Jun 05 10:44:26.999029 ip-10-0-138-107 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 10:44:26.999040 ip-10-0-138-107 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 10:44:26.999047 ip-10-0-138-107 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 10:44:26.999311 ip-10-0-138-107 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 10:44:36.779405 ip-10-0-138-107 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 05 10:44:36.779420 ip-10-0-138-107 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8f76124d8ec64162b546de0efe131f38 -- Jun 05 10:46:51.096513 ip-10-0-138-107 systemd[1]: Starting Kubernetes Kubelet... Jun 05 10:46:51.490791 ip-10-0-138-107 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 10:46:51.490791 ip-10-0-138-107 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 10:46:51.490791 ip-10-0-138-107 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 10:46:51.490791 ip-10-0-138-107 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 10:46:51.490791 ip-10-0-138-107 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 10:46:51.491958 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.491731 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 10:46:51.496317 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496302 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 10:46:51.496317 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496317 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496320 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496323 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496328 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496331 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496334 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496336 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496339 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496342 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496345 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496348 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496350 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496354 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496357 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496359 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496362 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496364 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496367 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496371 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496373 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 10:46:51.496380 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496376 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496379 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496382 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496384 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496388 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496390 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496393 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496396 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496399 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496403 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496406 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496409 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496411 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496414 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496416 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496418 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496421 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496423 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496426 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 10:46:51.496840 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496429 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496433 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496436 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496438 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496441 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496443 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496446 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496448 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496451 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496453 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496456 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496458 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496460 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496463 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496465 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496468 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496471 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496473 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496476 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 10:46:51.497291 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496480 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496482 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496485 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496487 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496490 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496492 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496494 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496496 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496499 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496501 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496503 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496506 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496508 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496511 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496514 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496516 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496518 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496522 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496525 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 10:46:51.497738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496528 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496530 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496533 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496535 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496538 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496540 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496542 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496545 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496547 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496551 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496553 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496556 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496558 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496560 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496563 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496565 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496567 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496570 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496573 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496575 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.496577 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 10:46:51.498195 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497275 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497282 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497285 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497288 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497291 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497294 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497297 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497300 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497302 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497305 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497307 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497309 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497312 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497314 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497317 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497319 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497322 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497324 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497326 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497329 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 10:46:51.498689 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497332 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497335 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497337 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497340 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497342 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497345 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497347 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497350 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497352 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497354 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497358 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497362 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497365 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497368 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497371 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497373 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497376 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497379 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497382 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 10:46:51.499206 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497384 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497387 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497389 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497392 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497394 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497397 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497399 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497402 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497404 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497407 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497410 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497413 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497417 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497420 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497423 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497425 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497428 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497431 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497433 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497436 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 10:46:51.499652 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497439 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497441 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497443 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497446 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497448 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497451 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497453 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497457 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497460 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497463 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497465 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497468 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497470 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497473 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497475 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497477 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497480 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497482 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497485 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 10:46:51.500126 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497488 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497490 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497492 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497495 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497497 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497500 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497504 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497506 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497509 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497511 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497513 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497516 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497518 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497520 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497523 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497525 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497527 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497530 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497532 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497534 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 10:46:51.500586 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497537 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497885 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497889 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497892 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497895 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497898 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497901 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497903 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497906 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497908 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497910 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497913 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497915 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497918 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497920 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497923 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497925 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497928 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497931 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497934 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 10:46:51.501050 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497936 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497940 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497944 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497947 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497950 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497952 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497955 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497958 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497960 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497963 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497965 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497968 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497971 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497973 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497976 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497983 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497986 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497988 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497991 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 10:46:51.501538 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497993 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.497997 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498001 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498003 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498006 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498008 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498011 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498013 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498016 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498018 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498021 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498023 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498026 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498028 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498030 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498033 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498035 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498038 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498040 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498043 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 10:46:51.502025 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498045 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498047 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498050 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498052 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498054 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498057 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498059 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498062 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498067 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498070 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498073 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498075 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498078 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498081 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498083 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498085 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498102 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498106 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498109 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 10:46:51.502518 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498112 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498115 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498118 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498120 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498123 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498126 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498128 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498131 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498133 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498135 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498138 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498140 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498142 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498145 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498147 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498149 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498152 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498154 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498156 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498159 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 10:46:51.502969 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498161 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.498179 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498245 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498252 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498258 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498262 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498266 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498269 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498273 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498277 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498280 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498283 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498286 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498290 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498293 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498297 2580 flags.go:64] FLAG: --cgroup-root="" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498300 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498303 2580 flags.go:64] FLAG: --client-ca-file="" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498306 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498309 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498313 2580 flags.go:64] FLAG: --cluster-domain="" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498315 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498318 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498321 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 10:46:51.503484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498324 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498328 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498330 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498333 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498336 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498340 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498342 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498345 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498348 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498352 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498356 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498359 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498361 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498364 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498367 2580 flags.go:64] FLAG: --enable-server="true" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498370 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498374 2580 flags.go:64] FLAG: --event-burst="100" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498377 2580 flags.go:64] FLAG: --event-qps="50" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498380 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498383 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498385 2580 flags.go:64] FLAG: --eviction-hard="" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498389 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498391 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498396 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498398 2580 flags.go:64] FLAG: --eviction-soft="" Jun 05 10:46:51.504054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498401 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498404 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498406 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498409 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498412 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498414 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498417 2580 flags.go:64] FLAG: --feature-gates="" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498420 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498423 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498426 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498429 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498432 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498434 2580 flags.go:64] FLAG: --help="false" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498437 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498440 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498443 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498446 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498449 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498452 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498455 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498458 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498461 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498463 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 10:46:51.504714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498466 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498469 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498472 2580 flags.go:64] FLAG: --kube-reserved="" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498475 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498478 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498480 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498483 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498486 2580 flags.go:64] FLAG: --lock-file="" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498489 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498492 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498495 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498500 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498503 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498505 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498508 2580 flags.go:64] FLAG: --logging-format="text" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498510 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498514 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498517 2580 flags.go:64] FLAG: --manifest-url="" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498519 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498523 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498526 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498530 2580 flags.go:64] FLAG: --max-pods="110" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498532 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498535 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498538 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 10:46:51.505364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498542 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498545 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498548 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498551 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498562 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498565 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498568 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498570 2580 flags.go:64] FLAG: --pod-cidr="" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.498573 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499358 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499361 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499365 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499368 2580 flags.go:64] FLAG: --port="10250" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499371 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499374 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ae97d2a598a0c5c4" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499378 2580 flags.go:64] FLAG: --qos-reserved="" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499381 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499384 2580 flags.go:64] FLAG: --register-node="true" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499387 2580 flags.go:64] FLAG: --register-with-taints="" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499390 2580 flags.go:64] FLAG: --registry-burst="10" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499393 2580 flags.go:64] FLAG: --registry-qps="5" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499396 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499399 2580 flags.go:64] FLAG: --reserved-memory="" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499402 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499405 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 10:46:51.505971 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499408 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499410 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499413 2580 flags.go:64] FLAG: --runonce="false" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499416 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499419 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499421 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499424 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499427 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499432 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499434 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499438 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499440 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499443 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499446 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499448 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499451 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499455 2580 flags.go:64] FLAG: --system-cgroups="" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499457 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499462 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499465 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499468 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499473 2580 flags.go:64] FLAG: --tls-min-version="" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499476 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499478 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499481 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 10:46:51.506572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499484 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499486 2580 flags.go:64] FLAG: --v="2" Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499490 2580 flags.go:64] FLAG: --version="false" Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499494 2580 flags.go:64] FLAG: --vmodule="" Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499498 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499501 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499619 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499623 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499626 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499629 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499632 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499635 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499637 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499640 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499642 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499646 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499648 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499651 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499653 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499656 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499659 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 10:46:51.507161 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499663 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499665 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499668 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499671 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499673 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499675 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499678 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499681 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499685 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499687 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499690 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499692 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499694 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499697 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499700 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499702 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499705 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499707 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499710 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 10:46:51.507665 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499712 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499715 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499718 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499720 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499722 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499725 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499728 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499731 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499733 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499736 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499738 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499741 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499743 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499746 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499748 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499750 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499752 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499756 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499758 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499760 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 10:46:51.508128 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499763 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499765 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499768 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499770 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499772 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499775 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499777 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499779 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499782 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499784 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499787 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499789 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499791 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499794 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499798 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499801 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499803 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499806 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499809 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 10:46:51.508715 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499811 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499814 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499816 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499819 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499822 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499824 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499827 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499829 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499831 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499834 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499845 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499848 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499851 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499854 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499857 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499859 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499862 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499864 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499867 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499869 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 10:46:51.509184 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499871 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499874 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499876 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499879 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499881 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.499885 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.499890 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.506384 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.506399 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.507151 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.507158 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507228 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507235 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507239 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 10:46:51.509667 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507242 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507245 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507248 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507250 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507253 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507256 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507258 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507261 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507263 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507266 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507269 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507272 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507274 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507277 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507279 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507282 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507285 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507287 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507290 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507292 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 10:46:51.510007 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507295 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507297 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507299 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507302 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507305 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507307 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507311 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507314 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507316 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507319 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507321 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507324 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507326 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507328 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507331 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507333 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507335 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507338 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507340 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507342 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 10:46:51.510487 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507344 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507347 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507349 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507352 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507354 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507356 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507359 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507361 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507363 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507367 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507370 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507373 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507376 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507378 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507381 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507383 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507385 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507388 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507392 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 10:46:51.510997 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507396 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507399 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507402 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507405 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507407 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507410 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507412 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507415 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507417 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507419 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507422 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507424 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507427 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507429 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507431 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507434 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507436 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507438 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507441 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 10:46:51.511462 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507443 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507445 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507448 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507450 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507452 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507455 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507457 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507459 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507462 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507464 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507467 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507469 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507472 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507475 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507478 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507480 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507483 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 10:46:51.511906 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507485 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.507490 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507602 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507607 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507609 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507612 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507614 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507616 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507619 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507621 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507623 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507626 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507628 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507630 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507633 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 10:46:51.512321 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507636 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507639 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507641 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507643 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507646 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507649 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507652 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507654 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507656 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507659 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507672 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507676 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507680 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507683 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507686 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507689 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507692 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507695 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507698 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 10:46:51.512681 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507702 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507704 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507707 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507709 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507712 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507714 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507717 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507719 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507721 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507724 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507726 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507728 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507730 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507733 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507735 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507738 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507740 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507742 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507744 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507747 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 10:46:51.513122 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507749 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507751 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507754 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507756 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507758 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507761 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507763 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507767 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507770 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507773 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507776 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507779 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507781 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507784 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507786 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507789 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507791 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507795 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507797 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 10:46:51.513589 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507800 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507802 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507805 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507807 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507810 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507812 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507814 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507817 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507819 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507821 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507824 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507826 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507829 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507831 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507834 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507844 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507846 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507849 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507851 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 10:46:51.514023 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507854 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 10:46:51.514481 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507856 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 10:46:51.514481 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507858 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 10:46:51.514481 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507861 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 10:46:51.514481 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507864 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 10:46:51.514481 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507867 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 10:46:51.514481 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507869 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 10:46:51.514481 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507872 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 10:46:51.514481 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:51.507874 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 10:46:51.514481 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.507878 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 10:46:51.514481 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.507978 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 10:46:51.516923 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.516907 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 10:46:51.518601 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.518589 2580 server.go:1019] "Starting client certificate rotation" Jun 05 10:46:51.518706 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.518692 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 10:46:51.518741 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.518726 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 10:46:51.522728 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.522705 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 10:46:51.523823 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.523805 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 10:46:51.538884 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.538861 2580 log.go:25] "Validated CRI v1 runtime API" Jun 05 10:46:51.542020 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.542009 2580 log.go:25] "Validated CRI v1 image API" Jun 05 10:46:51.542823 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.542806 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 10:46:51.547334 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.547316 2580 fs.go:135] Filesystem UUIDs: map[06ba46c1-287b-4c44-9d26-289b4358d344:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cdcfc44b-b0dc-4ea1-ab94-0b7ab9ab0d0c:/dev/nvme0n1p4] Jun 05 10:46:51.547405 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.547333 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 10:46:51.550516 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.550495 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 10:46:51.553260 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.553146 2580 manager.go:216] Machine: {Timestamp:2026-06-05 10:46:51.551926673 +0000 UTC m=+0.339374477 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199838 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec274a1b5d6768c4afb15f285b1dd08d SystemUUID:ec274a1b-5d67-68c4-afb1-5f285b1dd08d BootID:8f76124d-8ec6-4162-b546-de0efe131f38 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:5b:c9:8b:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:5b:c9:8b:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:41:49:f3:90:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 10:46:51.553260 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.553259 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 10:46:51.553377 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.553366 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 10:46:51.556114 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.556087 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 10:46:51.556264 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.556117 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 10:46:51.556823 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.556814 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 10:46:51.556852 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.556826 2580 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 10:46:51.556852 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.556834 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 10:46:51.558115 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.558105 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 10:46:51.558846 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.558836 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 10:46:51.561527 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.561515 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 05 10:46:51.561638 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.561629 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 10:46:51.561667 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.561658 2580 kubelet.go:486] "Attempting to sync node with API server" Jun 05 10:46:51.561693 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.561668 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 10:46:51.561693 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.561682 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 10:46:51.561693 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.561692 2580 kubelet.go:398] "Adding apiserver pod source" Jun 05 10:46:51.561785 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.561700 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 10:46:51.562535 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.562070 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 10:46:51.562535 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.562090 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 10:46:51.566243 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.566207 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 10:46:51.567830 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.567816 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 10:46:51.567881 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.567858 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 10:46:51.568408 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568397 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 10:46:51.568439 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568412 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 10:46:51.568439 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568418 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 10:46:51.568439 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568423 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 10:46:51.568439 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568431 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 10:46:51.568439 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568436 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 10:46:51.568561 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568500 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 10:46:51.568561 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568506 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 10:46:51.568561 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568513 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 10:46:51.568561 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568518 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 10:46:51.568561 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568526 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 10:46:51.568561 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.568534 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 10:46:51.569389 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.569378 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 10:46:51.569434 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.569391 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 10:46:51.571144 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.571123 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 10:46:51.571277 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.571254 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 10:46:51.571323 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.571275 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 10:46:51.576401 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.576389 2580 server.go:1268] "Started kubelet" Jun 05 10:46:51.576474 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.576452 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 10:46:51.576862 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.576831 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 10:46:51.576940 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.576881 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 10:46:51.577379 ip-10-0-138-107 systemd[1]: Started Kubernetes Kubelet. Jun 05 10:46:51.579070 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.579051 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 10:46:51.579145 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.579082 2580 server.go:310] "Adding debug handlers to kubelet server" Jun 05 10:46:51.581975 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.580905 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-107.ec2.internal.18b629926f07e642 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-107.ec2.internal,UID:ip-10-0-138-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-107.ec2.internal,},FirstTimestamp:2026-06-05 10:46:51.576362562 +0000 UTC m=+0.363810366,LastTimestamp:2026-06-05 10:46:51.576362562 +0000 UTC m=+0.363810366,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-107.ec2.internal,}" Jun 05 10:46:51.583118 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.583102 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 10:46:51.583384 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.583366 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 10:46:51.583384 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.583382 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 10:46:51.583523 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.583501 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:51.583880 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.583860 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 10:46:51.583967 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.583862 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 10:46:51.583967 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.583912 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 10:46:51.584063 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.583992 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 05 10:46:51.584063 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.584001 2580 reconciler.go:29] "Reconciler: start to sync state" Jun 05 10:46:51.584301 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.584285 2580 factory.go:55] Registering systemd factory Jun 05 10:46:51.584365 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.584304 2580 factory.go:223] Registration of the systemd container factory successfully Jun 05 10:46:51.584529 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.584512 2580 factory.go:153] Registering CRI-O factory Jun 05 10:46:51.584529 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.584530 2580 factory.go:223] Registration of the crio container factory successfully Jun 05 10:46:51.584661 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.584581 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 10:46:51.584661 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.584604 2580 factory.go:103] Registering Raw factory Jun 05 10:46:51.584661 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.584619 2580 manager.go:1196] Started watching for new ooms in manager Jun 05 10:46:51.584943 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.584931 2580 manager.go:349] Starting recovery of all containers Jun 05 10:46:51.595700 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.595662 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 10:46:51.595791 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.595772 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 10:46:51.598404 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.598383 2580 manager.go:354] Recovery completed Jun 05 10:46:51.601305 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.601280 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sw47t" Jun 05 10:46:51.603280 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.603265 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 10:46:51.605812 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.605793 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory" Jun 05 10:46:51.605888 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.605833 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 10:46:51.605888 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.605850 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID" Jun 05 10:46:51.606451 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.606437 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 10:46:51.606451 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.606447 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 10:46:51.606548 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.606462 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 05 10:46:51.606548 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.606469 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 10:46:51.607621 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.607609 2580 policy_none.go:49] "None policy: Start" Jun 05 10:46:51.607672 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.607625 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 10:46:51.607672 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.607638 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 10:46:51.608051 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.608028 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory" Jun 05 10:46:51.608138 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.608061 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 10:46:51.608138 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.608076 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID" Jun 05 10:46:51.608295 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.608220 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-107.ec2.internal.18b6299270c944f8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-107.ec2.internal,UID:ip-10-0-138-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-107.ec2.internal,},FirstTimestamp:2026-06-05 10:46:51.605812472 +0000 UTC m=+0.393260284,LastTimestamp:2026-06-05 10:46:51.605812472 +0000 UTC m=+0.393260284,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-107.ec2.internal,}" Jun 05 10:46:51.609234 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.609209 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sw47t" Jun 05 10:46:51.609861 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.609846 2580 policy_none.go:47] "Start" Jun 05 10:46:51.646543 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.646516 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 10:46:51.650284 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.647723 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 10:46:51.650284 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.647760 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 10:46:51.650284 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.647779 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 10:46:51.650284 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.647862 2580 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 05 10:46:51.650284 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.649924 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 10:46:51.652751 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.652737 2580 manager.go:337] "Starting Device Plugin manager" Jun 05 10:46:51.652835 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.652773 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 10:46:51.652835 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.652783 2580 server.go:87] "Starting device plugin registration server" Jun 05 10:46:51.653054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.653043 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 10:46:51.653096 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.653058 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 10:46:51.653207 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.653192 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 10:46:51.653287 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.653272 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 10:46:51.653333 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.653289 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 10:46:51.653885 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.653867 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 10:46:51.653944 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.653920 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:51.748682 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.748658 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal"] Jun 05 10:46:51.748781 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.748742 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 10:46:51.749822 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.749804 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory" Jun 05 10:46:51.749920 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.749835 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 10:46:51.749920 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.749848 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID" Jun 05 10:46:51.750980 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.750968 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 10:46:51.751086 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.751071 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.751150 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.751100 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 10:46:51.751684 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.751669 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory" Jun 05 10:46:51.751746 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.751695 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 10:46:51.751746 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.751710 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID" Jun 05 10:46:51.751829 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.751711 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory" Jun 05 10:46:51.751829 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.751809 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 10:46:51.751920 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.751829 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID" Jun 05 10:46:51.752956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.752940 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.753046 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.752974 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 10:46:51.753123 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.753109 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 10:46:51.753750 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.753733 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory" Jun 05 10:46:51.753822 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.753759 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 10:46:51.753822 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.753773 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID" Jun 05 10:46:51.753897 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.753822 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientMemory" Jun 05 10:46:51.753897 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.753851 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 10:46:51.753897 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.753862 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeHasSufficientPID" Jun 05 10:46:51.753897 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.753879 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.760208 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.760194 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.760265 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.760213 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-107.ec2.internal\": node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:51.778903 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.778877 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-107.ec2.internal\" not found" node="ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.783394 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.783379 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-107.ec2.internal\" not found" node="ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.785894 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.785876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43a2b82bdab6b7ce84c0a457af7d0312-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"43a2b82bdab6b7ce84c0a457af7d0312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.785970 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.785907 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43a2b82bdab6b7ce84c0a457af7d0312-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"43a2b82bdab6b7ce84c0a457af7d0312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.785970 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.785931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0fd7eff5e644b9c4f6c4c8f52a7fb9a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-107.ec2.internal\" (UID: \"a0fd7eff5e644b9c4f6c4c8f52a7fb9a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.787939 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.787923 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:51.886081 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.886047 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43a2b82bdab6b7ce84c0a457af7d0312-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"43a2b82bdab6b7ce84c0a457af7d0312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.886081 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.886081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43a2b82bdab6b7ce84c0a457af7d0312-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"43a2b82bdab6b7ce84c0a457af7d0312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.886264 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.886102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0fd7eff5e644b9c4f6c4c8f52a7fb9a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-107.ec2.internal\" (UID: \"a0fd7eff5e644b9c4f6c4c8f52a7fb9a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.886264 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.886140 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43a2b82bdab6b7ce84c0a457af7d0312-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"43a2b82bdab6b7ce84c0a457af7d0312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.886264 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.886159 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0fd7eff5e644b9c4f6c4c8f52a7fb9a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-107.ec2.internal\" (UID: \"a0fd7eff5e644b9c4f6c4c8f52a7fb9a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.886264 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:51.886140 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43a2b82bdab6b7ce84c0a457af7d0312-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal\" (UID: \"43a2b82bdab6b7ce84c0a457af7d0312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" Jun 05 10:46:51.888160 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.888142 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:51.989036 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:51.989010 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:52.082497 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.082421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" Jun 05 10:46:52.087808 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.087789 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" Jun 05 10:46:52.089937 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:52.089920 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:52.190956 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:52.190922 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:52.291429 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:52.291392 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:52.392006 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:52.391927 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:52.492588 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:52.492419 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:52.517608 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.517577 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 10:46:52.517762 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.517749 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 10:46:52.578383 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:52.578352 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0fd7eff5e644b9c4f6c4c8f52a7fb9a.slice/crio-a826bc920fce703bb7d6e2b613371194aab042eec3e582d4152a837e300f41ca WatchSource:0}: Error finding container a826bc920fce703bb7d6e2b613371194aab042eec3e582d4152a837e300f41ca: Status 404 returned error can't find the container with id a826bc920fce703bb7d6e2b613371194aab042eec3e582d4152a837e300f41ca Jun 05 10:46:52.578523 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:52.578510 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a2b82bdab6b7ce84c0a457af7d0312.slice/crio-cbf9e7153cf989a261186236d371c3caf429fbbf725ab615249a511e3629ae73 WatchSource:0}: Error finding container cbf9e7153cf989a261186236d371c3caf429fbbf725ab615249a511e3629ae73: Status 404 returned error can't find the container with id cbf9e7153cf989a261186236d371c3caf429fbbf725ab615249a511e3629ae73 Jun 05 10:46:52.583484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.583464 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 10:46:52.593037 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:52.593008 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:52.612110 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.612074 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 10:41:51 +0000 UTC" deadline="2027-11-22 04:21:06.139448167 +0000 UTC" Jun 05 10:46:52.612110 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.612104 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12833h34m13.527346716s" Jun 05 10:46:52.651596 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.651483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" event={"ID":"a0fd7eff5e644b9c4f6c4c8f52a7fb9a","Type":"ContainerStarted","Data":"a826bc920fce703bb7d6e2b613371194aab042eec3e582d4152a837e300f41ca"} Jun 05 10:46:52.652543 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.652523 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" event={"ID":"43a2b82bdab6b7ce84c0a457af7d0312","Type":"ContainerStarted","Data":"cbf9e7153cf989a261186236d371c3caf429fbbf725ab615249a511e3629ae73"} Jun 05 10:46:52.693134 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:52.693086 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:52.737927 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.737904 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 10:46:52.793339 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:52.793317 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-107.ec2.internal\" not found" Jun 05 10:46:52.793492 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.793477 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 10:46:52.883842 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.883794 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" Jun 05 10:46:52.902288 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.902221 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 10:46:52.905814 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.905785 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" Jun 05 10:46:52.917083 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:52.917061 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 10:46:53.050198 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.050150 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 10:46:53.563772 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.563737 2580 apiserver.go:52] "Watching apiserver" Jun 05 10:46:53.571487 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.571454 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 10:46:53.573095 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.572658 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62","openshift-cluster-node-tuning-operator/tuned-zd72w","openshift-image-registry/node-ca-lwdlg","openshift-multus/multus-additional-cni-plugins-54df8","openshift-multus/multus-mrckg","openshift-ovn-kubernetes/ovnkube-node-ghh4r","kube-system/global-pull-secret-syncer-lm5dk","openshift-dns/node-resolver-4fz2m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal","openshift-multus/network-metrics-daemon-w5msc","openshift-network-diagnostics/network-check-target-xnbrx","openshift-network-operator/iptables-alerter-knrgr","kube-system/konnectivity-agent-qh698"] Jun 05 10:46:53.574385 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.574362 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.576015 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.575982 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4fz2m" Jun 05 10:46:53.577320 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.577300 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.578951 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.578929 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 10:46:53.579051 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.579009 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lwdlg" Jun 05 10:46:53.579437 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.579418 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 10:46:53.579533 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.579459 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4w59h\"" Jun 05 10:46:53.579533 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.579423 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 10:46:53.580148 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.579912 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 10:46:53.580148 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.579943 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 10:46:53.580148 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.579986 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 10:46:53.581548 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.580426 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 10:46:53.581548 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.580690 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.581548 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.580926 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 10:46:53.581548 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.581240 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 10:46:53.581548 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.581359 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x4hgb\"" Jun 05 10:46:53.581881 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.581763 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.583149 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.582089 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 10:46:53.583149 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.582308 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 10:46:53.583149 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.582323 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 10:46:53.583149 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.582769 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rqbq7\"" Jun 05 10:46:53.583149 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.582835 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9qllq\"" Jun 05 10:46:53.583149 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.583041 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 10:46:53.590242 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.589637 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:53.590242 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.589651 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-knrgr" Jun 05 10:46:53.590242 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:53.589872 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:46:53.590242 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.589935 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.590689 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.590659 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 10:46:53.591230 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.590886 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 10:46:53.591230 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.590937 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 10:46:53.591230 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.591038 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 10:46:53.591230 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.591187 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 10:46:53.591458 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.591347 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-smqls\"" Jun 05 10:46:53.591508 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.591479 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 10:46:53.591584 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.591562 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 10:46:53.591723 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.591565 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 10:46:53.591723 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.591662 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8clb7\"" Jun 05 10:46:53.591837 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.591737 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 10:46:53.592710 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.592459 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:46:53.592710 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:53.592524 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:46:53.593811 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.593790 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:53.593899 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:53.593870 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:46:53.594406 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.594383 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 10:46:53.594481 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.594423 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 10:46:53.594849 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.594653 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 10:46:53.594984 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.594969 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qh698" Jun 05 10:46:53.595081 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595065 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-var-lib-kubelet\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.595153 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595091 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7871c10-514e-415d-ab43-518a6358a6db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.595153 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-run-netns\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.595153 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncfqp\" (UniqueName: \"kubernetes.io/projected/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-kube-api-access-ncfqp\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:53.595153 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-ovn-node-metrics-cert\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595178 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-host\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.594969 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zs5gw\"" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595199 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aca12326-5f8f-4534-aaa1-6bc006550b18-tmp\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595220 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qzjd\" (UniqueName: \"kubernetes.io/projected/aca12326-5f8f-4534-aaa1-6bc006550b18-kube-api-access-4qzjd\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-run-multus-certs\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-node-log\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595341 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595356 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d27t2\"" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595372 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-device-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.595416 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-modprobe-d\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595429 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-tuned\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-run-openvswitch\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7871c10-514e-415d-ab43-518a6358a6db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595529 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-env-overrides\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-sys\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79890b97-8df2-4cbf-9076-358cf6ca8e70-host\") pod \"node-ca-lwdlg\" (UID: \"79890b97-8df2-4cbf-9076-358cf6ca8e70\") " pod="openshift-image-registry/node-ca-lwdlg" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595648 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/422e93d0-0b10-4483-9e12-5f57cfc85714-iptables-alerter-script\") pod \"iptables-alerter-knrgr\" (UID: \"422e93d0-0b10-4483-9e12-5f57cfc85714\") " pod="openshift-network-operator/iptables-alerter-knrgr" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595677 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-sysctl-d\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595704 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/422e93d0-0b10-4483-9e12-5f57cfc85714-host-slash\") pod \"iptables-alerter-knrgr\" (UID: \"422e93d0-0b10-4483-9e12-5f57cfc85714\") " pod="openshift-network-operator/iptables-alerter-knrgr" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-cni-dir\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595748 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-hostroot\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595780 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-run-netns\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595795 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7871c10-514e-415d-ab43-518a6358a6db-cni-binary-copy\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595818 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-socket-dir-parent\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-run-k8s-cni-cncf-io\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.595956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-ovnkube-config\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-os-release\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqs9q\" (UniqueName: \"kubernetes.io/projected/3fc2b3f4-5d2e-4654-8748-770ab05d667b-kube-api-access-sqs9q\") pod \"node-resolver-4fz2m\" (UID: \"3fc2b3f4-5d2e-4654-8748-770ab05d667b\") " pod="openshift-dns/node-resolver-4fz2m" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-run\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595975 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-lib-modules\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.595993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-log-socket\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596065 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4krz8\" (UniqueName: \"kubernetes.io/projected/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-kube-api-access-4krz8\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596091 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-system-cni-dir\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596114 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fc2b3f4-5d2e-4654-8748-770ab05d667b-tmp-dir\") pod \"node-resolver-4fz2m\" (UID: \"3fc2b3f4-5d2e-4654-8748-770ab05d667b\") " pod="openshift-dns/node-resolver-4fz2m" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596143 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd94t\" (UniqueName: \"kubernetes.io/projected/e7871c10-514e-415d-ab43-518a6358a6db-kube-api-access-kd94t\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596188 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596223 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-system-cni-dir\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596247 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-systemd-units\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596269 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-run-systemd\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-cnibin\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.596545 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596381 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-kubernetes\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dc070cf-093c-4d58-a4f5-a2fd871a211b-cni-binary-copy\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-etc-kubernetes\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-kubelet\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-sys-fs\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wsl9\" (UniqueName: \"kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9\") pod \"network-check-target-xnbrx\" (UID: \"6d815734-8fd9-4443-9343-79861f036e8f\") " pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc9td\" (UniqueName: \"kubernetes.io/projected/422e93d0-0b10-4483-9e12-5f57cfc85714-kube-api-access-gc9td\") pod \"iptables-alerter-knrgr\" (UID: \"422e93d0-0b10-4483-9e12-5f57cfc85714\") " pod="openshift-network-operator/iptables-alerter-knrgr" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-cnibin\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns6jg\" (UniqueName: \"kubernetes.io/projected/2dc070cf-093c-4d58-a4f5-a2fd871a211b-kube-api-access-ns6jg\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596633 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-slash\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-etc-openvswitch\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596703 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2gt9\" (UniqueName: \"kubernetes.io/projected/328b037c-30a2-4e1b-86d4-1ffde9de29cb-kube-api-access-p2gt9\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596729 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-sysconfig\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-os-release\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596801 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-var-lib-cni-multus\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-var-lib-kubelet\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.597238 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596845 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596860 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79890b97-8df2-4cbf-9076-358cf6ca8e70-serviceca\") pod \"node-ca-lwdlg\" (UID: \"79890b97-8df2-4cbf-9076-358cf6ca8e70\") " pod="openshift-image-registry/node-ca-lwdlg" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h6p7\" (UniqueName: \"kubernetes.io/projected/79890b97-8df2-4cbf-9076-358cf6ca8e70-kube-api-access-2h6p7\") pod \"node-ca-lwdlg\" (UID: \"79890b97-8df2-4cbf-9076-358cf6ca8e70\") " pod="openshift-image-registry/node-ca-lwdlg" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596942 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-conf-dir\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596965 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-cni-bin\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.596986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-registration-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fc2b3f4-5d2e-4654-8748-770ab05d667b-hosts-file\") pod \"node-resolver-4fz2m\" (UID: \"3fc2b3f4-5d2e-4654-8748-770ab05d667b\") " pod="openshift-dns/node-resolver-4fz2m" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597022 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-sysctl-conf\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597037 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-socket-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-var-lib-cni-bin\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597079 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-var-lib-openvswitch\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597116 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-ovnkube-script-lib\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597141 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597222 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-daemon-config\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597346 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-run-ovn\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597379 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-cni-netd\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.597787 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-systemd\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.598380 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.597808 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cdn75\"" Jun 05 10:46:53.598380 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.598132 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 10:46:53.598380 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.598214 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 10:46:53.607722 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.607701 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 10:46:53.648481 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.648459 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zln24" Jun 05 10:46:53.657258 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.657239 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zln24" Jun 05 10:46:53.685457 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.685428 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 10:46:53.698404 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-socket-dir-parent\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.698537 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698406 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-run-k8s-cni-cncf-io\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.698537 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-ovnkube-config\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.698537 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-os-release\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.698537 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqs9q\" (UniqueName: \"kubernetes.io/projected/3fc2b3f4-5d2e-4654-8748-770ab05d667b-kube-api-access-sqs9q\") pod \"node-resolver-4fz2m\" (UID: \"3fc2b3f4-5d2e-4654-8748-770ab05d667b\") " pod="openshift-dns/node-resolver-4fz2m" Jun 05 10:46:53.698537 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698491 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-socket-dir-parent\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.698537 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698502 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-run\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.698537 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698488 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-run-k8s-cni-cncf-io\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.698537 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698527 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-lib-modules\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698550 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-log-socket\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698578 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-run\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698592 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698597 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4krz8\" (UniqueName: \"kubernetes.io/projected/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-kube-api-access-4krz8\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698637 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-log-socket\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-system-cni-dir\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698552 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-os-release\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698655 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-lib-modules\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fc2b3f4-5d2e-4654-8748-770ab05d667b-tmp-dir\") pod \"node-resolver-4fz2m\" (UID: \"3fc2b3f4-5d2e-4654-8748-770ab05d667b\") " pod="openshift-dns/node-resolver-4fz2m" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698773 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-system-cni-dir\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698815 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-dbus\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698849 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd94t\" (UniqueName: \"kubernetes.io/projected/e7871c10-514e-415d-ab43-518a6358a6db-kube-api-access-kd94t\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.698918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.698919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-system-cni-dir\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699042 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-systemd-units\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699097 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fc2b3f4-5d2e-4654-8748-770ab05d667b-tmp-dir\") pod \"node-resolver-4fz2m\" (UID: \"3fc2b3f4-5d2e-4654-8748-770ab05d667b\") " pod="openshift-dns/node-resolver-4fz2m" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699112 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-system-cni-dir\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699113 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-systemd-units\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699115 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-ovnkube-config\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-run-systemd\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-cnibin\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699180 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-kubernetes\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dc070cf-093c-4d58-a4f5-a2fd871a211b-cni-binary-copy\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699210 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-run-systemd\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-etc-kubernetes\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699231 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-cnibin\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-kubelet\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699260 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-kubernetes\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-sys-fs\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wsl9\" (UniqueName: \"kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9\") pod \"network-check-target-xnbrx\" (UID: \"6d815734-8fd9-4443-9343-79861f036e8f\") " pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:46:53.699612 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699300 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-etc-kubernetes\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699318 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-kubelet\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc9td\" (UniqueName: \"kubernetes.io/projected/422e93d0-0b10-4483-9e12-5f57cfc85714-kube-api-access-gc9td\") pod \"iptables-alerter-knrgr\" (UID: \"422e93d0-0b10-4483-9e12-5f57cfc85714\") " pod="openshift-network-operator/iptables-alerter-knrgr" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699347 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-sys-fs\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699358 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-cnibin\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-cnibin\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns6jg\" (UniqueName: \"kubernetes.io/projected/2dc070cf-093c-4d58-a4f5-a2fd871a211b-kube-api-access-ns6jg\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-slash\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-etc-openvswitch\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gt9\" (UniqueName: \"kubernetes.io/projected/328b037c-30a2-4e1b-86d4-1ffde9de29cb-kube-api-access-p2gt9\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-sysconfig\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699806 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-os-release\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699829 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-var-lib-cni-multus\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-var-lib-kubelet\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699879 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79890b97-8df2-4cbf-9076-358cf6ca8e70-serviceca\") pod \"node-ca-lwdlg\" (UID: \"79890b97-8df2-4cbf-9076-358cf6ca8e70\") " pod="openshift-image-registry/node-ca-lwdlg" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6p7\" (UniqueName: \"kubernetes.io/projected/79890b97-8df2-4cbf-9076-358cf6ca8e70-kube-api-access-2h6p7\") pod \"node-ca-lwdlg\" (UID: \"79890b97-8df2-4cbf-9076-358cf6ca8e70\") " pod="openshift-image-registry/node-ca-lwdlg" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-conf-dir\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700304 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699938 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-cni-bin\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699972 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-registration-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699982 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-var-lib-cni-multus\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699607 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-etc-openvswitch\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fc2b3f4-5d2e-4654-8748-770ab05d667b-hosts-file\") pod \"node-resolver-4fz2m\" (UID: \"3fc2b3f4-5d2e-4654-8748-770ab05d667b\") " pod="openshift-dns/node-resolver-4fz2m" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699615 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-slash\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700019 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-sysctl-conf\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/641916f0-a44b-4d82-bdb9-188e363ca590-agent-certs\") pod \"konnectivity-agent-qh698\" (UID: \"641916f0-a44b-4d82-bdb9-188e363ca590\") " pod="kube-system/konnectivity-agent-qh698" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700068 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-os-release\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700077 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-socket-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.699700 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dc070cf-093c-4d58-a4f5-a2fd871a211b-cni-binary-copy\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-var-lib-cni-bin\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700122 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-var-lib-openvswitch\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700134 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-var-lib-kubelet\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700137 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-ovnkube-script-lib\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700180 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.700956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-daemon-config\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700228 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-run-ovn\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-cni-netd\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700271 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-systemd\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-var-lib-kubelet\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/641916f0-a44b-4d82-bdb9-188e363ca590-konnectivity-ca\") pod \"konnectivity-agent-qh698\" (UID: \"641916f0-a44b-4d82-bdb9-188e363ca590\") " pod="kube-system/konnectivity-agent-qh698" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700325 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7871c10-514e-415d-ab43-518a6358a6db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700351 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-run-netns\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncfqp\" (UniqueName: \"kubernetes.io/projected/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-kube-api-access-ncfqp\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700383 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-ovn-node-metrics-cert\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-host\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aca12326-5f8f-4534-aaa1-6bc006550b18-tmp\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qzjd\" (UniqueName: \"kubernetes.io/projected/aca12326-5f8f-4534-aaa1-6bc006550b18-kube-api-access-4qzjd\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-run-multus-certs\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700497 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-node-log\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700543 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.701579 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-device-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700575 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-ovnkube-script-lib\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700591 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-modprobe-d\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-tuned\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-run-openvswitch\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700646 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7871c10-514e-415d-ab43-518a6358a6db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-env-overrides\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-sys\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700693 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fc2b3f4-5d2e-4654-8748-770ab05d667b-hosts-file\") pod \"node-resolver-4fz2m\" (UID: \"3fc2b3f4-5d2e-4654-8748-770ab05d667b\") " pod="openshift-dns/node-resolver-4fz2m" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79890b97-8df2-4cbf-9076-358cf6ca8e70-host\") pod \"node-ca-lwdlg\" (UID: \"79890b97-8df2-4cbf-9076-358cf6ca8e70\") " pod="openshift-image-registry/node-ca-lwdlg" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700720 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/422e93d0-0b10-4483-9e12-5f57cfc85714-iptables-alerter-script\") pod \"iptables-alerter-knrgr\" (UID: \"422e93d0-0b10-4483-9e12-5f57cfc85714\") " pod="openshift-network-operator/iptables-alerter-knrgr" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-sysctl-d\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700736 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-sysconfig\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/422e93d0-0b10-4483-9e12-5f57cfc85714-host-slash\") pod \"iptables-alerter-knrgr\" (UID: \"422e93d0-0b10-4483-9e12-5f57cfc85714\") " pod="openshift-network-operator/iptables-alerter-knrgr" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-cni-dir\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-hostroot\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-run-netns\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7871c10-514e-415d-ab43-518a6358a6db-cni-binary-copy\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.702227 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700836 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-sysctl-conf\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700841 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-kubelet-config\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700921 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-node-log\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700959 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700992 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701038 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-device-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701111 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-modprobe-d\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701258 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79890b97-8df2-4cbf-9076-358cf6ca8e70-serviceca\") pod \"node-ca-lwdlg\" (UID: \"79890b97-8df2-4cbf-9076-358cf6ca8e70\") " pod="openshift-image-registry/node-ca-lwdlg" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:53.701338 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701365 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:53.701415 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs podName:8206f9d1-eeae-4107-8ec4-947a6f0f34a2 nodeName:}" failed. No retries permitted until 2026-06-05 10:46:54.201386289 +0000 UTC m=+2.988834094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs") pod "network-metrics-daemon-w5msc" (UID: "8206f9d1-eeae-4107-8ec4-947a6f0f34a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701649 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-host\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701705 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-run-ovn\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701736 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-conf-dir\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701765 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-cni-bin\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701779 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-cni-netd\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701826 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-systemd\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701865 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-var-lib-kubelet\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.703181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.701905 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7871c10-514e-415d-ab43-518a6358a6db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.702374 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-daemon-config\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.702374 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7871c10-514e-415d-ab43-518a6358a6db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.702426 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-run-netns\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.700630 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-registration-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703149 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-run-openvswitch\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703157 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-multus-cni-dir\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703209 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-sys\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703231 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-host-run-netns\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703456 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-sysctl-d\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703505 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79890b97-8df2-4cbf-9076-358cf6ca8e70-host\") pod \"node-ca-lwdlg\" (UID: \"79890b97-8df2-4cbf-9076-358cf6ca8e70\") " pod="openshift-image-registry/node-ca-lwdlg" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703602 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-env-overrides\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703641 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7871c10-514e-415d-ab43-518a6358a6db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703786 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/422e93d0-0b10-4483-9e12-5f57cfc85714-host-slash\") pod \"iptables-alerter-knrgr\" (UID: \"422e93d0-0b10-4483-9e12-5f57cfc85714\") " pod="openshift-network-operator/iptables-alerter-knrgr" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703844 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-hostroot\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.703979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703957 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-var-lib-cni-bin\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.704662 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.703997 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-var-lib-openvswitch\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.704662 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.704036 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2dc070cf-093c-4d58-a4f5-a2fd871a211b-host-run-multus-certs\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.704662 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.704050 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/328b037c-30a2-4e1b-86d4-1ffde9de29cb-socket-dir\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.704662 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.704137 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/422e93d0-0b10-4483-9e12-5f57cfc85714-iptables-alerter-script\") pod \"iptables-alerter-knrgr\" (UID: \"422e93d0-0b10-4483-9e12-5f57cfc85714\") " pod="openshift-network-operator/iptables-alerter-knrgr" Jun 05 10:46:53.704993 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.704964 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aca12326-5f8f-4534-aaa1-6bc006550b18-etc-tuned\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.706670 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.706599 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7871c10-514e-415d-ab43-518a6358a6db-cni-binary-copy\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.708389 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.708350 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aca12326-5f8f-4534-aaa1-6bc006550b18-tmp\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.710314 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.710222 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqs9q\" (UniqueName: \"kubernetes.io/projected/3fc2b3f4-5d2e-4654-8748-770ab05d667b-kube-api-access-sqs9q\") pod \"node-resolver-4fz2m\" (UID: \"3fc2b3f4-5d2e-4654-8748-770ab05d667b\") " pod="openshift-dns/node-resolver-4fz2m" Jun 05 10:46:53.710644 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.710623 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-ovn-node-metrics-cert\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.712771 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.712749 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4krz8\" (UniqueName: \"kubernetes.io/projected/f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c-kube-api-access-4krz8\") pod \"ovnkube-node-ghh4r\" (UID: \"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.712928 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.712905 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc9td\" (UniqueName: \"kubernetes.io/projected/422e93d0-0b10-4483-9e12-5f57cfc85714-kube-api-access-gc9td\") pod \"iptables-alerter-knrgr\" (UID: \"422e93d0-0b10-4483-9e12-5f57cfc85714\") " pod="openshift-network-operator/iptables-alerter-knrgr" Jun 05 10:46:53.713650 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:53.713430 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 10:46:53.713650 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:53.713455 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 10:46:53.713650 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:53.713469 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8wsl9 for pod openshift-network-diagnostics/network-check-target-xnbrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:46:53.713650 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:53.713524 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9 podName:6d815734-8fd9-4443-9343-79861f036e8f nodeName:}" failed. No retries permitted until 2026-06-05 10:46:54.213507167 +0000 UTC m=+3.000954958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8wsl9" (UniqueName: "kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9") pod "network-check-target-xnbrx" (UID: "6d815734-8fd9-4443-9343-79861f036e8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:46:53.713650 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.713536 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns6jg\" (UniqueName: \"kubernetes.io/projected/2dc070cf-093c-4d58-a4f5-a2fd871a211b-kube-api-access-ns6jg\") pod \"multus-mrckg\" (UID: \"2dc070cf-093c-4d58-a4f5-a2fd871a211b\") " pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.714761 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.714733 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd94t\" (UniqueName: \"kubernetes.io/projected/e7871c10-514e-415d-ab43-518a6358a6db-kube-api-access-kd94t\") pod \"multus-additional-cni-plugins-54df8\" (UID: \"e7871c10-514e-415d-ab43-518a6358a6db\") " pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.715388 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.715319 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2gt9\" (UniqueName: \"kubernetes.io/projected/328b037c-30a2-4e1b-86d4-1ffde9de29cb-kube-api-access-p2gt9\") pod \"aws-ebs-csi-driver-node-vwl62\" (UID: \"328b037c-30a2-4e1b-86d4-1ffde9de29cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.716788 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.716758 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncfqp\" (UniqueName: \"kubernetes.io/projected/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-kube-api-access-ncfqp\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:53.717145 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.717123 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h6p7\" (UniqueName: \"kubernetes.io/projected/79890b97-8df2-4cbf-9076-358cf6ca8e70-kube-api-access-2h6p7\") pod \"node-ca-lwdlg\" (UID: \"79890b97-8df2-4cbf-9076-358cf6ca8e70\") " pod="openshift-image-registry/node-ca-lwdlg" Jun 05 10:46:53.717261 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.717194 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qzjd\" (UniqueName: \"kubernetes.io/projected/aca12326-5f8f-4534-aaa1-6bc006550b18-kube-api-access-4qzjd\") pod \"tuned-zd72w\" (UID: \"aca12326-5f8f-4534-aaa1-6bc006550b18\") " pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.801157 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.801124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:53.801324 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.801180 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/641916f0-a44b-4d82-bdb9-188e363ca590-agent-certs\") pod \"konnectivity-agent-qh698\" (UID: \"641916f0-a44b-4d82-bdb9-188e363ca590\") " pod="kube-system/konnectivity-agent-qh698" Jun 05 10:46:53.801324 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.801208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/641916f0-a44b-4d82-bdb9-188e363ca590-konnectivity-ca\") pod \"konnectivity-agent-qh698\" (UID: \"641916f0-a44b-4d82-bdb9-188e363ca590\") " pod="kube-system/konnectivity-agent-qh698" Jun 05 10:46:53.801324 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.801244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-kubelet-config\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:53.801324 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.801271 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-dbus\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:53.801324 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:53.801275 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 10:46:53.801572 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:53.801360 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret podName:bcdb32b6-c598-4833-9f6c-8bd52ecc232d nodeName:}" failed. No retries permitted until 2026-06-05 10:46:54.301339652 +0000 UTC m=+3.088787451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret") pod "global-pull-secret-syncer-lm5dk" (UID: "bcdb32b6-c598-4833-9f6c-8bd52ecc232d") : object "kube-system"/"original-pull-secret" not registered Jun 05 10:46:53.801572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.801384 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-dbus\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:53.801572 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.801389 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-kubelet-config\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:53.801784 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.801765 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/641916f0-a44b-4d82-bdb9-188e363ca590-konnectivity-ca\") pod \"konnectivity-agent-qh698\" (UID: \"641916f0-a44b-4d82-bdb9-188e363ca590\") " pod="kube-system/konnectivity-agent-qh698" Jun 05 10:46:53.803948 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.803922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/641916f0-a44b-4d82-bdb9-188e363ca590-agent-certs\") pod \"konnectivity-agent-qh698\" (UID: \"641916f0-a44b-4d82-bdb9-188e363ca590\") " pod="kube-system/konnectivity-agent-qh698" Jun 05 10:46:53.895079 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.895002 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:46:53.901966 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.901944 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lwdlg" Jun 05 10:46:53.908573 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.908555 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4fz2m" Jun 05 10:46:53.913976 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.913955 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zd72w" Jun 05 10:46:53.919555 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.919539 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-54df8" Jun 05 10:46:53.926095 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.926076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" Jun 05 10:46:53.932665 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.932646 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-knrgr" Jun 05 10:46:53.940280 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.940260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrckg" Jun 05 10:46:53.943881 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:53.943852 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qh698" Jun 05 10:46:54.031302 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.031274 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 10:46:54.204213 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.204122 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:54.204367 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:54.204299 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:46:54.204408 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:54.204369 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs podName:8206f9d1-eeae-4107-8ec4-947a6f0f34a2 nodeName:}" failed. No retries permitted until 2026-06-05 10:46:55.204353151 +0000 UTC m=+3.991800942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs") pod "network-metrics-daemon-w5msc" (UID: "8206f9d1-eeae-4107-8ec4-947a6f0f34a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:46:54.304782 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.304733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wsl9\" (UniqueName: \"kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9\") pod \"network-check-target-xnbrx\" (UID: \"6d815734-8fd9-4443-9343-79861f036e8f\") " pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:46:54.304927 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.304814 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:54.304927 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:54.304906 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 10:46:54.304927 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:54.304925 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 10:46:54.304927 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:54.304927 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 10:46:54.305108 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:54.304937 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8wsl9 for pod openshift-network-diagnostics/network-check-target-xnbrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:46:54.305108 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:54.304991 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9 podName:6d815734-8fd9-4443-9343-79861f036e8f nodeName:}" failed. No retries permitted until 2026-06-05 10:46:55.304972585 +0000 UTC m=+4.092420392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wsl9" (UniqueName: "kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9") pod "network-check-target-xnbrx" (UID: "6d815734-8fd9-4443-9343-79861f036e8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:46:54.305108 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:54.305036 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret podName:bcdb32b6-c598-4833-9f6c-8bd52ecc232d nodeName:}" failed. No retries permitted until 2026-06-05 10:46:55.305012291 +0000 UTC m=+4.092460086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret") pod "global-pull-secret-syncer-lm5dk" (UID: "bcdb32b6-c598-4833-9f6c-8bd52ecc232d") : object "kube-system"/"original-pull-secret" not registered Jun 05 10:46:54.403358 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:54.403335 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7871c10_514e_415d_ab43_518a6358a6db.slice/crio-ef7e5bf36f240dc90a110af1be4c57eb8fd87fb134b993fd22ca3ef03954b9d9 WatchSource:0}: Error finding container ef7e5bf36f240dc90a110af1be4c57eb8fd87fb134b993fd22ca3ef03954b9d9: Status 404 returned error can't find the container with id ef7e5bf36f240dc90a110af1be4c57eb8fd87fb134b993fd22ca3ef03954b9d9 Jun 05 10:46:54.414796 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:54.414766 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79890b97_8df2_4cbf_9076_358cf6ca8e70.slice/crio-f7ce3b509f166b0e30312c642b400fcd02c35dc4f4b6da04c7c61fe525e2d75a WatchSource:0}: Error finding container f7ce3b509f166b0e30312c642b400fcd02c35dc4f4b6da04c7c61fe525e2d75a: Status 404 returned error can't find the container with id f7ce3b509f166b0e30312c642b400fcd02c35dc4f4b6da04c7c61fe525e2d75a Jun 05 10:46:54.416139 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:54.416113 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc2b3f4_5d2e_4654_8748_770ab05d667b.slice/crio-b4d5bc47a6c4b107c84356cf91dfa6b6609ce4b0d8c11b603ffaea75f8addcae WatchSource:0}: Error finding container b4d5bc47a6c4b107c84356cf91dfa6b6609ce4b0d8c11b603ffaea75f8addcae: Status 404 returned error can't find the container with id b4d5bc47a6c4b107c84356cf91dfa6b6609ce4b0d8c11b603ffaea75f8addcae Jun 05 10:46:54.420313 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:54.420275 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod422e93d0_0b10_4483_9e12_5f57cfc85714.slice/crio-89270fa4244c97dd8e522b145bca0a3a36912e8e4990558c320c0f386312b836 WatchSource:0}: Error finding container 89270fa4244c97dd8e522b145bca0a3a36912e8e4990558c320c0f386312b836: Status 404 returned error can't find the container with id 89270fa4244c97dd8e522b145bca0a3a36912e8e4990558c320c0f386312b836 Jun 05 10:46:54.421738 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:54.421717 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca12326_5f8f_4534_aaa1_6bc006550b18.slice/crio-f160bae78f159e9c80d7af2a251630b2c26b7878df1f418f9c6f0e09648309dd WatchSource:0}: Error finding container f160bae78f159e9c80d7af2a251630b2c26b7878df1f418f9c6f0e09648309dd: Status 404 returned error can't find the container with id f160bae78f159e9c80d7af2a251630b2c26b7878df1f418f9c6f0e09648309dd Jun 05 10:46:54.424338 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:46:54.423424 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328b037c_30a2_4e1b_86d4_1ffde9de29cb.slice/crio-12aca77b84382858fcbfdcf192741b249af0773151c5c26d100e34843f537301 WatchSource:0}: Error finding container 12aca77b84382858fcbfdcf192741b249af0773151c5c26d100e34843f537301: Status 404 returned error can't find the container with id 12aca77b84382858fcbfdcf192741b249af0773151c5c26d100e34843f537301 Jun 05 10:46:54.656309 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.656272 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qh698" event={"ID":"641916f0-a44b-4d82-bdb9-188e363ca590","Type":"ContainerStarted","Data":"af5ca2e4387ac3c323a4fc3d5e1563cc761d720ac0cf6a64b6507b0ea09326c7"} Jun 05 10:46:54.657351 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.657328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" event={"ID":"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c","Type":"ContainerStarted","Data":"30efe0dcfcd2397cebf7d4ea2f34f4444dfc00e73c9bd27664864fa2cbcbc712"} Jun 05 10:46:54.658333 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.658314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" event={"ID":"328b037c-30a2-4e1b-86d4-1ffde9de29cb","Type":"ContainerStarted","Data":"12aca77b84382858fcbfdcf192741b249af0773151c5c26d100e34843f537301"} Jun 05 10:46:54.659086 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.659049 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 10:41:53 +0000 UTC" deadline="2028-02-22 07:01:18.480231014 +0000 UTC" Jun 05 10:46:54.659156 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.659088 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15044h14m23.821146647s" Jun 05 10:46:54.659265 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.659250 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-knrgr" event={"ID":"422e93d0-0b10-4483-9e12-5f57cfc85714","Type":"ContainerStarted","Data":"89270fa4244c97dd8e522b145bca0a3a36912e8e4990558c320c0f386312b836"} Jun 05 10:46:54.660400 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.660374 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54df8" event={"ID":"e7871c10-514e-415d-ab43-518a6358a6db","Type":"ContainerStarted","Data":"ef7e5bf36f240dc90a110af1be4c57eb8fd87fb134b993fd22ca3ef03954b9d9"} Jun 05 10:46:54.662119 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.662098 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" event={"ID":"a0fd7eff5e644b9c4f6c4c8f52a7fb9a","Type":"ContainerStarted","Data":"5bff500591f95a0a7dfb234e46b6313c309d4aebe7abbadb69b7bbd87e2fd827"} Jun 05 10:46:54.663141 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.663108 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrckg" event={"ID":"2dc070cf-093c-4d58-a4f5-a2fd871a211b","Type":"ContainerStarted","Data":"dcbb17bface2319a039c3814eacfdae2a34c3033f7ec6a7b9618d349823e37f5"} Jun 05 10:46:54.664213 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.664194 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zd72w" event={"ID":"aca12326-5f8f-4534-aaa1-6bc006550b18","Type":"ContainerStarted","Data":"f160bae78f159e9c80d7af2a251630b2c26b7878df1f418f9c6f0e09648309dd"} Jun 05 10:46:54.665208 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.665188 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4fz2m" event={"ID":"3fc2b3f4-5d2e-4654-8748-770ab05d667b","Type":"ContainerStarted","Data":"b4d5bc47a6c4b107c84356cf91dfa6b6609ce4b0d8c11b603ffaea75f8addcae"} Jun 05 10:46:54.666244 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.666226 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lwdlg" event={"ID":"79890b97-8df2-4cbf-9076-358cf6ca8e70","Type":"ContainerStarted","Data":"f7ce3b509f166b0e30312c642b400fcd02c35dc4f4b6da04c7c61fe525e2d75a"} Jun 05 10:46:54.677380 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:54.677337 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-107.ec2.internal" podStartSLOduration=2.677324123 podStartE2EDuration="2.677324123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:46:54.677095717 +0000 UTC m=+3.464543526" watchObservedRunningTime="2026-06-05 10:46:54.677324123 +0000 UTC m=+3.464771935" Jun 05 10:46:55.211690 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:55.211651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:55.211896 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:55.211873 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:46:55.211959 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:55.211936 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs podName:8206f9d1-eeae-4107-8ec4-947a6f0f34a2 nodeName:}" failed. No retries permitted until 2026-06-05 10:46:57.2119186 +0000 UTC m=+5.999366395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs") pod "network-metrics-daemon-w5msc" (UID: "8206f9d1-eeae-4107-8ec4-947a6f0f34a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:46:55.313889 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:55.313007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wsl9\" (UniqueName: \"kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9\") pod \"network-check-target-xnbrx\" (UID: \"6d815734-8fd9-4443-9343-79861f036e8f\") " pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:46:55.313889 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:55.313138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:55.313889 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:55.313306 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 10:46:55.313889 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:55.313366 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret podName:bcdb32b6-c598-4833-9f6c-8bd52ecc232d nodeName:}" failed. No retries permitted until 2026-06-05 10:46:57.313348041 +0000 UTC m=+6.100795834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret") pod "global-pull-secret-syncer-lm5dk" (UID: "bcdb32b6-c598-4833-9f6c-8bd52ecc232d") : object "kube-system"/"original-pull-secret" not registered Jun 05 10:46:55.313889 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:55.313775 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 10:46:55.313889 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:55.313792 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 10:46:55.313889 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:55.313806 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8wsl9 for pod openshift-network-diagnostics/network-check-target-xnbrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:46:55.313889 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:55.313847 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9 podName:6d815734-8fd9-4443-9343-79861f036e8f nodeName:}" failed. No retries permitted until 2026-06-05 10:46:57.313833723 +0000 UTC m=+6.101281517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wsl9" (UniqueName: "kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9") pod "network-check-target-xnbrx" (UID: "6d815734-8fd9-4443-9343-79861f036e8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:46:55.651039 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:55.650963 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:46:55.651219 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:55.651097 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:46:55.651219 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:55.651201 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:55.651337 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:55.651281 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:46:55.651386 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:55.651340 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:55.651435 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:55.651402 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:46:55.661257 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:55.659639 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 10:41:53 +0000 UTC" deadline="2028-03-17 18:29:34.637684152 +0000 UTC" Jun 05 10:46:55.661257 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:55.659673 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15631h42m38.978016012s" Jun 05 10:46:55.682478 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:55.681839 2580 generic.go:356] "Generic (PLEG): container finished" podID="43a2b82bdab6b7ce84c0a457af7d0312" containerID="f8c6662b6b938c34644c61e211912c84fa01b73ae82f530be4c71754999f2f5e" exitCode=0 Jun 05 10:46:55.682478 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:55.682238 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" event={"ID":"43a2b82bdab6b7ce84c0a457af7d0312","Type":"ContainerDied","Data":"f8c6662b6b938c34644c61e211912c84fa01b73ae82f530be4c71754999f2f5e"} Jun 05 10:46:56.696593 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:56.696473 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" event={"ID":"43a2b82bdab6b7ce84c0a457af7d0312","Type":"ContainerStarted","Data":"453486823f77a80962672f4cc71a4865a9dc75c1b34286258247bed8c2f16052"} Jun 05 10:46:57.228725 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:57.228552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:57.228891 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:57.228844 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:46:57.228962 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:57.228893 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs podName:8206f9d1-eeae-4107-8ec4-947a6f0f34a2 nodeName:}" failed. No retries permitted until 2026-06-05 10:47:01.228880586 +0000 UTC m=+10.016328378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs") pod "network-metrics-daemon-w5msc" (UID: "8206f9d1-eeae-4107-8ec4-947a6f0f34a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:46:57.329644 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:57.329557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:57.329807 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:57.329643 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wsl9\" (UniqueName: \"kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9\") pod \"network-check-target-xnbrx\" (UID: \"6d815734-8fd9-4443-9343-79861f036e8f\") " pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:46:57.329807 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:57.329777 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 10:46:57.329807 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:57.329795 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 10:46:57.329807 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:57.329808 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8wsl9 for pod openshift-network-diagnostics/network-check-target-xnbrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:46:57.329999 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:57.329863 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9 podName:6d815734-8fd9-4443-9343-79861f036e8f nodeName:}" failed. No retries permitted until 2026-06-05 10:47:01.329845697 +0000 UTC m=+10.117293502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wsl9" (UniqueName: "kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9") pod "network-check-target-xnbrx" (UID: "6d815734-8fd9-4443-9343-79861f036e8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:46:57.330322 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:57.330260 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 10:46:57.330322 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:57.330320 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret podName:bcdb32b6-c598-4833-9f6c-8bd52ecc232d nodeName:}" failed. No retries permitted until 2026-06-05 10:47:01.330305269 +0000 UTC m=+10.117753071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret") pod "global-pull-secret-syncer-lm5dk" (UID: "bcdb32b6-c598-4833-9f6c-8bd52ecc232d") : object "kube-system"/"original-pull-secret" not registered Jun 05 10:46:57.648522 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:57.648412 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:46:57.653398 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:57.653352 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:46:57.653740 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:57.653718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:57.653858 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:57.653843 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:46:57.653962 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:57.653885 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:57.653962 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:57.653958 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:46:59.649753 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:59.649284 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:46:59.649753 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:59.649311 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:46:59.649753 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:46:59.649284 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:46:59.649753 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:59.649428 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:46:59.649753 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:59.649494 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:46:59.649753 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:46:59.649558 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:01.261899 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:01.261861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:01.262353 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:01.262055 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:47:01.262353 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:01.262116 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs podName:8206f9d1-eeae-4107-8ec4-947a6f0f34a2 nodeName:}" failed. No retries permitted until 2026-06-05 10:47:09.262097523 +0000 UTC m=+18.049545330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs") pod "network-metrics-daemon-w5msc" (UID: "8206f9d1-eeae-4107-8ec4-947a6f0f34a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:47:01.363228 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:01.363195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wsl9\" (UniqueName: \"kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9\") pod \"network-check-target-xnbrx\" (UID: \"6d815734-8fd9-4443-9343-79861f036e8f\") " pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:01.363358 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:01.363244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:01.363358 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:01.363339 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 10:47:01.363429 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:01.363382 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret podName:bcdb32b6-c598-4833-9f6c-8bd52ecc232d nodeName:}" failed. No retries permitted until 2026-06-05 10:47:09.363369868 +0000 UTC m=+18.150817659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret") pod "global-pull-secret-syncer-lm5dk" (UID: "bcdb32b6-c598-4833-9f6c-8bd52ecc232d") : object "kube-system"/"original-pull-secret" not registered Jun 05 10:47:01.363680 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:01.363666 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 10:47:01.363716 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:01.363686 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 10:47:01.363716 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:01.363695 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8wsl9 for pod openshift-network-diagnostics/network-check-target-xnbrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:47:01.363788 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:01.363723 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9 podName:6d815734-8fd9-4443-9343-79861f036e8f nodeName:}" failed. No retries permitted until 2026-06-05 10:47:09.363714582 +0000 UTC m=+18.151162373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wsl9" (UniqueName: "kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9") pod "network-check-target-xnbrx" (UID: "6d815734-8fd9-4443-9343-79861f036e8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:47:01.649119 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:01.649025 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:01.649299 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:01.649148 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:01.649299 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:01.649245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:01.649400 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:01.649342 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:01.649507 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:01.649489 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:01.649604 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:01.649582 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:03.648542 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:03.648506 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:03.649040 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:03.648557 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:03.649040 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:03.648506 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:03.649040 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:03.648663 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:03.649040 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:03.648713 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:03.649040 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:03.648790 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:05.648557 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:05.648483 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:05.648895 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:05.648592 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:05.648895 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:05.648482 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:05.648895 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:05.648662 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:05.648895 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:05.648483 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:05.648895 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:05.648734 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:07.648623 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:07.648586 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:07.649048 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:07.648600 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:07.649048 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:07.648711 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:07.649048 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:07.648724 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:07.649048 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:07.648941 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:07.649048 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:07.649028 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:09.322864 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:09.322786 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:09.323277 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:09.322919 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:47:09.323277 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:09.322986 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs podName:8206f9d1-eeae-4107-8ec4-947a6f0f34a2 nodeName:}" failed. No retries permitted until 2026-06-05 10:47:25.32296551 +0000 UTC m=+34.110413302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs") pod "network-metrics-daemon-w5msc" (UID: "8206f9d1-eeae-4107-8ec4-947a6f0f34a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:47:09.423505 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:09.423463 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wsl9\" (UniqueName: \"kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9\") pod \"network-check-target-xnbrx\" (UID: \"6d815734-8fd9-4443-9343-79861f036e8f\") " pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:09.423680 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:09.423537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:09.423680 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:09.423654 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 10:47:09.423680 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:09.423658 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 10:47:09.423842 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:09.423686 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 10:47:09.423842 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:09.423700 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8wsl9 for pod openshift-network-diagnostics/network-check-target-xnbrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:47:09.423842 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:09.423721 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret podName:bcdb32b6-c598-4833-9f6c-8bd52ecc232d nodeName:}" failed. No retries permitted until 2026-06-05 10:47:25.423703046 +0000 UTC m=+34.211150857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret") pod "global-pull-secret-syncer-lm5dk" (UID: "bcdb32b6-c598-4833-9f6c-8bd52ecc232d") : object "kube-system"/"original-pull-secret" not registered Jun 05 10:47:09.423842 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:09.423749 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9 podName:6d815734-8fd9-4443-9343-79861f036e8f nodeName:}" failed. No retries permitted until 2026-06-05 10:47:25.423735223 +0000 UTC m=+34.211183019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wsl9" (UniqueName: "kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9") pod "network-check-target-xnbrx" (UID: "6d815734-8fd9-4443-9343-79861f036e8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:47:09.648636 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:09.648558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:09.648782 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:09.648558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:09.648782 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:09.648712 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:09.648782 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:09.648772 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:09.648969 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:09.648558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:09.648969 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:09.648846 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:11.649303 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:11.649262 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:11.649954 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:11.649366 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:11.649954 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:11.649375 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:11.649954 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:11.649495 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:11.649954 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:11.649529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:11.649954 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:11.649611 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:13.648429 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.648251 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:13.649294 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.648256 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:13.649294 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:13.648502 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:13.649294 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.648312 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:13.649294 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:13.648573 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:13.649294 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:13.648609 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:13.733242 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.733145 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zd72w" event={"ID":"aca12326-5f8f-4534-aaa1-6bc006550b18","Type":"ContainerStarted","Data":"07f96721121506784507bc21e4ec888a37eb134ad491f9dd68bced98e560774d"} Jun 05 10:47:13.735156 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.735123 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4fz2m" event={"ID":"3fc2b3f4-5d2e-4654-8748-770ab05d667b","Type":"ContainerStarted","Data":"c0a41cd786ef7fdfffa949d3e9f44a71ec559089f4a991819aecc0770fda7c54"} Jun 05 10:47:13.736899 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.736844 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lwdlg" event={"ID":"79890b97-8df2-4cbf-9076-358cf6ca8e70","Type":"ContainerStarted","Data":"96912b44feadbbe39dd893f7355cfb6e49f477ee2a3387641bbd27b77f7d7fda"} Jun 05 10:47:13.738403 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.738378 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qh698" event={"ID":"641916f0-a44b-4d82-bdb9-188e363ca590","Type":"ContainerStarted","Data":"90eddbfd9ddd49f1a805c28f7716d88dd6ca2083603f48b14864ee12770cba41"} Jun 05 10:47:13.742063 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.741718 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" event={"ID":"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c","Type":"ContainerStarted","Data":"312b2cbac294ffa1bc48494525a5c3dce13c242244052daba549adaf7954f77c"} Jun 05 10:47:13.742063 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.741792 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" event={"ID":"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c","Type":"ContainerStarted","Data":"c955212e3b3fd8bcf08992845e8bb755934d383f8437fa726b51a6e48795489a"} Jun 05 10:47:13.742063 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.741844 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" event={"ID":"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c","Type":"ContainerStarted","Data":"1d23a5f65e15f9541673f9537776a3d2814a379e929f6eafa98f51d991a2e758"} Jun 05 10:47:13.742063 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.741938 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" event={"ID":"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c","Type":"ContainerStarted","Data":"c48b1408a3abcd181c14274672b6beb07de535abba838c5f155cf20fd31fec21"} Jun 05 10:47:13.742063 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.741985 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" event={"ID":"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c","Type":"ContainerStarted","Data":"bdb0945a2c4435d80d32f42c355bf49db8b2b0cee7f0b3279484aaf919a88873"} Jun 05 10:47:13.742063 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.742022 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" event={"ID":"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c","Type":"ContainerStarted","Data":"ed364b05d6914691b17d3d37ab3fd302999bba7948237ec0fc615baff68b8c7e"} Jun 05 10:47:13.743222 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.743198 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" event={"ID":"328b037c-30a2-4e1b-86d4-1ffde9de29cb","Type":"ContainerStarted","Data":"463de680aa887807d3cbb7fb1c2601ba7b179137841c248c4a263ef8944b5171"} Jun 05 10:47:13.744903 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.744729 2580 generic.go:356] "Generic (PLEG): container finished" podID="e7871c10-514e-415d-ab43-518a6358a6db" containerID="4d203cc370a9d0244804913fa0f2ce452aa1d2c528500887d2fc408adbdcaba5" exitCode=0 Jun 05 10:47:13.745009 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.744851 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54df8" event={"ID":"e7871c10-514e-415d-ab43-518a6358a6db","Type":"ContainerDied","Data":"4d203cc370a9d0244804913fa0f2ce452aa1d2c528500887d2fc408adbdcaba5"} Jun 05 10:47:13.746570 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.746544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrckg" event={"ID":"2dc070cf-093c-4d58-a4f5-a2fd871a211b","Type":"ContainerStarted","Data":"e65174c964d3d68166888778e5137e82320af1030b3bbe7bc113e72083b79a6e"} Jun 05 10:47:13.752044 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.752007 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-107.ec2.internal" podStartSLOduration=21.751996555 podStartE2EDuration="21.751996555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:46:56.713620573 +0000 UTC m=+5.501068388" watchObservedRunningTime="2026-06-05 10:47:13.751996555 +0000 UTC m=+22.539444367" Jun 05 10:47:13.752347 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.752322 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zd72w" podStartSLOduration=4.231289688 podStartE2EDuration="22.752315757s" totalImagesPullingTime="18.521026069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:47:13.751983641 +0000 UTC m=+22.539431453" watchObservedRunningTime="2026-06-05 10:47:13.752315757 +0000 UTC m=+22.539763570" Jun 05 10:47:13.772500 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.772437 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mrckg" podStartSLOduration=3.187800259 podStartE2EDuration="21.772426152s" totalImagesPullingTime="18.584625893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:47:13.772276718 +0000 UTC m=+22.559724529" watchObservedRunningTime="2026-06-05 10:47:13.772426152 +0000 UTC m=+22.559873963" Jun 05 10:47:13.789596 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.789552 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qh698" podStartSLOduration=7.372122875 podStartE2EDuration="21.789541235s" totalImagesPullingTime="14.41741836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:47:13.78860175 +0000 UTC m=+22.576049563" watchObservedRunningTime="2026-06-05 10:47:13.789541235 +0000 UTC m=+22.576989046" Jun 05 10:47:13.834018 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.833968 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4fz2m" podStartSLOduration=8.405252039 podStartE2EDuration="22.833952534s" totalImagesPullingTime="14.428700495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:47:13.809232839 +0000 UTC m=+22.596680654" watchObservedRunningTime="2026-06-05 10:47:13.833952534 +0000 UTC m=+22.621400406" Jun 05 10:47:13.870045 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:13.870006 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lwdlg" podStartSLOduration=4.323239195 podStartE2EDuration="22.869994094s" totalImagesPullingTime="18.546754899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:47:13.835081001 +0000 UTC m=+22.622528808" watchObservedRunningTime="2026-06-05 10:47:13.869994094 +0000 UTC m=+22.657441906" Jun 05 10:47:14.353604 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:14.353571 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qh698" Jun 05 10:47:14.354214 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:14.354196 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qh698" Jun 05 10:47:14.601990 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:14.601965 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 10:47:14.664300 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:14.664156 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T10:47:14.601987344Z","UUID":"5d3c7fe1-661a-4823-a24c-85f9ec453d98","Handler":null,"Name":"","Endpoint":""} Jun 05 10:47:14.665964 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:14.665941 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 10:47:14.666065 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:14.665985 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 10:47:14.750793 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:14.750761 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" event={"ID":"328b037c-30a2-4e1b-86d4-1ffde9de29cb","Type":"ContainerStarted","Data":"a43b072541790663db60b1022f8b7134cb90992319c059cfeb13886a7bcf2ba2"} Jun 05 10:47:14.752103 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:14.752071 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-knrgr" event={"ID":"422e93d0-0b10-4483-9e12-5f57cfc85714","Type":"ContainerStarted","Data":"fc00206df037f04c2aecd185d026dfb60c38068860279093ca470523a235c02b"} Jun 05 10:47:14.752426 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:14.752397 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qh698" Jun 05 10:47:14.752854 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:14.752837 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qh698" Jun 05 10:47:14.776980 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:14.776888 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-knrgr" podStartSLOduration=4.234844422 podStartE2EDuration="22.776869243s" totalImagesPullingTime="18.542024821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:47:14.776127642 +0000 UTC m=+23.563575453" watchObservedRunningTime="2026-06-05 10:47:14.776869243 +0000 UTC m=+23.564317057" Jun 05 10:47:15.648988 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:15.648962 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:15.649125 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:15.649080 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:15.649258 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:15.649189 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:15.649310 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:15.649193 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:15.649310 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:15.649297 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:15.649384 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:15.649371 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:15.761534 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:15.761498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" event={"ID":"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c","Type":"ContainerStarted","Data":"f79bfb3d51fb675f8c0844fd9598c1684b03bf896d793273c3f2f2f1ec7913c4"} Jun 05 10:47:16.765198 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:16.765144 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" event={"ID":"328b037c-30a2-4e1b-86d4-1ffde9de29cb","Type":"ContainerStarted","Data":"040db17876ffc8ca0ca70931ea47b82deba54289e03617874b5842aaf924887f"} Jun 05 10:47:17.648965 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:17.648933 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:17.649157 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:17.649006 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:17.649157 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:17.648945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:17.649157 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:17.649102 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:17.649329 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:17.649159 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:17.649329 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:17.649248 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:19.648728 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:19.648554 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:19.649295 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:19.648554 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:19.649295 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:19.648796 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:19.649295 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:19.648559 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:19.649295 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:19.648886 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:19.649295 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:19.648976 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:19.774930 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:19.774896 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" event={"ID":"f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c","Type":"ContainerStarted","Data":"aed7aa83366a7b324de14391c64a93b69c20435d7ffd691aae767994fc1c8493"} Jun 05 10:47:19.775139 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:19.775122 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:47:19.777035 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:19.777010 2580 generic.go:356] "Generic (PLEG): container finished" podID="e7871c10-514e-415d-ab43-518a6358a6db" containerID="6d92489f6e6aee11b290f6facfd2bbf49fb1ab85e5d248819619b3f9ba99e76d" exitCode=0 Jun 05 10:47:19.777156 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:19.777043 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54df8" event={"ID":"e7871c10-514e-415d-ab43-518a6358a6db","Type":"ContainerDied","Data":"6d92489f6e6aee11b290f6facfd2bbf49fb1ab85e5d248819619b3f9ba99e76d"} Jun 05 10:47:19.791016 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:19.790993 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:47:19.808034 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:19.807995 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vwl62" podStartSLOduration=7.673191453 podStartE2EDuration="28.807982164s" totalImagesPullingTime="21.134790711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:46:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:47:16.786420982 +0000 UTC m=+25.573868795" watchObservedRunningTime="2026-06-05 10:47:19.807982164 +0000 UTC m=+28.595429973" Jun 05 10:47:19.808320 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:19.808299 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" podStartSLOduration=10.198907103 podStartE2EDuration="28.808294145s" totalImagesPullingTime="18.609387042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:47:19.807886946 +0000 UTC m=+28.595334755" watchObservedRunningTime="2026-06-05 10:47:19.808294145 +0000 UTC m=+28.595741957" Jun 05 10:47:20.777372 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:20.777126 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w5msc"] Jun 05 10:47:20.777751 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:20.777441 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:20.777751 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:20.777530 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:20.779703 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:20.779528 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xnbrx"] Jun 05 10:47:20.779703 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:20.779655 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:20.779882 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:20.779785 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:20.780208 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:20.780181 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lm5dk"] Jun 05 10:47:20.780338 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:20.780273 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:20.780404 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:20.780351 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:20.781611 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:20.781587 2580 generic.go:356] "Generic (PLEG): container finished" podID="e7871c10-514e-415d-ab43-518a6358a6db" containerID="4add93e2e83c977d34fa93be2b28e5e2a128b87ca3d1572edb223d4818b72326" exitCode=0 Jun 05 10:47:20.781713 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:20.781611 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54df8" event={"ID":"e7871c10-514e-415d-ab43-518a6358a6db","Type":"ContainerDied","Data":"4add93e2e83c977d34fa93be2b28e5e2a128b87ca3d1572edb223d4818b72326"} Jun 05 10:47:20.782639 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:20.782292 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:47:20.782639 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:20.782369 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:47:20.799840 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:20.799784 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:47:22.648184 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:22.648126 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:22.648858 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:22.648201 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:22.648858 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:22.648254 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:22.648858 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:22.648269 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:22.648858 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:22.648329 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:22.648858 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:22.648386 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:22.788815 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:22.788780 2580 generic.go:356] "Generic (PLEG): container finished" podID="e7871c10-514e-415d-ab43-518a6358a6db" containerID="785bfbd30e7b03021d8d16729f671dd67a0948a609d393a8d366cb2dd7627872" exitCode=0 Jun 05 10:47:22.788975 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:22.788862 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54df8" event={"ID":"e7871c10-514e-415d-ab43-518a6358a6db","Type":"ContainerDied","Data":"785bfbd30e7b03021d8d16729f671dd67a0948a609d393a8d366cb2dd7627872"} Jun 05 10:47:24.648797 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:24.648713 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:24.648797 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:24.648741 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:24.649268 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:24.648844 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:24.649268 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:24.648849 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnbrx" podUID="6d815734-8fd9-4443-9343-79861f036e8f" Jun 05 10:47:24.649268 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:24.648899 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm5dk" podUID="bcdb32b6-c598-4833-9f6c-8bd52ecc232d" Jun 05 10:47:24.649268 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:24.648978 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:47:25.343822 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.343570 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:25.344002 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.343734 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:47:25.344002 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.343944 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs podName:8206f9d1-eeae-4107-8ec4-947a6f0f34a2 nodeName:}" failed. No retries permitted until 2026-06-05 10:47:57.343928227 +0000 UTC m=+66.131376022 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs") pod "network-metrics-daemon-w5msc" (UID: "8206f9d1-eeae-4107-8ec4-947a6f0f34a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 10:47:25.444381 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.444343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wsl9\" (UniqueName: \"kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9\") pod \"network-check-target-xnbrx\" (UID: \"6d815734-8fd9-4443-9343-79861f036e8f\") " pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:25.444537 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.444399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:25.444537 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.444502 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 10:47:25.444537 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.444536 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 10:47:25.444673 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.444551 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8wsl9 for pod openshift-network-diagnostics/network-check-target-xnbrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:47:25.444673 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.444506 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 10:47:25.444673 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.444607 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9 podName:6d815734-8fd9-4443-9343-79861f036e8f nodeName:}" failed. No retries permitted until 2026-06-05 10:47:57.444590445 +0000 UTC m=+66.232038257 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wsl9" (UniqueName: "kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9") pod "network-check-target-xnbrx" (UID: "6d815734-8fd9-4443-9343-79861f036e8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 10:47:25.444673 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.444634 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret podName:bcdb32b6-c598-4833-9f6c-8bd52ecc232d nodeName:}" failed. No retries permitted until 2026-06-05 10:47:57.444623731 +0000 UTC m=+66.232071522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret") pod "global-pull-secret-syncer-lm5dk" (UID: "bcdb32b6-c598-4833-9f6c-8bd52ecc232d") : object "kube-system"/"original-pull-secret" not registered Jun 05 10:47:25.547316 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.547290 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-107.ec2.internal" event="NodeReady" Jun 05 10:47:25.547471 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.547438 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 10:47:25.598356 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.598209 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f5886c84b-hsh6b"] Jun 05 10:47:25.604430 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.604409 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.611228 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.609103 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 10:47:25.611228 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.609138 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 10:47:25.611228 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.609392 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ggptq\"" Jun 05 10:47:25.611228 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.610383 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mh4n9"] Jun 05 10:47:25.611228 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.610994 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 10:47:25.613917 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.613896 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 10:47:25.614338 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.614318 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.617879 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.617850 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 10:47:25.617879 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.617895 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 10:47:25.618093 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.617945 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42v48\"" Jun 05 10:47:25.624239 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.624210 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5k57r"] Jun 05 10:47:25.628157 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.628134 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f5886c84b-hsh6b"] Jun 05 10:47:25.628309 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.628268 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5k57r" Jun 05 10:47:25.629669 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.629648 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mh4n9"] Jun 05 10:47:25.631242 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.631211 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 10:47:25.631242 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.631225 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 10:47:25.631378 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.631219 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-498dq\"" Jun 05 10:47:25.631378 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.631219 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 10:47:25.641530 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.641505 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5k57r"] Jun 05 10:47:25.752716 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.752677 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-certificates\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.752735 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v74qb\" (UniqueName: \"kubernetes.io/projected/767b7136-2858-4788-8ddb-6ccf5300b835-kube-api-access-v74qb\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.752762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1468658a-02c9-4c80-a102-f338a490caf3-cert\") pod \"ingress-canary-5k57r\" (UID: \"1468658a-02c9-4c80-a102-f338a490caf3\") " pod="openshift-ingress-canary/ingress-canary-5k57r" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.752781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.752804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-trusted-ca\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.752855 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-bound-sa-token\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.752905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/767b7136-2858-4788-8ddb-6ccf5300b835-config-volume\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.752930 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-image-registry-private-configuration\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.752953 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac2483d-5e71-4080-a380-6712ff6dd22a-ca-trust-extracted\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.752990 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.753008 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-installation-pull-secrets\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.753062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm5nm\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-kube-api-access-xm5nm\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.753086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c9rj\" (UniqueName: \"kubernetes.io/projected/1468658a-02c9-4c80-a102-f338a490caf3-kube-api-access-2c9rj\") pod \"ingress-canary-5k57r\" (UID: \"1468658a-02c9-4c80-a102-f338a490caf3\") " pod="openshift-ingress-canary/ingress-canary-5k57r" Jun 05 10:47:25.753201 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.753127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767b7136-2858-4788-8ddb-6ccf5300b835-tmp-dir\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.854339 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.854339 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854287 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-installation-pull-secrets\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.854556 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.854417 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 10:47:25.854556 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.854497 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls podName:767b7136-2858-4788-8ddb-6ccf5300b835 nodeName:}" failed. No retries permitted until 2026-06-05 10:47:26.354474412 +0000 UTC m=+35.141922207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls") pod "dns-default-mh4n9" (UID: "767b7136-2858-4788-8ddb-6ccf5300b835") : secret "dns-default-metrics-tls" not found Jun 05 10:47:25.854663 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm5nm\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-kube-api-access-xm5nm\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.854663 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c9rj\" (UniqueName: \"kubernetes.io/projected/1468658a-02c9-4c80-a102-f338a490caf3-kube-api-access-2c9rj\") pod \"ingress-canary-5k57r\" (UID: \"1468658a-02c9-4c80-a102-f338a490caf3\") " pod="openshift-ingress-canary/ingress-canary-5k57r" Jun 05 10:47:25.854663 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767b7136-2858-4788-8ddb-6ccf5300b835-tmp-dir\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.854784 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-certificates\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.854784 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v74qb\" (UniqueName: \"kubernetes.io/projected/767b7136-2858-4788-8ddb-6ccf5300b835-kube-api-access-v74qb\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.854784 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1468658a-02c9-4c80-a102-f338a490caf3-cert\") pod \"ingress-canary-5k57r\" (UID: \"1468658a-02c9-4c80-a102-f338a490caf3\") " pod="openshift-ingress-canary/ingress-canary-5k57r" Jun 05 10:47:25.854784 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.854937 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-trusted-ca\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.854937 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-bound-sa-token\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.854937 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/767b7136-2858-4788-8ddb-6ccf5300b835-config-volume\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.854937 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-image-registry-private-configuration\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.854937 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.854884 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac2483d-5e71-4080-a380-6712ff6dd22a-ca-trust-extracted\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.855142 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.854966 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 10:47:25.855142 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.854984 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5886c84b-hsh6b: secret "image-registry-tls" not found Jun 05 10:47:25.855142 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:25.855028 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls podName:9ac2483d-5e71-4080-a380-6712ff6dd22a nodeName:}" failed. No retries permitted until 2026-06-05 10:47:26.355010386 +0000 UTC m=+35.142458193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls") pod "image-registry-f5886c84b-hsh6b" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a") : secret "image-registry-tls" not found Jun 05 10:47:25.855142 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.855056 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767b7136-2858-4788-8ddb-6ccf5300b835-tmp-dir\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.855355 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.855237 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac2483d-5e71-4080-a380-6712ff6dd22a-ca-trust-extracted\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.855673 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.855642 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/767b7136-2858-4788-8ddb-6ccf5300b835-config-volume\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.855673 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.855656 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-certificates\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.856059 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.856014 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-trusted-ca\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.859425 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.859376 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-installation-pull-secrets\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.859425 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.859386 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-image-registry-private-configuration\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.859425 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.859407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1468658a-02c9-4c80-a102-f338a490caf3-cert\") pod \"ingress-canary-5k57r\" (UID: \"1468658a-02c9-4c80-a102-f338a490caf3\") " pod="openshift-ingress-canary/ingress-canary-5k57r" Jun 05 10:47:25.867516 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.867487 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-bound-sa-token\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.867745 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.867722 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v74qb\" (UniqueName: \"kubernetes.io/projected/767b7136-2858-4788-8ddb-6ccf5300b835-kube-api-access-v74qb\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:25.868956 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.868936 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm5nm\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-kube-api-access-xm5nm\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:25.869177 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.869135 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c9rj\" (UniqueName: \"kubernetes.io/projected/1468658a-02c9-4c80-a102-f338a490caf3-kube-api-access-2c9rj\") pod \"ingress-canary-5k57r\" (UID: \"1468658a-02c9-4c80-a102-f338a490caf3\") " pod="openshift-ingress-canary/ingress-canary-5k57r" Jun 05 10:47:25.938490 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:25.938447 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5k57r" Jun 05 10:47:26.358814 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.358778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:26.358978 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.358899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:26.358978 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:26.358942 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 10:47:26.359105 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:26.359011 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 10:47:26.359105 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:26.359020 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls podName:767b7136-2858-4788-8ddb-6ccf5300b835 nodeName:}" failed. No retries permitted until 2026-06-05 10:47:27.359001724 +0000 UTC m=+36.146449532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls") pod "dns-default-mh4n9" (UID: "767b7136-2858-4788-8ddb-6ccf5300b835") : secret "dns-default-metrics-tls" not found Jun 05 10:47:26.359105 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:26.359025 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5886c84b-hsh6b: secret "image-registry-tls" not found Jun 05 10:47:26.359105 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:26.359075 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls podName:9ac2483d-5e71-4080-a380-6712ff6dd22a nodeName:}" failed. No retries permitted until 2026-06-05 10:47:27.359058224 +0000 UTC m=+36.146506020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls") pod "image-registry-f5886c84b-hsh6b" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a") : secret "image-registry-tls" not found Jun 05 10:47:26.648705 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.648674 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:26.648874 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.648774 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:26.648874 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.648811 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:26.652838 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.652612 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 10:47:26.652838 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.652643 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 10:47:26.652838 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.652667 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 10:47:26.652838 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.652686 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-km9bk\"" Jun 05 10:47:26.652838 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.652686 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j8pcn\"" Jun 05 10:47:26.652838 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.652716 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 10:47:26.760520 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.760490 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5k57r"] Jun 05 10:47:26.775051 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:47:26.775018 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1468658a_02c9_4c80_a102_f338a490caf3.slice/crio-35579f9241c8dc05b2357cd354acb125ae0b0e3a7b05f1102500d2a8637edc0b WatchSource:0}: Error finding container 35579f9241c8dc05b2357cd354acb125ae0b0e3a7b05f1102500d2a8637edc0b: Status 404 returned error can't find the container with id 35579f9241c8dc05b2357cd354acb125ae0b0e3a7b05f1102500d2a8637edc0b Jun 05 10:47:26.801739 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.801678 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54df8" event={"ID":"e7871c10-514e-415d-ab43-518a6358a6db","Type":"ContainerStarted","Data":"6f3957e663e12f81d7497f7befd078a0c972a52c08814ef378713fb7bf5dc4f5"} Jun 05 10:47:26.802893 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:26.802861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5k57r" event={"ID":"1468658a-02c9-4c80-a102-f338a490caf3","Type":"ContainerStarted","Data":"35579f9241c8dc05b2357cd354acb125ae0b0e3a7b05f1102500d2a8637edc0b"} Jun 05 10:47:27.365720 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:27.365500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:27.365891 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:27.365750 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:27.365891 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:27.365651 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 10:47:27.365891 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:27.365827 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5886c84b-hsh6b: secret "image-registry-tls" not found Jun 05 10:47:27.365891 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:27.365839 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 10:47:27.365891 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:27.365890 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls podName:767b7136-2858-4788-8ddb-6ccf5300b835 nodeName:}" failed. No retries permitted until 2026-06-05 10:47:29.365877435 +0000 UTC m=+38.153325226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls") pod "dns-default-mh4n9" (UID: "767b7136-2858-4788-8ddb-6ccf5300b835") : secret "dns-default-metrics-tls" not found Jun 05 10:47:27.366124 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:27.365905 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls podName:9ac2483d-5e71-4080-a380-6712ff6dd22a nodeName:}" failed. No retries permitted until 2026-06-05 10:47:29.365896735 +0000 UTC m=+38.153344530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls") pod "image-registry-f5886c84b-hsh6b" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a") : secret "image-registry-tls" not found Jun 05 10:47:27.456748 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:27.456715 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" limit=1024 Jun 05 10:47:27.554750 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:27.554720 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" limit=1024 Jun 05 10:47:27.809885 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:27.809851 2580 generic.go:356] "Generic (PLEG): container finished" podID="e7871c10-514e-415d-ab43-518a6358a6db" containerID="6f3957e663e12f81d7497f7befd078a0c972a52c08814ef378713fb7bf5dc4f5" exitCode=0 Jun 05 10:47:27.810275 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:27.809908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54df8" event={"ID":"e7871c10-514e-415d-ab43-518a6358a6db","Type":"ContainerDied","Data":"6f3957e663e12f81d7497f7befd078a0c972a52c08814ef378713fb7bf5dc4f5"} Jun 05 10:47:28.816291 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:28.816257 2580 generic.go:356] "Generic (PLEG): container finished" podID="e7871c10-514e-415d-ab43-518a6358a6db" containerID="f847f3afc3d87112cd21a9852fa24928e2ccc48a342aec5248a204c9640585fd" exitCode=0 Jun 05 10:47:28.816717 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:28.816336 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54df8" event={"ID":"e7871c10-514e-415d-ab43-518a6358a6db","Type":"ContainerDied","Data":"f847f3afc3d87112cd21a9852fa24928e2ccc48a342aec5248a204c9640585fd"} Jun 05 10:47:29.382188 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:29.382074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:29.382188 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:29.382135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:29.382367 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:29.382251 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 10:47:29.382367 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:29.382266 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 10:47:29.382367 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:29.382272 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5886c84b-hsh6b: secret "image-registry-tls" not found Jun 05 10:47:29.382367 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:29.382332 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls podName:9ac2483d-5e71-4080-a380-6712ff6dd22a nodeName:}" failed. No retries permitted until 2026-06-05 10:47:33.382311848 +0000 UTC m=+42.169759640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls") pod "image-registry-f5886c84b-hsh6b" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a") : secret "image-registry-tls" not found Jun 05 10:47:29.382367 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:29.382358 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls podName:767b7136-2858-4788-8ddb-6ccf5300b835 nodeName:}" failed. No retries permitted until 2026-06-05 10:47:33.382347824 +0000 UTC m=+42.169795616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls") pod "dns-default-mh4n9" (UID: "767b7136-2858-4788-8ddb-6ccf5300b835") : secret "dns-default-metrics-tls" not found Jun 05 10:47:29.821753 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:29.821721 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54df8" event={"ID":"e7871c10-514e-415d-ab43-518a6358a6db","Type":"ContainerStarted","Data":"58d808ad0aeeb6ac57f47970b6f8f8d178e43feaa8a2c0b273d599e51a74eab6"} Jun 05 10:47:29.823128 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:29.823102 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5k57r" event={"ID":"1468658a-02c9-4c80-a102-f338a490caf3","Type":"ContainerStarted","Data":"54d3332ae0084b987acff2347e5829cab85b6d66d4e68b16b5253c955b7ab278"} Jun 05 10:47:29.848419 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:29.848377 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-54df8" podStartSLOduration=9.261317812 podStartE2EDuration="38.848362105s" totalImagesPullingTime="29.587044293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:46:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:47:29.846658192 +0000 UTC m=+38.634106004" watchObservedRunningTime="2026-06-05 10:47:29.848362105 +0000 UTC m=+38.635809918" Jun 05 10:47:29.869335 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:29.869283 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5k57r" podStartSLOduration=2.658728891 podStartE2EDuration="4.869266945s" totalImagesPullingTime="2.210538054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:47:29.868224978 +0000 UTC m=+38.655672791" watchObservedRunningTime="2026-06-05 10:47:29.869266945 +0000 UTC m=+38.656714757" Jun 05 10:47:30.075573 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:30.075489 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" limit=1024 Jun 05 10:47:30.174319 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:30.174286 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" limit=1024 Jun 05 10:47:31.362776 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:31.362745 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" limit=1024 Jun 05 10:47:31.464138 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:31.464106 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" limit=1024 Jun 05 10:47:31.565184 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:31.565139 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" limit=1024 Jun 05 10:47:32.926849 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:32.926802 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" limit=1024 Jun 05 10:47:33.007176 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:33.007146 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" limit=1024 Jun 05 10:47:33.416331 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:33.416300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:33.416476 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:33.416371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:33.416476 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:33.416452 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 10:47:33.416541 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:33.416514 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls podName:767b7136-2858-4788-8ddb-6ccf5300b835 nodeName:}" failed. No retries permitted until 2026-06-05 10:47:41.416500098 +0000 UTC m=+50.203947890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls") pod "dns-default-mh4n9" (UID: "767b7136-2858-4788-8ddb-6ccf5300b835") : secret "dns-default-metrics-tls" not found Jun 05 10:47:33.416597 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:33.416453 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 10:47:33.416597 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:33.416552 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5886c84b-hsh6b: secret "image-registry-tls" not found Jun 05 10:47:33.416668 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:33.416598 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls podName:9ac2483d-5e71-4080-a380-6712ff6dd22a nodeName:}" failed. No retries permitted until 2026-06-05 10:47:41.41658829 +0000 UTC m=+50.204036081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls") pod "image-registry-f5886c84b-hsh6b" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a") : secret "image-registry-tls" not found Jun 05 10:47:34.461671 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:34.461615 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" limit=1024 Jun 05 10:47:34.536025 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:34.535999 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" limit=1024 Jun 05 10:47:41.473486 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:41.473448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:41.473945 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:41.473546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:41.473945 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:41.473612 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 10:47:41.473945 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:41.473636 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 10:47:41.473945 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:41.473646 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5886c84b-hsh6b: secret "image-registry-tls" not found Jun 05 10:47:41.473945 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:41.473678 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls podName:767b7136-2858-4788-8ddb-6ccf5300b835 nodeName:}" failed. No retries permitted until 2026-06-05 10:47:57.473662229 +0000 UTC m=+66.261110025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls") pod "dns-default-mh4n9" (UID: "767b7136-2858-4788-8ddb-6ccf5300b835") : secret "dns-default-metrics-tls" not found Jun 05 10:47:41.473945 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:41.473708 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls podName:9ac2483d-5e71-4080-a380-6712ff6dd22a nodeName:}" failed. No retries permitted until 2026-06-05 10:47:57.473697011 +0000 UTC m=+66.261144803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls") pod "image-registry-f5886c84b-hsh6b" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a") : secret "image-registry-tls" not found Jun 05 10:47:52.799868 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:52.799836 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ghh4r" Jun 05 10:47:57.394414 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.394364 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:47:57.397125 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.397106 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 10:47:57.405447 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:57.405431 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 10:47:57.405506 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:57.405485 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs podName:8206f9d1-eeae-4107-8ec4-947a6f0f34a2 nodeName:}" failed. No retries permitted until 2026-06-05 10:49:01.405470541 +0000 UTC m=+130.192918333 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs") pod "network-metrics-daemon-w5msc" (UID: "8206f9d1-eeae-4107-8ec4-947a6f0f34a2") : secret "metrics-daemon-secret" not found Jun 05 10:47:57.495366 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.495339 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:47:57.495462 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.495379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:47:57.495462 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.495400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wsl9\" (UniqueName: \"kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9\") pod \"network-check-target-xnbrx\" (UID: \"6d815734-8fd9-4443-9343-79861f036e8f\") " pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:57.495544 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:57.495474 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 10:47:57.495544 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:57.495493 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 10:47:57.495544 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:57.495514 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5886c84b-hsh6b: secret "image-registry-tls" not found Jun 05 10:47:57.495641 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:57.495516 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls podName:767b7136-2858-4788-8ddb-6ccf5300b835 nodeName:}" failed. No retries permitted until 2026-06-05 10:48:29.495505005 +0000 UTC m=+98.282952797 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls") pod "dns-default-mh4n9" (UID: "767b7136-2858-4788-8ddb-6ccf5300b835") : secret "dns-default-metrics-tls" not found Jun 05 10:47:57.495641 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:47:57.495588 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls podName:9ac2483d-5e71-4080-a380-6712ff6dd22a nodeName:}" failed. No retries permitted until 2026-06-05 10:48:29.495570828 +0000 UTC m=+98.283018623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls") pod "image-registry-f5886c84b-hsh6b" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a") : secret "image-registry-tls" not found Jun 05 10:47:57.495641 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.495618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:57.500402 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.500376 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 10:47:57.500478 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.500400 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 10:47:57.508985 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.508963 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bcdb32b6-c598-4833-9f6c-8bd52ecc232d-original-pull-secret\") pod \"global-pull-secret-syncer-lm5dk\" (UID: \"bcdb32b6-c598-4833-9f6c-8bd52ecc232d\") " pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:57.509815 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.509802 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 10:47:57.518139 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.518118 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wsl9\" (UniqueName: \"kubernetes.io/projected/6d815734-8fd9-4443-9343-79861f036e8f-kube-api-access-8wsl9\") pod \"network-check-target-xnbrx\" (UID: \"6d815734-8fd9-4443-9343-79861f036e8f\") " pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:57.559648 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.559627 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm5dk" Jun 05 10:47:57.577554 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.577534 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j8pcn\"" Jun 05 10:47:57.585346 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.585323 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:47:57.701034 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.700998 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lm5dk"] Jun 05 10:47:57.705243 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:47:57.705210 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcdb32b6_c598_4833_9f6c_8bd52ecc232d.slice/crio-f87775504fa8266cb40e287b79699d577a3e3f0db10b6f827d009e3072cd328a WatchSource:0}: Error finding container f87775504fa8266cb40e287b79699d577a3e3f0db10b6f827d009e3072cd328a: Status 404 returned error can't find the container with id f87775504fa8266cb40e287b79699d577a3e3f0db10b6f827d009e3072cd328a Jun 05 10:47:57.723696 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.723678 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xnbrx"] Jun 05 10:47:57.725762 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:47:57.725743 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d815734_8fd9_4443_9343_79861f036e8f.slice/crio-3ae61ad6067314a5a393cdc33c50da618ccaf8ed284b898a755f4a81a0641eef WatchSource:0}: Error finding container 3ae61ad6067314a5a393cdc33c50da618ccaf8ed284b898a755f4a81a0641eef: Status 404 returned error can't find the container with id 3ae61ad6067314a5a393cdc33c50da618ccaf8ed284b898a755f4a81a0641eef Jun 05 10:47:57.886477 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.886441 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xnbrx" event={"ID":"6d815734-8fd9-4443-9343-79861f036e8f","Type":"ContainerStarted","Data":"3ae61ad6067314a5a393cdc33c50da618ccaf8ed284b898a755f4a81a0641eef"} Jun 05 10:47:57.887576 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:47:57.887551 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lm5dk" event={"ID":"bcdb32b6-c598-4833-9f6c-8bd52ecc232d","Type":"ContainerStarted","Data":"f87775504fa8266cb40e287b79699d577a3e3f0db10b6f827d009e3072cd328a"} Jun 05 10:48:00.896052 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:48:00.896021 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xnbrx" event={"ID":"6d815734-8fd9-4443-9343-79861f036e8f","Type":"ContainerStarted","Data":"7c49cce77dd7b13f17932cd1e3c94c95c67421e37e1feb3761971c0cab54d125"} Jun 05 10:48:00.896376 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:48:00.896146 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:48:00.915269 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:48:00.915220 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xnbrx" podStartSLOduration=65.814241674 podStartE2EDuration="1m8.915204596s" totalImagesPullingTime="3.100962922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:48:00.913576459 +0000 UTC m=+69.701024271" watchObservedRunningTime="2026-06-05 10:48:00.915204596 +0000 UTC m=+69.702652387" Jun 05 10:48:04.907305 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:48:04.907269 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lm5dk" event={"ID":"bcdb32b6-c598-4833-9f6c-8bd52ecc232d","Type":"ContainerStarted","Data":"268f9b52304eaf6c8a3eb267c9a5c8ac4e2f34e649f1e34e841cc3e83f16efd2"} Jun 05 10:48:04.924943 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:48:04.924897 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lm5dk" podStartSLOduration=66.318967369 podStartE2EDuration="1m12.924882767s" totalImagesPullingTime="6.605915398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:48:04.924289316 +0000 UTC m=+73.711737129" watchObservedRunningTime="2026-06-05 10:48:04.924882767 +0000 UTC m=+73.712330581" Jun 05 10:48:29.521970 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:48:29.521915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:48:29.521970 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:48:29.521974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:48:29.522461 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:48:29.522068 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 10:48:29.522461 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:48:29.522067 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 10:48:29.522461 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:48:29.522094 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5886c84b-hsh6b: secret "image-registry-tls" not found Jun 05 10:48:29.522461 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:48:29.522133 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls podName:767b7136-2858-4788-8ddb-6ccf5300b835 nodeName:}" failed. No retries permitted until 2026-06-05 10:49:33.522119504 +0000 UTC m=+162.309567300 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls") pod "dns-default-mh4n9" (UID: "767b7136-2858-4788-8ddb-6ccf5300b835") : secret "dns-default-metrics-tls" not found Jun 05 10:48:29.522461 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:48:29.522148 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls podName:9ac2483d-5e71-4080-a380-6712ff6dd22a nodeName:}" failed. No retries permitted until 2026-06-05 10:49:33.522141457 +0000 UTC m=+162.309589249 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls") pod "image-registry-f5886c84b-hsh6b" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a") : secret "image-registry-tls" not found Jun 05 10:48:31.900950 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:48:31.900918 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xnbrx" Jun 05 10:49:01.451611 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:49:01.451574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:49:01.452092 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:49:01.451693 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 10:49:01.452092 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:49:01.451750 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs podName:8206f9d1-eeae-4107-8ec4-947a6f0f34a2 nodeName:}" failed. No retries permitted until 2026-06-05 10:51:03.451734619 +0000 UTC m=+252.239182410 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs") pod "network-metrics-daemon-w5msc" (UID: "8206f9d1-eeae-4107-8ec4-947a6f0f34a2") : secret "metrics-daemon-secret" not found Jun 05 10:49:28.615379 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:49:28.615333 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" podUID="9ac2483d-5e71-4080-a380-6712ff6dd22a" Jun 05 10:49:28.623542 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:49:28.623513 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mh4n9" podUID="767b7136-2858-4788-8ddb-6ccf5300b835" Jun 05 10:49:29.100056 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:49:29.100030 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mh4n9" Jun 05 10:49:29.100234 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:49:29.100030 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:49:29.667423 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:49:29.667389 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w5msc" podUID="8206f9d1-eeae-4107-8ec4-947a6f0f34a2" Jun 05 10:49:33.569112 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:49:33.569064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:49:33.569112 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:49:33.569124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:49:33.569537 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:49:33.569236 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 10:49:33.569537 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:49:33.569240 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 10:49:33.569537 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:49:33.569258 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5886c84b-hsh6b: secret "image-registry-tls" not found Jun 05 10:49:33.569537 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:49:33.569296 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls podName:767b7136-2858-4788-8ddb-6ccf5300b835 nodeName:}" failed. No retries permitted until 2026-06-05 10:51:35.569282576 +0000 UTC m=+284.356730368 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls") pod "dns-default-mh4n9" (UID: "767b7136-2858-4788-8ddb-6ccf5300b835") : secret "dns-default-metrics-tls" not found Jun 05 10:49:33.569537 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:49:33.569316 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls podName:9ac2483d-5e71-4080-a380-6712ff6dd22a nodeName:}" failed. No retries permitted until 2026-06-05 10:51:35.569302876 +0000 UTC m=+284.356750666 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls") pod "image-registry-f5886c84b-hsh6b" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a") : secret "image-registry-tls" not found Jun 05 10:49:43.649253 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:49:43.649157 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:50:44.845571 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.845542 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq"] Jun 05 10:50:44.848097 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.848082 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-fs92f"] Jun 05 10:50:44.848228 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.848211 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" Jun 05 10:50:44.850813 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.850780 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 05 10:50:44.850813 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.850806 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 05 10:50:44.851014 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.850824 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pqdgv\"" Jun 05 10:50:44.851114 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.851099 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 05 10:50:44.852189 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.852150 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 05 10:50:44.853585 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.853570 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wr94x"] Jun 05 10:50:44.853707 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.853687 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fs92f" Jun 05 10:50:44.855893 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.855875 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-24q9z\"" Jun 05 10:50:44.857370 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.857357 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz"] Jun 05 10:50:44.857474 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.857462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wr94x" Jun 05 10:50:44.859631 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.859615 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:44.860051 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.860030 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq"] Jun 05 10:50:44.860306 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.860155 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lgmm5\"" Jun 05 10:50:44.860306 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.860204 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 05 10:50:44.860553 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.860535 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 05 10:50:44.860880 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.860864 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-fs92f"] Jun 05 10:50:44.862260 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.862239 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 05 10:50:44.862260 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.862255 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lcmtz\"" Jun 05 10:50:44.862604 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.862571 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 10:50:44.863419 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.863401 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 10:50:44.863616 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.863601 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 05 10:50:44.865737 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.865716 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wr94x"] Jun 05 10:50:44.868484 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.868461 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz"] Jun 05 10:50:44.941089 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.941062 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7"] Jun 05 10:50:44.943438 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.943424 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" Jun 05 10:50:44.945748 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.945713 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7hngz\"" Jun 05 10:50:44.945748 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.945724 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 10:50:44.945909 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.945714 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 10:50:44.945970 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.945928 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13016b13-c77b-4566-b7d6-20fedbe73ff2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:44.946022 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.945966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjbn8\" (UniqueName: \"kubernetes.io/projected/13016b13-c77b-4566-b7d6-20fedbe73ff2-kube-api-access-gjbn8\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:44.946022 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.945970 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 10:50:44.946022 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.945997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ff9bf8c-fe4e-429e-bc75-670b0419ce27-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-ptkvq\" (UID: \"6ff9bf8c-fe4e-429e-bc75-670b0419ce27\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" Jun 05 10:50:44.946022 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.945993 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 10:50:44.946241 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.946097 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:44.946241 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.946144 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ff9bf8c-fe4e-429e-bc75-670b0419ce27-config\") pod \"service-ca-operator-6bc5ff68f5-ptkvq\" (UID: \"6ff9bf8c-fe4e-429e-bc75-670b0419ce27\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" Jun 05 10:50:44.946317 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.946249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpcx6\" (UniqueName: \"kubernetes.io/projected/6ff9bf8c-fe4e-429e-bc75-670b0419ce27-kube-api-access-gpcx6\") pod \"service-ca-operator-6bc5ff68f5-ptkvq\" (UID: \"6ff9bf8c-fe4e-429e-bc75-670b0419ce27\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" Jun 05 10:50:44.946317 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.946282 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5s6d\" (UniqueName: \"kubernetes.io/projected/4587c133-6966-46d6-81c7-90b3b8956c4b-kube-api-access-q5s6d\") pod \"volume-data-source-validator-78dd696465-wr94x\" (UID: \"4587c133-6966-46d6-81c7-90b3b8956c4b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wr94x" Jun 05 10:50:44.946384 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.946317 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfh2k\" (UniqueName: \"kubernetes.io/projected/58ee4673-7463-4ebe-a6ea-c07e06748d08-kube-api-access-nfh2k\") pod \"network-check-source-dbd9cf844-fs92f\" (UID: \"58ee4673-7463-4ebe-a6ea-c07e06748d08\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fs92f" Jun 05 10:50:44.948779 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.948760 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bc5f8d7d7-g4q9q"] Jun 05 10:50:44.951091 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.951072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:44.951534 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.951513 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7"] Jun 05 10:50:44.953555 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.953537 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 10:50:44.953654 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.953570 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 10:50:44.953713 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.953694 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 10:50:44.953808 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.953791 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xfszd\"" Jun 05 10:50:44.953902 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.953885 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 10:50:44.954092 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.954075 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 10:50:44.954214 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.954110 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 10:50:44.967465 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:44.967439 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bc5f8d7d7-g4q9q"] Jun 05 10:50:45.046790 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.046764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13016b13-c77b-4566-b7d6-20fedbe73ff2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:45.046902 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.046793 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-stats-auth\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.046902 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.046818 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ff9bf8c-fe4e-429e-bc75-670b0419ce27-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-ptkvq\" (UID: \"6ff9bf8c-fe4e-429e-bc75-670b0419ce27\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" Jun 05 10:50:45.046902 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.046840 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p2r8\" (UniqueName: \"kubernetes.io/projected/2005ddad-ae9b-4f45-b0e5-f6181daff90a-kube-api-access-8p2r8\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.047010 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.046917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfh2k\" (UniqueName: \"kubernetes.io/projected/58ee4673-7463-4ebe-a6ea-c07e06748d08-kube-api-access-nfh2k\") pod \"network-check-source-dbd9cf844-fs92f\" (UID: \"58ee4673-7463-4ebe-a6ea-c07e06748d08\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fs92f" Jun 05 10:50:45.047010 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.046960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:45.047010 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.046991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpcx6\" (UniqueName: \"kubernetes.io/projected/6ff9bf8c-fe4e-429e-bc75-670b0419ce27-kube-api-access-gpcx6\") pod \"service-ca-operator-6bc5ff68f5-ptkvq\" (UID: \"6ff9bf8c-fe4e-429e-bc75-670b0419ce27\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" Jun 05 10:50:45.047131 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.047028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b914a01a-b6dd-49ad-8aff-7fb0880e3e63-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9v6m7\" (UID: \"b914a01a-b6dd-49ad-8aff-7fb0880e3e63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" Jun 05 10:50:45.047131 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:45.047055 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 10:50:45.047131 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.047063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b914a01a-b6dd-49ad-8aff-7fb0880e3e63-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9v6m7\" (UID: \"b914a01a-b6dd-49ad-8aff-7fb0880e3e63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" Jun 05 10:50:45.047131 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.047090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.047131 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:45.047127 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls podName:13016b13-c77b-4566-b7d6-20fedbe73ff2 nodeName:}" failed. No retries permitted until 2026-06-05 10:50:45.547107856 +0000 UTC m=+234.334555648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7nqtz" (UID: "13016b13-c77b-4566-b7d6-20fedbe73ff2") : secret "cluster-monitoring-operator-tls" not found Jun 05 10:50:45.047380 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.047208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ff9bf8c-fe4e-429e-bc75-670b0419ce27-config\") pod \"service-ca-operator-6bc5ff68f5-ptkvq\" (UID: \"6ff9bf8c-fe4e-429e-bc75-670b0419ce27\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" Jun 05 10:50:45.047380 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.047238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5s6d\" (UniqueName: \"kubernetes.io/projected/4587c133-6966-46d6-81c7-90b3b8956c4b-kube-api-access-q5s6d\") pod \"volume-data-source-validator-78dd696465-wr94x\" (UID: \"4587c133-6966-46d6-81c7-90b3b8956c4b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wr94x" Jun 05 10:50:45.047380 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.047271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpcvd\" (UniqueName: \"kubernetes.io/projected/b914a01a-b6dd-49ad-8aff-7fb0880e3e63-kube-api-access-tpcvd\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9v6m7\" (UID: \"b914a01a-b6dd-49ad-8aff-7fb0880e3e63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" Jun 05 10:50:45.047380 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.047301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjbn8\" (UniqueName: \"kubernetes.io/projected/13016b13-c77b-4566-b7d6-20fedbe73ff2-kube-api-access-gjbn8\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:45.047380 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.047328 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-default-certificate\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.047380 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.047352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.047658 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.047535 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13016b13-c77b-4566-b7d6-20fedbe73ff2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:45.047748 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.047730 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ff9bf8c-fe4e-429e-bc75-670b0419ce27-config\") pod \"service-ca-operator-6bc5ff68f5-ptkvq\" (UID: \"6ff9bf8c-fe4e-429e-bc75-670b0419ce27\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" Jun 05 10:50:45.049127 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.049113 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ff9bf8c-fe4e-429e-bc75-670b0419ce27-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-ptkvq\" (UID: \"6ff9bf8c-fe4e-429e-bc75-670b0419ce27\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" Jun 05 10:50:45.055831 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.055809 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfh2k\" (UniqueName: \"kubernetes.io/projected/58ee4673-7463-4ebe-a6ea-c07e06748d08-kube-api-access-nfh2k\") pod \"network-check-source-dbd9cf844-fs92f\" (UID: \"58ee4673-7463-4ebe-a6ea-c07e06748d08\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fs92f" Jun 05 10:50:45.058485 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.058458 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5s6d\" (UniqueName: \"kubernetes.io/projected/4587c133-6966-46d6-81c7-90b3b8956c4b-kube-api-access-q5s6d\") pod \"volume-data-source-validator-78dd696465-wr94x\" (UID: \"4587c133-6966-46d6-81c7-90b3b8956c4b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wr94x" Jun 05 10:50:45.058587 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.058468 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpcx6\" (UniqueName: \"kubernetes.io/projected/6ff9bf8c-fe4e-429e-bc75-670b0419ce27-kube-api-access-gpcx6\") pod \"service-ca-operator-6bc5ff68f5-ptkvq\" (UID: \"6ff9bf8c-fe4e-429e-bc75-670b0419ce27\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" Jun 05 10:50:45.058635 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.058585 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjbn8\" (UniqueName: \"kubernetes.io/projected/13016b13-c77b-4566-b7d6-20fedbe73ff2-kube-api-access-gjbn8\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:45.147816 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.147749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-stats-auth\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.147816 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.147784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p2r8\" (UniqueName: \"kubernetes.io/projected/2005ddad-ae9b-4f45-b0e5-f6181daff90a-kube-api-access-8p2r8\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.147976 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.147837 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b914a01a-b6dd-49ad-8aff-7fb0880e3e63-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9v6m7\" (UID: \"b914a01a-b6dd-49ad-8aff-7fb0880e3e63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" Jun 05 10:50:45.147976 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.147856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b914a01a-b6dd-49ad-8aff-7fb0880e3e63-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9v6m7\" (UID: \"b914a01a-b6dd-49ad-8aff-7fb0880e3e63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" Jun 05 10:50:45.147976 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.147873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.147976 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.147917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpcvd\" (UniqueName: \"kubernetes.io/projected/b914a01a-b6dd-49ad-8aff-7fb0880e3e63-kube-api-access-tpcvd\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9v6m7\" (UID: \"b914a01a-b6dd-49ad-8aff-7fb0880e3e63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" Jun 05 10:50:45.147976 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.147960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-default-certificate\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.148288 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:45.148024 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 10:50:45.148288 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:45.148129 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs podName:2005ddad-ae9b-4f45-b0e5-f6181daff90a nodeName:}" failed. No retries permitted until 2026-06-05 10:50:45.648108321 +0000 UTC m=+234.435556115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs") pod "router-default-6bc5f8d7d7-g4q9q" (UID: "2005ddad-ae9b-4f45-b0e5-f6181daff90a") : secret "router-metrics-certs-default" not found Jun 05 10:50:45.148288 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.148152 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.148420 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:45.148322 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle podName:2005ddad-ae9b-4f45-b0e5-f6181daff90a nodeName:}" failed. No retries permitted until 2026-06-05 10:50:45.648308654 +0000 UTC m=+234.435756467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle") pod "router-default-6bc5f8d7d7-g4q9q" (UID: "2005ddad-ae9b-4f45-b0e5-f6181daff90a") : configmap references non-existent config key: service-ca.crt Jun 05 10:50:45.148479 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.148460 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b914a01a-b6dd-49ad-8aff-7fb0880e3e63-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9v6m7\" (UID: \"b914a01a-b6dd-49ad-8aff-7fb0880e3e63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" Jun 05 10:50:45.150110 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.150088 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b914a01a-b6dd-49ad-8aff-7fb0880e3e63-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9v6m7\" (UID: \"b914a01a-b6dd-49ad-8aff-7fb0880e3e63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" Jun 05 10:50:45.150269 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.150253 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-stats-auth\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.150314 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.150293 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-default-certificate\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.157326 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.157308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" Jun 05 10:50:45.159181 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.159128 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpcvd\" (UniqueName: \"kubernetes.io/projected/b914a01a-b6dd-49ad-8aff-7fb0880e3e63-kube-api-access-tpcvd\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9v6m7\" (UID: \"b914a01a-b6dd-49ad-8aff-7fb0880e3e63\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" Jun 05 10:50:45.159272 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.159222 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p2r8\" (UniqueName: \"kubernetes.io/projected/2005ddad-ae9b-4f45-b0e5-f6181daff90a-kube-api-access-8p2r8\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.165871 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.165854 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fs92f" Jun 05 10:50:45.175392 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.175365 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wr94x" Jun 05 10:50:45.252714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.252686 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" Jun 05 10:50:45.296889 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.296847 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq"] Jun 05 10:50:45.301559 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:50:45.301530 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff9bf8c_fe4e_429e_bc75_670b0419ce27.slice/crio-2758bb4c519a2b71260d061dbddf52250ea9114173b68a53789f8cf50b98ae74 WatchSource:0}: Error finding container 2758bb4c519a2b71260d061dbddf52250ea9114173b68a53789f8cf50b98ae74: Status 404 returned error can't find the container with id 2758bb4c519a2b71260d061dbddf52250ea9114173b68a53789f8cf50b98ae74 Jun 05 10:50:45.390422 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.390390 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7"] Jun 05 10:50:45.392842 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:50:45.392824 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb914a01a_b6dd_49ad_8aff_7fb0880e3e63.slice/crio-905913d2c11f0e1670adf3616d4bef3af5fd4e324bae6e91b7034a612be63c32 WatchSource:0}: Error finding container 905913d2c11f0e1670adf3616d4bef3af5fd4e324bae6e91b7034a612be63c32: Status 404 returned error can't find the container with id 905913d2c11f0e1670adf3616d4bef3af5fd4e324bae6e91b7034a612be63c32 Jun 05 10:50:45.519453 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.519428 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wr94x"] Jun 05 10:50:45.522512 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:50:45.522483 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4587c133_6966_46d6_81c7_90b3b8956c4b.slice/crio-f7ee1833eb0ff2350c970a124984077a7b07ce503411fb6d44d4a6e73dd8b8e2 WatchSource:0}: Error finding container f7ee1833eb0ff2350c970a124984077a7b07ce503411fb6d44d4a6e73dd8b8e2: Status 404 returned error can't find the container with id f7ee1833eb0ff2350c970a124984077a7b07ce503411fb6d44d4a6e73dd8b8e2 Jun 05 10:50:45.522642 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.522579 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-fs92f"] Jun 05 10:50:45.525933 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:50:45.525913 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ee4673_7463_4ebe_a6ea_c07e06748d08.slice/crio-642d61514e70f8e089d3c2fe24a97cdc22f3f2f1b9f81e58e6a9b6329b9b8897 WatchSource:0}: Error finding container 642d61514e70f8e089d3c2fe24a97cdc22f3f2f1b9f81e58e6a9b6329b9b8897: Status 404 returned error can't find the container with id 642d61514e70f8e089d3c2fe24a97cdc22f3f2f1b9f81e58e6a9b6329b9b8897 Jun 05 10:50:45.551979 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.551951 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:45.552088 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:45.552056 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 10:50:45.552147 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:45.552115 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls podName:13016b13-c77b-4566-b7d6-20fedbe73ff2 nodeName:}" failed. No retries permitted until 2026-06-05 10:50:46.552101692 +0000 UTC m=+235.339549484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7nqtz" (UID: "13016b13-c77b-4566-b7d6-20fedbe73ff2") : secret "cluster-monitoring-operator-tls" not found Jun 05 10:50:45.652794 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.652760 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.652955 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:45.652830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:45.652955 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:45.652873 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 10:50:45.652955 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:45.652937 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs podName:2005ddad-ae9b-4f45-b0e5-f6181daff90a nodeName:}" failed. No retries permitted until 2026-06-05 10:50:46.652922403 +0000 UTC m=+235.440370194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs") pod "router-default-6bc5f8d7d7-g4q9q" (UID: "2005ddad-ae9b-4f45-b0e5-f6181daff90a") : secret "router-metrics-certs-default" not found Jun 05 10:50:45.653079 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:45.652959 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle podName:2005ddad-ae9b-4f45-b0e5-f6181daff90a nodeName:}" failed. No retries permitted until 2026-06-05 10:50:46.652943618 +0000 UTC m=+235.440391411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle") pod "router-default-6bc5f8d7d7-g4q9q" (UID: "2005ddad-ae9b-4f45-b0e5-f6181daff90a") : configmap references non-existent config key: service-ca.crt Jun 05 10:50:46.273151 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:46.273112 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" event={"ID":"6ff9bf8c-fe4e-429e-bc75-670b0419ce27","Type":"ContainerStarted","Data":"2758bb4c519a2b71260d061dbddf52250ea9114173b68a53789f8cf50b98ae74"} Jun 05 10:50:46.274580 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:46.274545 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wr94x" event={"ID":"4587c133-6966-46d6-81c7-90b3b8956c4b","Type":"ContainerStarted","Data":"f7ee1833eb0ff2350c970a124984077a7b07ce503411fb6d44d4a6e73dd8b8e2"} Jun 05 10:50:46.275769 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:46.275716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" event={"ID":"b914a01a-b6dd-49ad-8aff-7fb0880e3e63","Type":"ContainerStarted","Data":"905913d2c11f0e1670adf3616d4bef3af5fd4e324bae6e91b7034a612be63c32"} Jun 05 10:50:46.278213 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:46.278186 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fs92f" event={"ID":"58ee4673-7463-4ebe-a6ea-c07e06748d08","Type":"ContainerStarted","Data":"548e05b016cbc6dab23af15dcad6a40153bafb9857d499c6aeb2e7ce2e87209a"} Jun 05 10:50:46.278313 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:46.278233 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fs92f" event={"ID":"58ee4673-7463-4ebe-a6ea-c07e06748d08","Type":"ContainerStarted","Data":"642d61514e70f8e089d3c2fe24a97cdc22f3f2f1b9f81e58e6a9b6329b9b8897"} Jun 05 10:50:46.293495 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:46.293446 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fs92f" podStartSLOduration=2.293428952 podStartE2EDuration="2.293428952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:50:46.293105572 +0000 UTC m=+235.080553388" watchObservedRunningTime="2026-06-05 10:50:46.293428952 +0000 UTC m=+235.080876766" Jun 05 10:50:46.562959 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:46.562838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:46.563088 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:46.563009 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 10:50:46.563129 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:46.563093 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls podName:13016b13-c77b-4566-b7d6-20fedbe73ff2 nodeName:}" failed. No retries permitted until 2026-06-05 10:50:48.563071957 +0000 UTC m=+237.350519760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7nqtz" (UID: "13016b13-c77b-4566-b7d6-20fedbe73ff2") : secret "cluster-monitoring-operator-tls" not found Jun 05 10:50:46.664000 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:46.663953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:46.664221 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:46.664033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:46.664221 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:46.664146 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 10:50:46.664354 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:46.664236 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs podName:2005ddad-ae9b-4f45-b0e5-f6181daff90a nodeName:}" failed. No retries permitted until 2026-06-05 10:50:48.664215173 +0000 UTC m=+237.451662987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs") pod "router-default-6bc5f8d7d7-g4q9q" (UID: "2005ddad-ae9b-4f45-b0e5-f6181daff90a") : secret "router-metrics-certs-default" not found Jun 05 10:50:46.664354 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:46.664255 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle podName:2005ddad-ae9b-4f45-b0e5-f6181daff90a nodeName:}" failed. No retries permitted until 2026-06-05 10:50:48.66424675 +0000 UTC m=+237.451694563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle") pod "router-default-6bc5f8d7d7-g4q9q" (UID: "2005ddad-ae9b-4f45-b0e5-f6181daff90a") : configmap references non-existent config key: service-ca.crt Jun 05 10:50:47.282505 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:47.282463 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wr94x" event={"ID":"4587c133-6966-46d6-81c7-90b3b8956c4b","Type":"ContainerStarted","Data":"fcde2a10dbbc66aa3ce32a30183b1d4d1b999dac0b9c46f68d8c882ebabc0353"} Jun 05 10:50:47.296735 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:47.296669 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wr94x" podStartSLOduration=1.9770538530000001 podStartE2EDuration="3.296653396s" totalImagesPullingTime="1.319599543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:50:47.296438156 +0000 UTC m=+236.083885971" watchObservedRunningTime="2026-06-05 10:50:47.296653396 +0000 UTC m=+236.084101214" Jun 05 10:50:48.287220 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:48.287157 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" event={"ID":"6ff9bf8c-fe4e-429e-bc75-670b0419ce27","Type":"ContainerStarted","Data":"e43326dac35a68d1b4a68e64f85561c2ae47ae4ec26c13fc55ba8ca70447e933"} Jun 05 10:50:48.288653 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:48.288626 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" event={"ID":"b914a01a-b6dd-49ad-8aff-7fb0880e3e63","Type":"ContainerStarted","Data":"07f2dc64f3ad815d4e478ccb779ae27beb32beedbd6a10ea3f1edddcabec7f15"} Jun 05 10:50:48.301540 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:48.301503 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" podStartSLOduration=1.6973883760000001 podStartE2EDuration="4.30149262s" totalImagesPullingTime="2.604104244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:50:48.301015775 +0000 UTC m=+237.088463588" watchObservedRunningTime="2026-06-05 10:50:48.30149262 +0000 UTC m=+237.088940432" Jun 05 10:50:48.317106 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:48.317068 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" podStartSLOduration=1.8071686059999998 podStartE2EDuration="4.317054688s" totalImagesPullingTime="2.509886082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:50:48.316259393 +0000 UTC m=+237.103707210" watchObservedRunningTime="2026-06-05 10:50:48.317054688 +0000 UTC m=+237.104502531" Jun 05 10:50:48.580742 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:48.580665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:48.580895 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:48.580799 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 10:50:48.580895 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:48.580877 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls podName:13016b13-c77b-4566-b7d6-20fedbe73ff2 nodeName:}" failed. No retries permitted until 2026-06-05 10:50:52.580862936 +0000 UTC m=+241.368310732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7nqtz" (UID: "13016b13-c77b-4566-b7d6-20fedbe73ff2") : secret "cluster-monitoring-operator-tls" not found Jun 05 10:50:48.681698 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:48.681666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:48.681856 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:48.681715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:48.681856 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:48.681804 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 10:50:48.681856 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:48.681850 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle podName:2005ddad-ae9b-4f45-b0e5-f6181daff90a nodeName:}" failed. No retries permitted until 2026-06-05 10:50:52.681836168 +0000 UTC m=+241.469283959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle") pod "router-default-6bc5f8d7d7-g4q9q" (UID: "2005ddad-ae9b-4f45-b0e5-f6181daff90a") : configmap references non-existent config key: service-ca.crt Jun 05 10:50:48.681971 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:48.681868 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs podName:2005ddad-ae9b-4f45-b0e5-f6181daff90a nodeName:}" failed. No retries permitted until 2026-06-05 10:50:52.681859601 +0000 UTC m=+241.469307395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs") pod "router-default-6bc5f8d7d7-g4q9q" (UID: "2005ddad-ae9b-4f45-b0e5-f6181daff90a") : secret "router-metrics-certs-default" not found Jun 05 10:50:49.367409 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:49.367376 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr"] Jun 05 10:50:49.370605 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:49.370587 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr" Jun 05 10:50:49.372902 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:49.372881 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 05 10:50:49.372902 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:49.372889 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 05 10:50:49.373872 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:49.373857 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-r2nd5\"" Jun 05 10:50:49.380356 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:49.380332 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr"] Jun 05 10:50:49.487405 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:49.487367 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj87q\" (UniqueName: \"kubernetes.io/projected/47f99db4-d0bf-40e1-8ed6-22b2df1c687f-kube-api-access-gj87q\") pod \"migrator-955ffdf5f-8gnhr\" (UID: \"47f99db4-d0bf-40e1-8ed6-22b2df1c687f\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr" Jun 05 10:50:49.588609 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:49.588575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj87q\" (UniqueName: \"kubernetes.io/projected/47f99db4-d0bf-40e1-8ed6-22b2df1c687f-kube-api-access-gj87q\") pod \"migrator-955ffdf5f-8gnhr\" (UID: \"47f99db4-d0bf-40e1-8ed6-22b2df1c687f\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr" Jun 05 10:50:49.598949 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:49.598919 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj87q\" (UniqueName: \"kubernetes.io/projected/47f99db4-d0bf-40e1-8ed6-22b2df1c687f-kube-api-access-gj87q\") pod \"migrator-955ffdf5f-8gnhr\" (UID: \"47f99db4-d0bf-40e1-8ed6-22b2df1c687f\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr" Jun 05 10:50:49.679864 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:49.679808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr" Jun 05 10:50:49.799064 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:49.799038 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr"] Jun 05 10:50:49.802141 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:50:49.802115 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f99db4_d0bf_40e1_8ed6_22b2df1c687f.slice/crio-a5807b4f1eb097cceeff1c09ed78d29f56d089f6320c61c640a63f55f6a5ecb3 WatchSource:0}: Error finding container a5807b4f1eb097cceeff1c09ed78d29f56d089f6320c61c640a63f55f6a5ecb3: Status 404 returned error can't find the container with id a5807b4f1eb097cceeff1c09ed78d29f56d089f6320c61c640a63f55f6a5ecb3 Jun 05 10:50:50.296651 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:50.296613 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr" event={"ID":"47f99db4-d0bf-40e1-8ed6-22b2df1c687f","Type":"ContainerStarted","Data":"a5807b4f1eb097cceeff1c09ed78d29f56d089f6320c61c640a63f55f6a5ecb3"} Jun 05 10:50:50.894362 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:50.894337 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4fz2m_3fc2b3f4-5d2e-4654-8748-770ab05d667b/dns-node-resolver/0.log" Jun 05 10:50:51.300713 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:51.300682 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr" event={"ID":"47f99db4-d0bf-40e1-8ed6-22b2df1c687f","Type":"ContainerStarted","Data":"fb2f0d25087275633229f5a737f17cd22492d1bb5a93e720114457a0001f8da2"} Jun 05 10:50:51.300897 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:51.300739 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr" event={"ID":"47f99db4-d0bf-40e1-8ed6-22b2df1c687f","Type":"ContainerStarted","Data":"2e28cca9b96ddeb9bf8d43061040d06cd290d969a9ed7487245e1fd8bae2ce82"} Jun 05 10:50:51.316054 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:51.316002 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8gnhr" podStartSLOduration=1.225684576 podStartE2EDuration="2.315989532s" totalImagesPullingTime="1.090304956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:50:51.314719413 +0000 UTC m=+240.102167225" watchObservedRunningTime="2026-06-05 10:50:51.315989532 +0000 UTC m=+240.103437345" Jun 05 10:50:52.294372 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:52.294340 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lwdlg_79890b97-8df2-4cbf-9076-358cf6ca8e70/node-ca/0.log" Jun 05 10:50:52.610591 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:52.610498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:50:52.610743 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:52.610610 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 10:50:52.610743 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:52.610664 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls podName:13016b13-c77b-4566-b7d6-20fedbe73ff2 nodeName:}" failed. No retries permitted until 2026-06-05 10:51:00.61065039 +0000 UTC m=+249.398098182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7nqtz" (UID: "13016b13-c77b-4566-b7d6-20fedbe73ff2") : secret "cluster-monitoring-operator-tls" not found Jun 05 10:50:52.695409 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:52.695378 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5k57r_1468658a-02c9-4c80-a102-f338a490caf3/serve-healthcheck-canary/0.log" Jun 05 10:50:52.711627 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:52.711596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:52.711766 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:50:52.711657 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:50:52.711766 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:52.711746 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 10:50:52.711845 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:52.711772 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle podName:2005ddad-ae9b-4f45-b0e5-f6181daff90a nodeName:}" failed. No retries permitted until 2026-06-05 10:51:00.71175305 +0000 UTC m=+249.499200841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle") pod "router-default-6bc5f8d7d7-g4q9q" (UID: "2005ddad-ae9b-4f45-b0e5-f6181daff90a") : configmap references non-existent config key: service-ca.crt Jun 05 10:50:52.711845 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:50:52.711792 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs podName:2005ddad-ae9b-4f45-b0e5-f6181daff90a nodeName:}" failed. No retries permitted until 2026-06-05 10:51:00.711782427 +0000 UTC m=+249.499230234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs") pod "router-default-6bc5f8d7d7-g4q9q" (UID: "2005ddad-ae9b-4f45-b0e5-f6181daff90a") : secret "router-metrics-certs-default" not found Jun 05 10:51:00.670399 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:00.670361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:51:00.670786 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:51:00.670504 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 10:51:00.670786 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:51:00.670568 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls podName:13016b13-c77b-4566-b7d6-20fedbe73ff2 nodeName:}" failed. No retries permitted until 2026-06-05 10:51:16.670553762 +0000 UTC m=+265.458001553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7nqtz" (UID: "13016b13-c77b-4566-b7d6-20fedbe73ff2") : secret "cluster-monitoring-operator-tls" not found Jun 05 10:51:00.770811 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:00.770781 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:51:00.770948 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:00.770833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:51:00.771002 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:51:00.770965 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle podName:2005ddad-ae9b-4f45-b0e5-f6181daff90a nodeName:}" failed. No retries permitted until 2026-06-05 10:51:16.770952353 +0000 UTC m=+265.558400144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle") pod "router-default-6bc5f8d7d7-g4q9q" (UID: "2005ddad-ae9b-4f45-b0e5-f6181daff90a") : configmap references non-existent config key: service-ca.crt Jun 05 10:51:00.773293 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:00.773274 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2005ddad-ae9b-4f45-b0e5-f6181daff90a-metrics-certs\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:51:03.490186 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:03.490135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:51:03.492488 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:03.492470 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8206f9d1-eeae-4107-8ec4-947a6f0f34a2-metrics-certs\") pod \"network-metrics-daemon-w5msc\" (UID: \"8206f9d1-eeae-4107-8ec4-947a6f0f34a2\") " pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:51:03.753002 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:03.752922 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-km9bk\"" Jun 05 10:51:03.760982 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:03.760961 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5msc" Jun 05 10:51:03.879725 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:03.879685 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w5msc"] Jun 05 10:51:03.882238 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:03.882208 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8206f9d1_eeae_4107_8ec4_947a6f0f34a2.slice/crio-aadf47788952b142cff97c92b600c2e023e57a81debb2a015483bdcb0afb4d56 WatchSource:0}: Error finding container aadf47788952b142cff97c92b600c2e023e57a81debb2a015483bdcb0afb4d56: Status 404 returned error can't find the container with id aadf47788952b142cff97c92b600c2e023e57a81debb2a015483bdcb0afb4d56 Jun 05 10:51:04.337709 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:04.337665 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5msc" event={"ID":"8206f9d1-eeae-4107-8ec4-947a6f0f34a2","Type":"ContainerStarted","Data":"aadf47788952b142cff97c92b600c2e023e57a81debb2a015483bdcb0afb4d56"} Jun 05 10:51:05.342221 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:05.342186 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5msc" event={"ID":"8206f9d1-eeae-4107-8ec4-947a6f0f34a2","Type":"ContainerStarted","Data":"732ce97041804cf1831eecd1021047bc6967b4cb8a74540fc857eaf2dcefc201"} Jun 05 10:51:05.342583 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:05.342235 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5msc" event={"ID":"8206f9d1-eeae-4107-8ec4-947a6f0f34a2","Type":"ContainerStarted","Data":"84a17adeea8ba9e306f3262e1915ea9156b08d86276a23a37ffbf1bce55d0c48"} Jun 05 10:51:05.358072 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:05.358031 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w5msc" podStartSLOduration=252.446711871 podStartE2EDuration="4m13.358016458s" totalImagesPullingTime="911.304587ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:05.357143165 +0000 UTC m=+254.144590978" watchObservedRunningTime="2026-06-05 10:51:05.358016458 +0000 UTC m=+254.145464270" Jun 05 10:51:11.728696 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.728610 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bmxf7"] Jun 05 10:51:11.732485 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.732471 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.734834 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.734815 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 10:51:11.735899 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.735881 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 10:51:11.736008 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.735885 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b5hnp\"" Jun 05 10:51:11.736008 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.735920 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 10:51:11.736008 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.735937 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 10:51:11.743072 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.743051 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bmxf7"] Jun 05 10:51:11.749762 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.749742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fab1fccb-56a6-4386-8611-0d496c5e8077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.749849 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.749798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fab1fccb-56a6-4386-8611-0d496c5e8077-data-volume\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.749849 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.749822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6s4k\" (UniqueName: \"kubernetes.io/projected/fab1fccb-56a6-4386-8611-0d496c5e8077-kube-api-access-l6s4k\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.749849 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.749839 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fab1fccb-56a6-4386-8611-0d496c5e8077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.749976 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.749854 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fab1fccb-56a6-4386-8611-0d496c5e8077-crio-socket\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.850860 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.850830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fab1fccb-56a6-4386-8611-0d496c5e8077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.850860 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.850865 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fab1fccb-56a6-4386-8611-0d496c5e8077-crio-socket\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.851059 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.850917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fab1fccb-56a6-4386-8611-0d496c5e8077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.851059 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.850959 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fab1fccb-56a6-4386-8611-0d496c5e8077-data-volume\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.851059 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.851028 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fab1fccb-56a6-4386-8611-0d496c5e8077-crio-socket\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.851208 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.851059 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6s4k\" (UniqueName: \"kubernetes.io/projected/fab1fccb-56a6-4386-8611-0d496c5e8077-kube-api-access-l6s4k\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.851365 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.851347 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fab1fccb-56a6-4386-8611-0d496c5e8077-data-volume\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.851464 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.851445 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fab1fccb-56a6-4386-8611-0d496c5e8077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.853479 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.853458 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fab1fccb-56a6-4386-8611-0d496c5e8077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:11.865525 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:11.865503 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6s4k\" (UniqueName: \"kubernetes.io/projected/fab1fccb-56a6-4386-8611-0d496c5e8077-kube-api-access-l6s4k\") pod \"insights-runtime-extractor-bmxf7\" (UID: \"fab1fccb-56a6-4386-8611-0d496c5e8077\") " pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:12.040811 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:12.040785 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bmxf7" Jun 05 10:51:12.165241 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:12.165210 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bmxf7"] Jun 05 10:51:12.168052 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:12.168028 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab1fccb_56a6_4386_8611_0d496c5e8077.slice/crio-e2d38cf8c65be0470c89c6ab11906dcc42c8fda2ce7411233e0da4df0e0c8273 WatchSource:0}: Error finding container e2d38cf8c65be0470c89c6ab11906dcc42c8fda2ce7411233e0da4df0e0c8273: Status 404 returned error can't find the container with id e2d38cf8c65be0470c89c6ab11906dcc42c8fda2ce7411233e0da4df0e0c8273 Jun 05 10:51:12.362913 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:12.362826 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmxf7" event={"ID":"fab1fccb-56a6-4386-8611-0d496c5e8077","Type":"ContainerStarted","Data":"1724f5068e22a6a272a3b4941130aeaca3478b12010fd7246748a27f6b7c9667"} Jun 05 10:51:12.362913 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:12.362880 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmxf7" event={"ID":"fab1fccb-56a6-4386-8611-0d496c5e8077","Type":"ContainerStarted","Data":"e2d38cf8c65be0470c89c6ab11906dcc42c8fda2ce7411233e0da4df0e0c8273"} Jun 05 10:51:13.369881 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:13.369843 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmxf7" event={"ID":"fab1fccb-56a6-4386-8611-0d496c5e8077","Type":"ContainerStarted","Data":"5b989945874021a0f9cea5063ef6d72c2de722970569a005828991cddaa59c5f"} Jun 05 10:51:15.380228 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:15.380191 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmxf7" event={"ID":"fab1fccb-56a6-4386-8611-0d496c5e8077","Type":"ContainerStarted","Data":"0442684f2a596a8e6f6415b733693ca4668286ed75cc6fa19bef3144a00a3ef0"} Jun 05 10:51:15.397448 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:15.397408 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bmxf7" podStartSLOduration=2.299272814 podStartE2EDuration="4.397394532s" totalImagesPullingTime="2.098121718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 10:51:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:15.395450017 +0000 UTC m=+264.182897830" watchObservedRunningTime="2026-06-05 10:51:15.397394532 +0000 UTC m=+264.184842345" Jun 05 10:51:16.690268 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:16.690234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:51:16.692688 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:16.692662 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13016b13-c77b-4566-b7d6-20fedbe73ff2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7nqtz\" (UID: \"13016b13-c77b-4566-b7d6-20fedbe73ff2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:51:16.791020 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:16.790984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:51:16.791561 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:16.791544 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005ddad-ae9b-4f45-b0e5-f6181daff90a-service-ca-bundle\") pod \"router-default-6bc5f8d7d7-g4q9q\" (UID: \"2005ddad-ae9b-4f45-b0e5-f6181daff90a\") " pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:51:16.982931 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:16.982864 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lcmtz\"" Jun 05 10:51:16.990701 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:16.990682 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" Jun 05 10:51:17.061892 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:17.061864 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xfszd\"" Jun 05 10:51:17.069771 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:17.069747 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:51:17.160836 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:17.160808 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz"] Jun 05 10:51:17.163031 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:17.163009 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13016b13_c77b_4566_b7d6_20fedbe73ff2.slice/crio-16345cc2297679bcca9ac37ad8b61e88bbfc5a8d42c42158b0ff1625826a815c WatchSource:0}: Error finding container 16345cc2297679bcca9ac37ad8b61e88bbfc5a8d42c42158b0ff1625826a815c: Status 404 returned error can't find the container with id 16345cc2297679bcca9ac37ad8b61e88bbfc5a8d42c42158b0ff1625826a815c Jun 05 10:51:17.226847 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:17.226779 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bc5f8d7d7-g4q9q"] Jun 05 10:51:17.229154 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:17.229128 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2005ddad_ae9b_4f45_b0e5_f6181daff90a.slice/crio-969e316c020c547bb8846e8fb8783d9b346d26c5515719ab312153349c60925b WatchSource:0}: Error finding container 969e316c020c547bb8846e8fb8783d9b346d26c5515719ab312153349c60925b: Status 404 returned error can't find the container with id 969e316c020c547bb8846e8fb8783d9b346d26c5515719ab312153349c60925b Jun 05 10:51:17.388117 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:17.388073 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" event={"ID":"13016b13-c77b-4566-b7d6-20fedbe73ff2","Type":"ContainerStarted","Data":"16345cc2297679bcca9ac37ad8b61e88bbfc5a8d42c42158b0ff1625826a815c"} Jun 05 10:51:17.389467 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:17.389446 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" event={"ID":"2005ddad-ae9b-4f45-b0e5-f6181daff90a","Type":"ContainerStarted","Data":"f72ffe36307d3c991585844f466d8fa368b996df2460d0eac68547bb7d69a499"} Jun 05 10:51:17.389552 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:17.389483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" event={"ID":"2005ddad-ae9b-4f45-b0e5-f6181daff90a","Type":"ContainerStarted","Data":"969e316c020c547bb8846e8fb8783d9b346d26c5515719ab312153349c60925b"} Jun 05 10:51:17.407792 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:17.407753 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" podStartSLOduration=33.407738094 podStartE2EDuration="33.407738094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:17.40769764 +0000 UTC m=+266.195145453" watchObservedRunningTime="2026-06-05 10:51:17.407738094 +0000 UTC m=+266.195185904" Jun 05 10:51:18.070488 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.070449 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:51:18.073160 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.073128 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:51:18.393724 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.393640 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:51:18.395128 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.395108 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bc5f8d7d7-g4q9q" Jun 05 10:51:18.722823 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.722745 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-755c6d57df-4stvs"] Jun 05 10:51:18.725994 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.725970 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.728433 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.728404 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 10:51:18.728542 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.728404 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 10:51:18.728542 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.728468 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 10:51:18.728542 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.728502 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 10:51:18.728690 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.728556 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 10:51:18.729530 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.729481 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 10:51:18.729656 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.729558 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tdb8d\"" Jun 05 10:51:18.729656 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.729598 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 10:51:18.736131 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.736110 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755c6d57df-4stvs"] Jun 05 10:51:18.807383 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.807349 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-oauth-config\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.807559 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.807410 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-serving-cert\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.807559 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.807503 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-oauth-serving-cert\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.807559 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.807548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-service-ca\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.807721 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.807606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-config\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.807721 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.807643 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb69v\" (UniqueName: \"kubernetes.io/projected/899b11e5-2617-4fb9-bf7a-cefd43d84532-kube-api-access-jb69v\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.910781 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.908450 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-service-ca\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.910781 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.908534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-config\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.910781 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.908587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb69v\" (UniqueName: \"kubernetes.io/projected/899b11e5-2617-4fb9-bf7a-cefd43d84532-kube-api-access-jb69v\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.910781 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.908652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-oauth-config\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.910781 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.908928 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-serving-cert\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.910781 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.908986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-oauth-serving-cert\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.910781 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.909279 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-service-ca\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.910781 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.910109 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-oauth-serving-cert\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.913204 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.913161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-config\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.913527 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.913509 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-oauth-config\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.914776 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.914754 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-serving-cert\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:18.917358 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:18.917340 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb69v\" (UniqueName: \"kubernetes.io/projected/899b11e5-2617-4fb9-bf7a-cefd43d84532-kube-api-access-jb69v\") pod \"console-755c6d57df-4stvs\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:19.037854 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:19.037824 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:19.166873 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:19.166847 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755c6d57df-4stvs"] Jun 05 10:51:19.169602 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:19.169577 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899b11e5_2617_4fb9_bf7a_cefd43d84532.slice/crio-db3519309152f449c68a2d8952431243825074b04a674d8a20ddd011122cd36a WatchSource:0}: Error finding container db3519309152f449c68a2d8952431243825074b04a674d8a20ddd011122cd36a: Status 404 returned error can't find the container with id db3519309152f449c68a2d8952431243825074b04a674d8a20ddd011122cd36a Jun 05 10:51:19.398421 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:19.398377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755c6d57df-4stvs" event={"ID":"899b11e5-2617-4fb9-bf7a-cefd43d84532","Type":"ContainerStarted","Data":"db3519309152f449c68a2d8952431243825074b04a674d8a20ddd011122cd36a"} Jun 05 10:51:19.399969 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:19.399942 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" event={"ID":"13016b13-c77b-4566-b7d6-20fedbe73ff2","Type":"ContainerStarted","Data":"0647a3111d3ec9ce908b863a0dcacb50be1a8ab917bc441794a31ecb925c522d"} Jun 05 10:51:19.418142 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:19.418097 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7nqtz" podStartSLOduration=33.644524838 podStartE2EDuration="35.418083154s" totalImagesPullingTime="1.773558316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:19.417820062 +0000 UTC m=+268.205267876" watchObservedRunningTime="2026-06-05 10:51:19.418083154 +0000 UTC m=+268.205530967" Jun 05 10:51:22.475055 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.475031 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-hmt65"] Jun 05 10:51:22.477928 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.477906 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:22.481345 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.481321 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 05 10:51:22.481445 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.481327 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 05 10:51:22.481445 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.481375 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 10:51:22.481445 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.481412 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4vhc9\"" Jun 05 10:51:22.487175 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.487133 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-hmt65"] Jun 05 10:51:22.542435 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.542406 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:22.542592 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.542471 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk828\" (UniqueName: \"kubernetes.io/projected/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-kube-api-access-bk828\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:22.542592 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.542529 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:22.542592 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.542558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:22.643512 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.643417 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk828\" (UniqueName: \"kubernetes.io/projected/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-kube-api-access-bk828\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:22.643662 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.643532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:22.643662 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.643564 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:22.643662 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.643648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:22.643816 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:51:22.643744 2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 05 10:51:22.643816 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:51:22.643800 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-prometheus-operator-tls podName:c75dd63d-ff5c-4130-a7ac-6d09575c6cb4 nodeName:}" failed. No retries permitted until 2026-06-05 10:51:23.143782469 +0000 UTC m=+271.931230263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-hmt65" (UID: "c75dd63d-ff5c-4130-a7ac-6d09575c6cb4") : secret "prometheus-operator-tls" not found Jun 05 10:51:22.644257 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.644234 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:22.645984 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.645960 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:22.653501 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:22.653453 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk828\" (UniqueName: \"kubernetes.io/projected/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-kube-api-access-bk828\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:23.146973 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:23.146921 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:23.149357 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:23.149335 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c75dd63d-ff5c-4130-a7ac-6d09575c6cb4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-hmt65\" (UID: \"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:23.386826 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:23.386788 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" Jun 05 10:51:23.417270 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:23.417203 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755c6d57df-4stvs" event={"ID":"899b11e5-2617-4fb9-bf7a-cefd43d84532","Type":"ContainerStarted","Data":"c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb"} Jun 05 10:51:23.433766 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:23.433596 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-755c6d57df-4stvs" podStartSLOduration=2.201754064 podStartE2EDuration="5.433574742s" totalImagesPullingTime="3.231820678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:23.432647762 +0000 UTC m=+272.220095577" watchObservedRunningTime="2026-06-05 10:51:23.433574742 +0000 UTC m=+272.221022556" Jun 05 10:51:23.509091 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:23.508961 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-hmt65"] Jun 05 10:51:23.511360 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:23.511336 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75dd63d_ff5c_4130_a7ac_6d09575c6cb4.slice/crio-ef12849f9c86fb65f3f610663d3402c1536f1bae65e16a994137d5a35114bf10 WatchSource:0}: Error finding container ef12849f9c86fb65f3f610663d3402c1536f1bae65e16a994137d5a35114bf10: Status 404 returned error can't find the container with id ef12849f9c86fb65f3f610663d3402c1536f1bae65e16a994137d5a35114bf10 Jun 05 10:51:24.422246 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:24.422209 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" event={"ID":"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4","Type":"ContainerStarted","Data":"ef12849f9c86fb65f3f610663d3402c1536f1bae65e16a994137d5a35114bf10"} Jun 05 10:51:25.426559 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:25.426525 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" event={"ID":"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4","Type":"ContainerStarted","Data":"324f30de39630c5320dc767e39fdb9995e61f52781b43cad7ce4047c756346d5"} Jun 05 10:51:25.426918 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:25.426580 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" event={"ID":"c75dd63d-ff5c-4130-a7ac-6d09575c6cb4","Type":"ContainerStarted","Data":"3ed90541a81a8f073f0680070c69fee0eac838522d8ec6d74bdc720119472340"} Jun 05 10:51:25.441083 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:25.441040 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hmt65" podStartSLOduration=2.2035961410000002 podStartE2EDuration="3.441027069s" totalImagesPullingTime="1.237430928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:25.4410221 +0000 UTC m=+274.228469935" watchObservedRunningTime="2026-06-05 10:51:25.441027069 +0000 UTC m=+274.228474861" Jun 05 10:51:27.843278 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.843245 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc"] Jun 05 10:51:27.846712 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.846696 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:27.850203 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.850180 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 10:51:27.850698 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.850681 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 10:51:27.850744 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.850700 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-748jz\"" Jun 05 10:51:27.863847 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.863809 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc"] Jun 05 10:51:27.909344 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.909314 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4p685"] Jun 05 10:51:27.912577 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.912558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:27.915022 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.914999 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9ggcl\"" Jun 05 10:51:27.915143 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.915128 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 10:51:27.915507 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.915487 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 10:51:27.915597 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.915489 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 10:51:27.987137 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:27.987137 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987138 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06bb21c6-fc49-4cd2-a274-c3476391a307-root\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:27.987306 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-wtmp\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:27.987306 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06bb21c6-fc49-4cd2-a274-c3476391a307-metrics-client-ca\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:27.987306 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987246 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tt4z\" (UniqueName: \"kubernetes.io/projected/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-kube-api-access-5tt4z\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:27.987306 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:27.987434 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-textfile\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:27.987434 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987362 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06bb21c6-fc49-4cd2-a274-c3476391a307-sys\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:27.987434 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-tls\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:27.987518 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:27.987518 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987463 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-accelerators-collector-config\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:27.987518 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987479 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v2sj\" (UniqueName: \"kubernetes.io/projected/06bb21c6-fc49-4cd2-a274-c3476391a307-kube-api-access-5v2sj\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:27.987607 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:27.987518 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:28.088364 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088337 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06bb21c6-fc49-4cd2-a274-c3476391a307-sys\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.088487 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088376 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-tls\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.088487 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:28.088487 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088437 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-accelerators-collector-config\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.088487 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088443 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06bb21c6-fc49-4cd2-a274-c3476391a307-sys\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.088487 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v2sj\" (UniqueName: \"kubernetes.io/projected/06bb21c6-fc49-4cd2-a274-c3476391a307-kube-api-access-5v2sj\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.088706 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088496 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:28.088706 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088540 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:28.088706 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:51:28.088546 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 05 10:51:28.088706 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088563 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06bb21c6-fc49-4cd2-a274-c3476391a307-root\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.088706 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088586 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-wtmp\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.088706 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:51:28.088614 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-openshift-state-metrics-tls podName:d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5 nodeName:}" failed. No retries permitted until 2026-06-05 10:51:28.588596784 +0000 UTC m=+277.376044589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-wrwhc" (UID: "d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5") : secret "openshift-state-metrics-tls" not found Jun 05 10:51:28.088706 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06bb21c6-fc49-4cd2-a274-c3476391a307-metrics-client-ca\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.088706 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tt4z\" (UniqueName: \"kubernetes.io/projected/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-kube-api-access-5tt4z\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:28.089082 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-wtmp\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.089082 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.089082 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.088771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-textfile\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.089082 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.089076 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-accelerators-collector-config\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.089460 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.089252 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-textfile\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.089460 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.089291 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06bb21c6-fc49-4cd2-a274-c3476391a307-metrics-client-ca\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.089460 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.089373 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06bb21c6-fc49-4cd2-a274-c3476391a307-root\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.089617 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.089556 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:28.090915 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.090894 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-tls\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.091046 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.091028 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06bb21c6-fc49-4cd2-a274-c3476391a307-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.091105 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.091032 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:28.095790 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.095724 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v2sj\" (UniqueName: \"kubernetes.io/projected/06bb21c6-fc49-4cd2-a274-c3476391a307-kube-api-access-5v2sj\") pod \"node-exporter-4p685\" (UID: \"06bb21c6-fc49-4cd2-a274-c3476391a307\") " pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.097392 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.097375 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tt4z\" (UniqueName: \"kubernetes.io/projected/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-kube-api-access-5tt4z\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:28.220981 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.220956 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4p685" Jun 05 10:51:28.231820 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:28.231799 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bb21c6_fc49_4cd2_a274_c3476391a307.slice/crio-3191046d13a374774be41bcbf371fd85b3f94b8f5d2c82662cda0ce29a538740 WatchSource:0}: Error finding container 3191046d13a374774be41bcbf371fd85b3f94b8f5d2c82662cda0ce29a538740: Status 404 returned error can't find the container with id 3191046d13a374774be41bcbf371fd85b3f94b8f5d2c82662cda0ce29a538740 Jun 05 10:51:28.436766 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.436688 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4p685" event={"ID":"06bb21c6-fc49-4cd2-a274-c3476391a307","Type":"ContainerStarted","Data":"3191046d13a374774be41bcbf371fd85b3f94b8f5d2c82662cda0ce29a538740"} Jun 05 10:51:28.593769 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.593736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:28.596477 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.596450 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wrwhc\" (UID: \"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:28.755018 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.754982 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" Jun 05 10:51:28.910363 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:28.910108 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc"] Jun 05 10:51:29.038743 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.038648 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:29.038743 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.038712 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:29.040155 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.040126 2580 patch_prober.go:28] interesting pod/console-755c6d57df-4stvs container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body= Jun 05 10:51:29.040289 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.040198 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-755c6d57df-4stvs" podUID="899b11e5-2617-4fb9-bf7a-cefd43d84532" containerName="console" probeResult="failure" output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" Jun 05 10:51:29.066222 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:29.066193 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8972a8a_eaf3_4f5a_b7b5_15fbb4e8a2d5.slice/crio-7fb90710e190bc2bcd8e74be732e27cf21c82a667ddceff7b6ca3729881b6b93 WatchSource:0}: Error finding container 7fb90710e190bc2bcd8e74be732e27cf21c82a667ddceff7b6ca3729881b6b93: Status 404 returned error can't find the container with id 7fb90710e190bc2bcd8e74be732e27cf21c82a667ddceff7b6ca3729881b6b93 Jun 05 10:51:29.442309 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.442227 2580 generic.go:356] "Generic (PLEG): container finished" podID="06bb21c6-fc49-4cd2-a274-c3476391a307" containerID="7383036ce00a9e8cc23a05f67a597e227fb164d5f268744bda5806e4d120d3f4" exitCode=0 Jun 05 10:51:29.442459 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.442318 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4p685" event={"ID":"06bb21c6-fc49-4cd2-a274-c3476391a307","Type":"ContainerDied","Data":"7383036ce00a9e8cc23a05f67a597e227fb164d5f268744bda5806e4d120d3f4"} Jun 05 10:51:29.444198 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.444149 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" event={"ID":"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5","Type":"ContainerStarted","Data":"238d4a1fb9962049ea3e4c048cccee581ed4b7aae765f627a4e853dae04c2c84"} Jun 05 10:51:29.444278 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.444228 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" event={"ID":"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5","Type":"ContainerStarted","Data":"931b596cf7d25ea791353caefeff71d9ed8c00d805849031adb9f637dce5d4dc"} Jun 05 10:51:29.444278 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.444256 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" event={"ID":"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5","Type":"ContainerStarted","Data":"7fb90710e190bc2bcd8e74be732e27cf21c82a667ddceff7b6ca3729881b6b93"} Jun 05 10:51:29.834780 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.834743 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs"] Jun 05 10:51:29.838424 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.838402 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:29.840934 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.840897 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 05 10:51:29.841057 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.840962 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 05 10:51:29.841057 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.840897 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 05 10:51:29.841199 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.841067 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pjzs2\"" Jun 05 10:51:29.841309 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.841288 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 05 10:51:29.841435 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.841330 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-abdo55qq0sbbl\"" Jun 05 10:51:29.841435 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.841361 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 05 10:51:29.851029 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.850485 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs"] Jun 05 10:51:29.905799 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.905768 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:29.905799 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.905808 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:29.906016 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.905842 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhvp5\" (UniqueName: \"kubernetes.io/projected/eeedb931-d311-4378-8b29-a1eb5fa1a844-kube-api-access-fhvp5\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:29.906016 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.905941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-grpc-tls\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:29.906016 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.905983 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:29.906141 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.906019 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:29.906141 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.906044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeedb931-d311-4378-8b29-a1eb5fa1a844-metrics-client-ca\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:29.906313 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:29.906188 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-tls\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.007271 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.007238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-grpc-tls\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.007271 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.007281 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.007798 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.007308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.007798 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.007337 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeedb931-d311-4378-8b29-a1eb5fa1a844-metrics-client-ca\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.007798 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.007413 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-tls\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.007798 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.007468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.007798 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.007703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.007798 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.007749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhvp5\" (UniqueName: \"kubernetes.io/projected/eeedb931-d311-4378-8b29-a1eb5fa1a844-kube-api-access-fhvp5\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.008397 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.008326 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeedb931-d311-4378-8b29-a1eb5fa1a844-metrics-client-ca\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.010417 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.010393 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-grpc-tls\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.010514 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.010444 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.010585 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.010564 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-tls\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.010679 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.010653 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.010782 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.010653 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.011253 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.011236 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeedb931-d311-4378-8b29-a1eb5fa1a844-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.015145 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.015128 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhvp5\" (UniqueName: \"kubernetes.io/projected/eeedb931-d311-4378-8b29-a1eb5fa1a844-kube-api-access-fhvp5\") pod \"thanos-querier-7f9cb469b9-7hgbs\" (UID: \"eeedb931-d311-4378-8b29-a1eb5fa1a844\") " pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.150747 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.150725 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:30.279667 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.279639 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs"] Jun 05 10:51:30.281842 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:30.281811 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeedb931_d311_4378_8b29_a1eb5fa1a844.slice/crio-1356861b98a15e8499e25ef86b6ea5aeb9dbe8bb1dde7a9b7d712a407f92863d WatchSource:0}: Error finding container 1356861b98a15e8499e25ef86b6ea5aeb9dbe8bb1dde7a9b7d712a407f92863d: Status 404 returned error can't find the container with id 1356861b98a15e8499e25ef86b6ea5aeb9dbe8bb1dde7a9b7d712a407f92863d Jun 05 10:51:30.448417 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.448322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" event={"ID":"eeedb931-d311-4378-8b29-a1eb5fa1a844","Type":"ContainerStarted","Data":"1356861b98a15e8499e25ef86b6ea5aeb9dbe8bb1dde7a9b7d712a407f92863d"} Jun 05 10:51:30.450451 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.450416 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4p685" event={"ID":"06bb21c6-fc49-4cd2-a274-c3476391a307","Type":"ContainerStarted","Data":"1e36d81899c950d79c820cbd4c8cbcb64753682f82c775b800768c5ff093cbce"} Jun 05 10:51:30.450587 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.450472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4p685" event={"ID":"06bb21c6-fc49-4cd2-a274-c3476391a307","Type":"ContainerStarted","Data":"17af0e5dd28ead71287e35385de88b05801eca507a9c9685b449ad57841626fe"} Jun 05 10:51:30.452331 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.452309 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" event={"ID":"d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5","Type":"ContainerStarted","Data":"7fe2e9114b1cd33219cb3022981cf6bb2ced7bfe887daf08095a2b6327a88da8"} Jun 05 10:51:30.466862 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.466816 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4p685" podStartSLOduration=2.505426182 podStartE2EDuration="3.466800654s" totalImagesPullingTime="889.765065ms" totalInitContainerRuntime="71.609407ms" isStatefulPod=true podCreationTimestamp="2026-06-05 10:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:30.466376565 +0000 UTC m=+279.253824403" watchObservedRunningTime="2026-06-05 10:51:30.466800654 +0000 UTC m=+279.254248469" Jun 05 10:51:30.482640 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:30.482597 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wrwhc" podStartSLOduration=2.571749298 podStartE2EDuration="3.482583553s" totalImagesPullingTime="910.834255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:30.481461989 +0000 UTC m=+279.268909802" watchObservedRunningTime="2026-06-05 10:51:30.482583553 +0000 UTC m=+279.270031365" Jun 05 10:51:32.101548 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:51:32.101502 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" podUID="9ac2483d-5e71-4080-a380-6712ff6dd22a" Jun 05 10:51:32.101548 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:51:32.101505 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mh4n9" podUID="767b7136-2858-4788-8ddb-6ccf5300b835" Jun 05 10:51:32.461332 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.461301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mh4n9" Jun 05 10:51:32.461332 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.461313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" event={"ID":"eeedb931-d311-4378-8b29-a1eb5fa1a844","Type":"ContainerStarted","Data":"7b6d91a8195d339226aa09781e34ea56a22776a8ffc15f2be0760c45284aa6b4"} Jun 05 10:51:32.461514 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.461387 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" event={"ID":"eeedb931-d311-4378-8b29-a1eb5fa1a844","Type":"ContainerStarted","Data":"7929f76a28e62692cf99b2e5fd826982c18423e7be24333c16c8ea2b8f9db565"} Jun 05 10:51:32.461514 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.461421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:51:32.461514 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.461434 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" event={"ID":"eeedb931-d311-4378-8b29-a1eb5fa1a844","Type":"ContainerStarted","Data":"56b9e57111fa88610558b394b8bc90ca7e9e424576c235e2d49347b25a4e4382"} Jun 05 10:51:32.623823 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.623745 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd"] Jun 05 10:51:32.626885 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.626867 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" Jun 05 10:51:32.629293 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.629266 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7p4bz\"" Jun 05 10:51:32.629402 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.629307 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 05 10:51:32.635548 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.635525 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd"] Jun 05 10:51:32.640641 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.640620 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755c6d57df-4stvs"] Jun 05 10:51:32.730939 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.730902 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00c25a2c-4695-4f65-9f2a-ddaa12c6ee23-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-jc4sd\" (UID: \"00c25a2c-4695-4f65-9f2a-ddaa12c6ee23\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" Jun 05 10:51:32.731101 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.730960 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85tfk\" (UniqueName: \"kubernetes.io/projected/00c25a2c-4695-4f65-9f2a-ddaa12c6ee23-kube-api-access-85tfk\") pod \"monitoring-plugin-76b68cc874-jc4sd\" (UID: \"00c25a2c-4695-4f65-9f2a-ddaa12c6ee23\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" Jun 05 10:51:32.831492 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.831458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85tfk\" (UniqueName: \"kubernetes.io/projected/00c25a2c-4695-4f65-9f2a-ddaa12c6ee23-kube-api-access-85tfk\") pod \"monitoring-plugin-76b68cc874-jc4sd\" (UID: \"00c25a2c-4695-4f65-9f2a-ddaa12c6ee23\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" Jun 05 10:51:32.831672 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.831595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00c25a2c-4695-4f65-9f2a-ddaa12c6ee23-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-jc4sd\" (UID: \"00c25a2c-4695-4f65-9f2a-ddaa12c6ee23\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" Jun 05 10:51:32.834549 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.834524 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00c25a2c-4695-4f65-9f2a-ddaa12c6ee23-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-jc4sd\" (UID: \"00c25a2c-4695-4f65-9f2a-ddaa12c6ee23\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" Jun 05 10:51:32.839287 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.839261 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85tfk\" (UniqueName: \"kubernetes.io/projected/00c25a2c-4695-4f65-9f2a-ddaa12c6ee23-kube-api-access-85tfk\") pod \"monitoring-plugin-76b68cc874-jc4sd\" (UID: \"00c25a2c-4695-4f65-9f2a-ddaa12c6ee23\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" Jun 05 10:51:32.936938 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:32.936869 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" Jun 05 10:51:33.144746 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:33.144721 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd"] Jun 05 10:51:33.148013 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:33.147986 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c25a2c_4695_4f65_9f2a_ddaa12c6ee23.slice/crio-d3f5e00218156f15f7136bb96bd2063b3d3d44a54fc983deae956d38610912e1 WatchSource:0}: Error finding container d3f5e00218156f15f7136bb96bd2063b3d3d44a54fc983deae956d38610912e1: Status 404 returned error can't find the container with id d3f5e00218156f15f7136bb96bd2063b3d3d44a54fc983deae956d38610912e1 Jun 05 10:51:33.470504 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:33.470404 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" event={"ID":"00c25a2c-4695-4f65-9f2a-ddaa12c6ee23","Type":"ContainerStarted","Data":"d3f5e00218156f15f7136bb96bd2063b3d3d44a54fc983deae956d38610912e1"} Jun 05 10:51:33.473069 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:33.473042 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" event={"ID":"eeedb931-d311-4378-8b29-a1eb5fa1a844","Type":"ContainerStarted","Data":"8c1646d3aec22c5ad90d40e5bb7c0ccdc53d428d131b2ae9ee675b233b687e53"} Jun 05 10:51:33.473222 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:33.473108 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" event={"ID":"eeedb931-d311-4378-8b29-a1eb5fa1a844","Type":"ContainerStarted","Data":"39792a24353f5e1a23a1b6cc7a6b40a487097dd525130c34641ee60ca628e6d1"} Jun 05 10:51:33.473222 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:33.473161 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" event={"ID":"eeedb931-d311-4378-8b29-a1eb5fa1a844","Type":"ContainerStarted","Data":"12d7486b6146196e501309095075ef839612581a488b8a9a4545ed92b502b97d"} Jun 05 10:51:33.473321 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:33.473227 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:33.495614 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:33.495575 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" podStartSLOduration=1.8842028320000002 podStartE2EDuration="4.495560925s" totalImagesPullingTime="2.611358093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:51:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:33.493403022 +0000 UTC m=+282.280850836" watchObservedRunningTime="2026-06-05 10:51:33.495560925 +0000 UTC m=+282.283008799" Jun 05 10:51:34.040271 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.040230 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 10:51:34.044688 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.044662 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.047677 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.047656 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 10:51:34.047830 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.047699 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 10:51:34.048048 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.047978 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 10:51:34.048048 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.048013 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 10:51:34.048264 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.048246 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 10:51:34.048327 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.048259 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9tjjk\"" Jun 05 10:51:34.048327 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.048297 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 10:51:34.048327 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.048303 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 10:51:34.049450 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.048678 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 10:51:34.049450 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.048690 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 10:51:34.049450 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.048966 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ccef4jinbnvm3\"" Jun 05 10:51:34.049450 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.049221 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 10:51:34.049450 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.049251 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 10:51:34.049719 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.049629 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 10:51:34.050078 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.049803 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 10:51:34.050078 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.049953 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 10:51:34.051580 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.051563 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 10:51:34.058263 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.057710 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 10:51:34.142764 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.142727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.142924 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.142799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n5tm\" (UniqueName: \"kubernetes.io/projected/45dcba37-aaed-4517-8993-4d7ec7fe063d-kube-api-access-8n5tm\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.142924 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.142881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.142924 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.142919 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143090 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.142949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45dcba37-aaed-4517-8993-4d7ec7fe063d-config-out\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143090 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45dcba37-aaed-4517-8993-4d7ec7fe063d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143090 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143451 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143597 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143597 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143706 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143609 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-config\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143706 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143706 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143684 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143846 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143846 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143757 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143846 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143846 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143823 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143996 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143996 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.143996 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.143938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-web-config\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245092 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245293 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-web-config\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245406 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n5tm\" (UniqueName: \"kubernetes.io/projected/45dcba37-aaed-4517-8993-4d7ec7fe063d-kube-api-access-8n5tm\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245463 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45dcba37-aaed-4517-8993-4d7ec7fe063d-config-out\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245515 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45dcba37-aaed-4517-8993-4d7ec7fe063d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-config\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.252618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245820 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.245869 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.246797 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.247374 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.247674 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.248333 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.248888 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.249303 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.249566 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.251785 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45dcba37-aaed-4517-8993-4d7ec7fe063d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.252270 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.253789 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.252989 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.254863 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.254827 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.255402 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.255379 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45dcba37-aaed-4517-8993-4d7ec7fe063d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.255891 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.255865 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-config\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.256812 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.256789 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45dcba37-aaed-4517-8993-4d7ec7fe063d-config-out\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.256992 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.256974 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n5tm\" (UniqueName: \"kubernetes.io/projected/45dcba37-aaed-4517-8993-4d7ec7fe063d-kube-api-access-8n5tm\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.257068 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.257003 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.257068 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.257048 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.257524 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.257487 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.258455 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.258439 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45dcba37-aaed-4517-8993-4d7ec7fe063d-web-config\") pod \"prometheus-k8s-0\" (UID: \"45dcba37-aaed-4517-8993-4d7ec7fe063d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.356779 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.356699 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:34.657829 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:34.657803 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 10:51:34.661064 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:34.661037 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45dcba37_aaed_4517_8993_4d7ec7fe063d.slice/crio-a2f8c4933e43ebbbbde875ae77414d9237c3274d62bd044bd9af96e9e777a871 WatchSource:0}: Error finding container a2f8c4933e43ebbbbde875ae77414d9237c3274d62bd044bd9af96e9e777a871: Status 404 returned error can't find the container with id a2f8c4933e43ebbbbde875ae77414d9237c3274d62bd044bd9af96e9e777a871 Jun 05 10:51:35.482663 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.482603 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" event={"ID":"00c25a2c-4695-4f65-9f2a-ddaa12c6ee23","Type":"ContainerStarted","Data":"b8896574658102bf483c3120d27c111fa4e3e3f18362ec89fb0fbad678dec3b0"} Jun 05 10:51:35.482663 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.482652 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" Jun 05 10:51:35.484108 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.484078 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45dcba37-aaed-4517-8993-4d7ec7fe063d","Type":"ContainerStarted","Data":"a2f8c4933e43ebbbbde875ae77414d9237c3274d62bd044bd9af96e9e777a871"} Jun 05 10:51:35.487483 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.487462 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" Jun 05 10:51:35.500662 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.500522 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-jc4sd" podStartSLOduration=2.07801081 podStartE2EDuration="3.500504275s" totalImagesPullingTime="1.422493465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:35.495828293 +0000 UTC m=+284.283276109" watchObservedRunningTime="2026-06-05 10:51:35.500504275 +0000 UTC m=+284.287952093" Jun 05 10:51:35.657563 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.657538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:51:35.657665 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.657589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:51:35.659740 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.659711 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/767b7136-2858-4788-8ddb-6ccf5300b835-metrics-tls\") pod \"dns-default-mh4n9\" (UID: \"767b7136-2858-4788-8ddb-6ccf5300b835\") " pod="openshift-dns/dns-default-mh4n9" Jun 05 10:51:35.659845 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.659791 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"image-registry-f5886c84b-hsh6b\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:51:35.764488 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.764465 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ggptq\"" Jun 05 10:51:35.764602 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.764514 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42v48\"" Jun 05 10:51:35.772708 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.772689 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:51:35.772827 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.772776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mh4n9" Jun 05 10:51:35.928500 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.928477 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f5886c84b-hsh6b"] Jun 05 10:51:35.930042 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:35.930013 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac2483d_5e71_4080_a380_6712ff6dd22a.slice/crio-22f7e031d47912f02c2d67e351ddc630fea5573d68eb9249a8e0e7b367a0aeb7 WatchSource:0}: Error finding container 22f7e031d47912f02c2d67e351ddc630fea5573d68eb9249a8e0e7b367a0aeb7: Status 404 returned error can't find the container with id 22f7e031d47912f02c2d67e351ddc630fea5573d68eb9249a8e0e7b367a0aeb7 Jun 05 10:51:35.943504 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:35.943486 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mh4n9"] Jun 05 10:51:35.945839 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:51:35.945815 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767b7136_2858_4788_8ddb_6ccf5300b835.slice/crio-ea8fd9cf1fa25142b3e8f3151d3a8b1f3bde2b10941b9e4727ec19c8889049ae WatchSource:0}: Error finding container ea8fd9cf1fa25142b3e8f3151d3a8b1f3bde2b10941b9e4727ec19c8889049ae: Status 404 returned error can't find the container with id ea8fd9cf1fa25142b3e8f3151d3a8b1f3bde2b10941b9e4727ec19c8889049ae Jun 05 10:51:36.490640 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:36.490517 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" event={"ID":"9ac2483d-5e71-4080-a380-6712ff6dd22a","Type":"ContainerStarted","Data":"34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d"} Jun 05 10:51:36.490640 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:36.490588 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:51:36.490640 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:36.490610 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" event={"ID":"9ac2483d-5e71-4080-a380-6712ff6dd22a","Type":"ContainerStarted","Data":"22f7e031d47912f02c2d67e351ddc630fea5573d68eb9249a8e0e7b367a0aeb7"} Jun 05 10:51:36.492205 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:36.492180 2580 generic.go:356] "Generic (PLEG): container finished" podID="45dcba37-aaed-4517-8993-4d7ec7fe063d" containerID="f91ac87a4bc09a9de97762f30fbfe8257a934501301556857b4f449a6d7c0208" exitCode=0 Jun 05 10:51:36.492312 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:36.492271 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45dcba37-aaed-4517-8993-4d7ec7fe063d","Type":"ContainerDied","Data":"f91ac87a4bc09a9de97762f30fbfe8257a934501301556857b4f449a6d7c0208"} Jun 05 10:51:36.493457 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:36.493431 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mh4n9" event={"ID":"767b7136-2858-4788-8ddb-6ccf5300b835","Type":"ContainerStarted","Data":"ea8fd9cf1fa25142b3e8f3151d3a8b1f3bde2b10941b9e4727ec19c8889049ae"} Jun 05 10:51:36.511740 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:36.511694 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" podStartSLOduration=284.511679488 podStartE2EDuration="4m44.511679488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:36.509378369 +0000 UTC m=+285.296826182" watchObservedRunningTime="2026-06-05 10:51:36.511679488 +0000 UTC m=+285.299127300" Jun 05 10:51:38.504897 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:38.504857 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mh4n9" event={"ID":"767b7136-2858-4788-8ddb-6ccf5300b835","Type":"ContainerStarted","Data":"9d724e40d9927aebdb9db11d95b1ed488a2cf432a34b99ba0d3e3db1b82e86b8"} Jun 05 10:51:38.505331 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:38.505037 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mh4n9" Jun 05 10:51:38.505331 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:38.505083 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mh4n9" event={"ID":"767b7136-2858-4788-8ddb-6ccf5300b835","Type":"ContainerStarted","Data":"d2c0acccaa954ab10536751a8387407be6d2e51614aff9761f9594184ea03ad2"} Jun 05 10:51:38.521998 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:38.521941 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mh4n9" podStartSLOduration=251.694354274 podStartE2EDuration="4m13.521922289s" totalImagesPullingTime="1.827568015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:38.520225236 +0000 UTC m=+287.307673050" watchObservedRunningTime="2026-06-05 10:51:38.521922289 +0000 UTC m=+287.309370097" Jun 05 10:51:39.485253 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:39.485230 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f9cb469b9-7hgbs" Jun 05 10:51:39.512615 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:39.512584 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45dcba37-aaed-4517-8993-4d7ec7fe063d","Type":"ContainerStarted","Data":"29fa83c6224ccbc029abfecd23be3d7551fd4472fa393d27da209a5b0435d4f9"} Jun 05 10:51:39.512965 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:39.512659 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45dcba37-aaed-4517-8993-4d7ec7fe063d","Type":"ContainerStarted","Data":"549c5fdfb052662a237d97c475f7c5d6e66a69bfbdf5ab272dae67962aee782e"} Jun 05 10:51:40.520341 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:40.520308 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45dcba37-aaed-4517-8993-4d7ec7fe063d","Type":"ContainerStarted","Data":"0f5d6783837e0947d6548be1b15895d32addb5a241dce0fdffd81ef087b15cbc"} Jun 05 10:51:40.520694 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:40.520377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45dcba37-aaed-4517-8993-4d7ec7fe063d","Type":"ContainerStarted","Data":"6e52bfcccf530f3c5e284ad1a445ee415f86ec14b1031c098ecaad2fe84a23e9"} Jun 05 10:51:40.520694 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:40.520402 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45dcba37-aaed-4517-8993-4d7ec7fe063d","Type":"ContainerStarted","Data":"4548c0de141d465e06626df1ec337d8c91e921f8df69c6f700f1b9faf54d5b51"} Jun 05 10:51:40.520694 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:40.520425 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45dcba37-aaed-4517-8993-4d7ec7fe063d","Type":"ContainerStarted","Data":"5346eff819c3c246e6697cf7b9fc6bb51727a92f13b1cb3470a4fbe7be670e01"} Jun 05 10:51:40.549421 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:40.549368 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.790263231 podStartE2EDuration="6.549349468s" totalImagesPullingTime="3.741536466s" totalInitContainerRuntime="17.549771ms" isStatefulPod=false podCreationTimestamp="2026-06-05 10:51:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:51:40.546903418 +0000 UTC m=+289.334351231" watchObservedRunningTime="2026-06-05 10:51:40.549349468 +0000 UTC m=+289.336797279" Jun 05 10:51:44.357477 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:44.357437 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:51:48.516905 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:48.516873 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mh4n9" Jun 05 10:51:51.626442 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:51.626417 2580 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 10:51:55.777478 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:55.777447 2580 patch_prober.go:28] interesting pod/image-registry-f5886c84b-hsh6b container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 10:51:55.777961 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:55.777500 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" podUID="9ac2483d-5e71-4080-a380-6712ff6dd22a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 10:51:57.503573 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.503544 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:51:57.660782 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.660733 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-755c6d57df-4stvs" podUID="899b11e5-2617-4fb9-bf7a-cefd43d84532" containerName="console" containerID="cri-o://c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb" gracePeriod=15 Jun 05 10:51:57.900705 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.900680 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:57.951045 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.951009 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-oauth-config\") pod \"899b11e5-2617-4fb9-bf7a-cefd43d84532\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " Jun 05 10:51:57.951045 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.951045 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb69v\" (UniqueName: \"kubernetes.io/projected/899b11e5-2617-4fb9-bf7a-cefd43d84532-kube-api-access-jb69v\") pod \"899b11e5-2617-4fb9-bf7a-cefd43d84532\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " Jun 05 10:51:57.951305 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.951075 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-oauth-serving-cert\") pod \"899b11e5-2617-4fb9-bf7a-cefd43d84532\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " Jun 05 10:51:57.951305 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.951098 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-service-ca\") pod \"899b11e5-2617-4fb9-bf7a-cefd43d84532\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " Jun 05 10:51:57.951305 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.951137 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-config\") pod \"899b11e5-2617-4fb9-bf7a-cefd43d84532\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " Jun 05 10:51:57.951305 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.951226 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-serving-cert\") pod \"899b11e5-2617-4fb9-bf7a-cefd43d84532\" (UID: \"899b11e5-2617-4fb9-bf7a-cefd43d84532\") " Jun 05 10:51:57.951540 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.951503 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "899b11e5-2617-4fb9-bf7a-cefd43d84532" (UID: "899b11e5-2617-4fb9-bf7a-cefd43d84532"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 10:51:57.951540 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.951517 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-service-ca" (OuterVolumeSpecName: "service-ca") pod "899b11e5-2617-4fb9-bf7a-cefd43d84532" (UID: "899b11e5-2617-4fb9-bf7a-cefd43d84532"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 10:51:57.951698 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.951616 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-config" (OuterVolumeSpecName: "console-config") pod "899b11e5-2617-4fb9-bf7a-cefd43d84532" (UID: "899b11e5-2617-4fb9-bf7a-cefd43d84532"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 10:51:57.953518 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.953491 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "899b11e5-2617-4fb9-bf7a-cefd43d84532" (UID: "899b11e5-2617-4fb9-bf7a-cefd43d84532"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 10:51:57.953605 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.953529 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "899b11e5-2617-4fb9-bf7a-cefd43d84532" (UID: "899b11e5-2617-4fb9-bf7a-cefd43d84532"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 10:51:57.953605 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:57.953546 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899b11e5-2617-4fb9-bf7a-cefd43d84532-kube-api-access-jb69v" (OuterVolumeSpecName: "kube-api-access-jb69v") pod "899b11e5-2617-4fb9-bf7a-cefd43d84532" (UID: "899b11e5-2617-4fb9-bf7a-cefd43d84532"). InnerVolumeSpecName "kube-api-access-jb69v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 10:51:58.052463 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.052382 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-serving-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:51:58.052463 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.052409 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-oauth-config\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:51:58.052463 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.052421 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb69v\" (UniqueName: \"kubernetes.io/projected/899b11e5-2617-4fb9-bf7a-cefd43d84532-kube-api-access-jb69v\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:51:58.052463 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.052432 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-oauth-serving-cert\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:51:58.052463 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.052444 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-service-ca\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:51:58.052463 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.052455 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/899b11e5-2617-4fb9-bf7a-cefd43d84532-console-config\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:51:58.593662 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.593635 2580 generic.go:356] "Generic (PLEG): container finished" podID="b914a01a-b6dd-49ad-8aff-7fb0880e3e63" containerID="07f2dc64f3ad815d4e478ccb779ae27beb32beedbd6a10ea3f1edddcabec7f15" exitCode=0 Jun 05 10:51:58.593963 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.593703 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" event={"ID":"b914a01a-b6dd-49ad-8aff-7fb0880e3e63","Type":"ContainerDied","Data":"07f2dc64f3ad815d4e478ccb779ae27beb32beedbd6a10ea3f1edddcabec7f15"} Jun 05 10:51:58.594025 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.593993 2580 scope.go:117] "RemoveContainer" containerID="07f2dc64f3ad815d4e478ccb779ae27beb32beedbd6a10ea3f1edddcabec7f15" Jun 05 10:51:58.595056 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.595027 2580 generic.go:356] "Generic (PLEG): container finished" podID="899b11e5-2617-4fb9-bf7a-cefd43d84532" containerID="c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb" exitCode=0 Jun 05 10:51:58.595188 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.595060 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755c6d57df-4stvs" Jun 05 10:51:58.595188 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.595084 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755c6d57df-4stvs" event={"ID":"899b11e5-2617-4fb9-bf7a-cefd43d84532","Type":"ContainerDied","Data":"c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb"} Jun 05 10:51:58.595188 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.595118 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755c6d57df-4stvs" event={"ID":"899b11e5-2617-4fb9-bf7a-cefd43d84532","Type":"ContainerDied","Data":"db3519309152f449c68a2d8952431243825074b04a674d8a20ddd011122cd36a"} Jun 05 10:51:58.595188 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.595143 2580 scope.go:117] "RemoveContainer" containerID="c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb" Jun 05 10:51:58.629714 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.628644 2580 scope.go:117] "RemoveContainer" containerID="c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb" Jun 05 10:51:58.629786 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:51:58.629728 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb\": container with ID starting with c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb not found: ID does not exist" containerID="c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb" Jun 05 10:51:58.629827 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.629765 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb"} err="failed to get container status \"c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb\": rpc error: code = NotFound desc = could not find container \"c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb\": container with ID starting with c115725574d4889a781cbec022548404e1cf9c3f066f5ceaed0045f9c22fbedb not found: ID does not exist" Jun 05 10:51:58.655087 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.655063 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755c6d57df-4stvs"] Jun 05 10:51:58.658618 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:58.658598 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-755c6d57df-4stvs"] Jun 05 10:51:59.600896 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:59.600861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9v6m7" event={"ID":"b914a01a-b6dd-49ad-8aff-7fb0880e3e63","Type":"ContainerStarted","Data":"cb56c099275044e75cc6e555535a7ac7597b3a523dc3cb5853bc4cee2b7eeb82"} Jun 05 10:51:59.660568 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:51:59.660227 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="899b11e5-2617-4fb9-bf7a-cefd43d84532" path="/var/lib/kubelet/pods/899b11e5-2617-4fb9-bf7a-cefd43d84532/volumes" Jun 05 10:52:02.192828 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:02.192788 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f5886c84b-hsh6b"] Jun 05 10:52:09.642862 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:09.642826 2580 generic.go:356] "Generic (PLEG): container finished" podID="6ff9bf8c-fe4e-429e-bc75-670b0419ce27" containerID="e43326dac35a68d1b4a68e64f85561c2ae47ae4ec26c13fc55ba8ca70447e933" exitCode=0 Jun 05 10:52:09.643243 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:09.642887 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" event={"ID":"6ff9bf8c-fe4e-429e-bc75-670b0419ce27","Type":"ContainerDied","Data":"e43326dac35a68d1b4a68e64f85561c2ae47ae4ec26c13fc55ba8ca70447e933"} Jun 05 10:52:09.643291 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:09.643275 2580 scope.go:117] "RemoveContainer" containerID="e43326dac35a68d1b4a68e64f85561c2ae47ae4ec26c13fc55ba8ca70447e933" Jun 05 10:52:10.648605 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:10.648570 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ptkvq" event={"ID":"6ff9bf8c-fe4e-429e-bc75-670b0419ce27","Type":"ContainerStarted","Data":"d226305691bf2037fa8ef6b9734bdcc171a81e6d8540b98bdef9194a730620da"} Jun 05 10:52:27.214287 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:27.214249 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" podUID="9ac2483d-5e71-4080-a380-6712ff6dd22a" containerName="registry" containerID="cri-o://34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d" gracePeriod=30 Jun 05 10:52:27.499780 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:27.499700 2580 patch_prober.go:28] interesting pod/image-registry-f5886c84b-hsh6b container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jun 05 10:52:27.499780 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:27.499762 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" podUID="9ac2483d-5e71-4080-a380-6712ff6dd22a" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jun 05 10:52:28.449391 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.449358 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:52:28.617210 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.617077 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") pod \"9ac2483d-5e71-4080-a380-6712ff6dd22a\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " Jun 05 10:52:28.617210 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.617133 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-bound-sa-token\") pod \"9ac2483d-5e71-4080-a380-6712ff6dd22a\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " Jun 05 10:52:28.617210 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.617152 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-installation-pull-secrets\") pod \"9ac2483d-5e71-4080-a380-6712ff6dd22a\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " Jun 05 10:52:28.617210 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.617210 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm5nm\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-kube-api-access-xm5nm\") pod \"9ac2483d-5e71-4080-a380-6712ff6dd22a\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " Jun 05 10:52:28.617517 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.617243 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-trusted-ca\") pod \"9ac2483d-5e71-4080-a380-6712ff6dd22a\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " Jun 05 10:52:28.617517 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.617303 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac2483d-5e71-4080-a380-6712ff6dd22a-ca-trust-extracted\") pod \"9ac2483d-5e71-4080-a380-6712ff6dd22a\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " Jun 05 10:52:28.617517 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.617328 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-image-registry-private-configuration\") pod \"9ac2483d-5e71-4080-a380-6712ff6dd22a\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " Jun 05 10:52:28.617517 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.617353 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-certificates\") pod \"9ac2483d-5e71-4080-a380-6712ff6dd22a\" (UID: \"9ac2483d-5e71-4080-a380-6712ff6dd22a\") " Jun 05 10:52:28.617905 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.617873 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9ac2483d-5e71-4080-a380-6712ff6dd22a" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 10:52:28.618187 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.618054 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9ac2483d-5e71-4080-a380-6712ff6dd22a" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 10:52:28.619832 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.619787 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9ac2483d-5e71-4080-a380-6712ff6dd22a" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 10:52:28.619832 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.619794 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9ac2483d-5e71-4080-a380-6712ff6dd22a" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 10:52:28.620013 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.619970 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-kube-api-access-xm5nm" (OuterVolumeSpecName: "kube-api-access-xm5nm") pod "9ac2483d-5e71-4080-a380-6712ff6dd22a" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a"). InnerVolumeSpecName "kube-api-access-xm5nm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 10:52:28.620013 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.620002 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9ac2483d-5e71-4080-a380-6712ff6dd22a" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 10:52:28.620371 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.620353 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9ac2483d-5e71-4080-a380-6712ff6dd22a" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 10:52:28.625571 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.625546 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ac2483d-5e71-4080-a380-6712ff6dd22a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9ac2483d-5e71-4080-a380-6712ff6dd22a" (UID: "9ac2483d-5e71-4080-a380-6712ff6dd22a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 10:52:28.718124 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.718089 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-image-registry-private-configuration\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:52:28.718124 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.718117 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-certificates\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:52:28.718124 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.718127 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-registry-tls\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:52:28.718124 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.718135 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-bound-sa-token\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:52:28.718397 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.718143 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac2483d-5e71-4080-a380-6712ff6dd22a-installation-pull-secrets\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:52:28.718397 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.718150 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm5nm\" (UniqueName: \"kubernetes.io/projected/9ac2483d-5e71-4080-a380-6712ff6dd22a-kube-api-access-xm5nm\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:52:28.718397 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.718158 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac2483d-5e71-4080-a380-6712ff6dd22a-trusted-ca\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:52:28.718397 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.718179 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac2483d-5e71-4080-a380-6712ff6dd22a-ca-trust-extracted\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 10:52:28.722371 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.722342 2580 generic.go:356] "Generic (PLEG): container finished" podID="9ac2483d-5e71-4080-a380-6712ff6dd22a" containerID="34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d" exitCode=0 Jun 05 10:52:28.722503 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.722386 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" Jun 05 10:52:28.722503 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.722432 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" event={"ID":"9ac2483d-5e71-4080-a380-6712ff6dd22a","Type":"ContainerDied","Data":"34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d"} Jun 05 10:52:28.722503 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.722489 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5886c84b-hsh6b" event={"ID":"9ac2483d-5e71-4080-a380-6712ff6dd22a","Type":"ContainerDied","Data":"22f7e031d47912f02c2d67e351ddc630fea5573d68eb9249a8e0e7b367a0aeb7"} Jun 05 10:52:28.722668 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.722515 2580 scope.go:117] "RemoveContainer" containerID="34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d" Jun 05 10:52:28.730992 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.730977 2580 scope.go:117] "RemoveContainer" containerID="34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d" Jun 05 10:52:28.731260 ip-10-0-138-107 kubenswrapper[2580]: E0605 10:52:28.731244 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d\": container with ID starting with 34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d not found: ID does not exist" containerID="34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d" Jun 05 10:52:28.731327 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.731270 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d"} err="failed to get container status \"34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d\": rpc error: code = NotFound desc = could not find container \"34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d\": container with ID starting with 34909b8f2a0724e56b832a83c13ec22193a66533e8ec4e8a9abe13821fd0758d not found: ID does not exist" Jun 05 10:52:28.742687 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.742662 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f5886c84b-hsh6b"] Jun 05 10:52:28.745867 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:28.745847 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f5886c84b-hsh6b"] Jun 05 10:52:29.653425 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:29.653386 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ac2483d-5e71-4080-a380-6712ff6dd22a" path="/var/lib/kubelet/pods/9ac2483d-5e71-4080-a380-6712ff6dd22a/volumes" Jun 05 10:52:34.356899 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:34.356841 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:52:34.373315 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:34.373288 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:52:34.760343 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:52:34.760310 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 10:57:49.488089 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.488057 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5"] Jun 05 10:57:49.488514 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.488363 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ac2483d-5e71-4080-a380-6712ff6dd22a" containerName="registry" Jun 05 10:57:49.488514 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.488374 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ac2483d-5e71-4080-a380-6712ff6dd22a" containerName="registry" Jun 05 10:57:49.488514 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.488384 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899b11e5-2617-4fb9-bf7a-cefd43d84532" containerName="console" Jun 05 10:57:49.488514 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.488390 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="899b11e5-2617-4fb9-bf7a-cefd43d84532" containerName="console" Jun 05 10:57:49.488514 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.488469 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="899b11e5-2617-4fb9-bf7a-cefd43d84532" containerName="console" Jun 05 10:57:49.488514 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.488477 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ac2483d-5e71-4080-a380-6712ff6dd22a" containerName="registry" Jun 05 10:57:49.491515 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.491498 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:49.493975 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.493949 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 05 10:57:49.494110 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.493977 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 05 10:57:49.494110 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.493980 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-zrstc\"" Jun 05 10:57:49.494821 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.494805 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 10:57:49.494886 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.494822 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 10:57:49.502934 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.502913 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5"] Jun 05 10:57:49.583078 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.583034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws7gm\" (UniqueName: \"kubernetes.io/projected/675fa654-d03f-404d-975b-f64e7dca7004-kube-api-access-ws7gm\") pod \"kubeflow-trainer-controller-manager-857f77d56c-tfpp5\" (UID: \"675fa654-d03f-404d-975b-f64e7dca7004\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:49.583290 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.583120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/675fa654-d03f-404d-975b-f64e7dca7004-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-tfpp5\" (UID: \"675fa654-d03f-404d-975b-f64e7dca7004\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:49.583290 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.583151 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/675fa654-d03f-404d-975b-f64e7dca7004-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-tfpp5\" (UID: \"675fa654-d03f-404d-975b-f64e7dca7004\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:49.684555 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.684523 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/675fa654-d03f-404d-975b-f64e7dca7004-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-tfpp5\" (UID: \"675fa654-d03f-404d-975b-f64e7dca7004\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:49.684710 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.684569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/675fa654-d03f-404d-975b-f64e7dca7004-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-tfpp5\" (UID: \"675fa654-d03f-404d-975b-f64e7dca7004\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:49.684710 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.684605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws7gm\" (UniqueName: \"kubernetes.io/projected/675fa654-d03f-404d-975b-f64e7dca7004-kube-api-access-ws7gm\") pod \"kubeflow-trainer-controller-manager-857f77d56c-tfpp5\" (UID: \"675fa654-d03f-404d-975b-f64e7dca7004\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:49.685265 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.685238 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/675fa654-d03f-404d-975b-f64e7dca7004-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-tfpp5\" (UID: \"675fa654-d03f-404d-975b-f64e7dca7004\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:49.687045 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.687026 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/675fa654-d03f-404d-975b-f64e7dca7004-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-tfpp5\" (UID: \"675fa654-d03f-404d-975b-f64e7dca7004\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:49.692730 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.692707 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws7gm\" (UniqueName: \"kubernetes.io/projected/675fa654-d03f-404d-975b-f64e7dca7004-kube-api-access-ws7gm\") pod \"kubeflow-trainer-controller-manager-857f77d56c-tfpp5\" (UID: \"675fa654-d03f-404d-975b-f64e7dca7004\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:49.808116 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.808087 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:49.935415 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.935388 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5"] Jun 05 10:57:49.938117 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:57:49.938093 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod675fa654_d03f_404d_975b_f64e7dca7004.slice/crio-72fccd0dbc7f57370c015396fff673ace6d2e37c762428c56b1ce7cfeb278e24 WatchSource:0}: Error finding container 72fccd0dbc7f57370c015396fff673ace6d2e37c762428c56b1ce7cfeb278e24: Status 404 returned error can't find the container with id 72fccd0dbc7f57370c015396fff673ace6d2e37c762428c56b1ce7cfeb278e24 Jun 05 10:57:49.939937 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:49.939923 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 10:57:50.943526 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:50.943485 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" event={"ID":"675fa654-d03f-404d-975b-f64e7dca7004","Type":"ContainerStarted","Data":"72fccd0dbc7f57370c015396fff673ace6d2e37c762428c56b1ce7cfeb278e24"} Jun 05 10:57:52.953810 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:52.953780 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" event={"ID":"675fa654-d03f-404d-975b-f64e7dca7004","Type":"ContainerStarted","Data":"9ad7c9d7fa76f05dac01c88b5b91aa9ace4e792b928ecda9e683b1774369a5f1"} Jun 05 10:57:52.954222 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:52.953889 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:57:52.968130 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:57:52.967992 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" podStartSLOduration=1.68105556 podStartE2EDuration="3.967975992s" totalImagesPullingTime="2.286920432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 10:57:52.967547765 +0000 UTC m=+661.754995573" watchObservedRunningTime="2026-06-05 10:57:52.967975992 +0000 UTC m=+661.755423806" Jun 05 10:58:08.962962 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:58:08.962928 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-tfpp5" Jun 05 10:59:47.023421 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:47.023382 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs"] Jun 05 10:59:47.026584 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:47.026567 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" Jun 05 10:59:47.029263 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:47.029233 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-dqhpr\"/\"default-dockercfg-b5mn6\"" Jun 05 10:59:47.029263 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:47.029258 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dqhpr\"/\"kube-root-ca.crt\"" Jun 05 10:59:47.030042 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:47.030023 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-dqhpr\"/\"openshift-service-ca.crt\"" Jun 05 10:59:47.072680 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:47.072651 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs"] Jun 05 10:59:47.077406 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:47.077377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cwl9\" (UniqueName: \"kubernetes.io/projected/e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5-kube-api-access-9cwl9\") pod \"test-trainjob-jml7z-node-0-0-7jdbs\" (UID: \"e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5\") " pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" Jun 05 10:59:47.177993 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:47.177956 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cwl9\" (UniqueName: \"kubernetes.io/projected/e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5-kube-api-access-9cwl9\") pod \"test-trainjob-jml7z-node-0-0-7jdbs\" (UID: \"e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5\") " pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" Jun 05 10:59:47.187010 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:47.186978 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cwl9\" (UniqueName: \"kubernetes.io/projected/e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5-kube-api-access-9cwl9\") pod \"test-trainjob-jml7z-node-0-0-7jdbs\" (UID: \"e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5\") " pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" Jun 05 10:59:47.335360 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:47.335260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" Jun 05 10:59:47.461520 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:47.461498 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs"] Jun 05 10:59:47.463732 ip-10-0-138-107 kubenswrapper[2580]: W0605 10:59:47.463703 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4f85a1f_0a10_4f8b_82a1_58f2ccd55af5.slice/crio-3b1a56fc62c76c3fba6b672bd8092deaa343e8ae48abac7fd6adbb4cf2f1e51b WatchSource:0}: Error finding container 3b1a56fc62c76c3fba6b672bd8092deaa343e8ae48abac7fd6adbb4cf2f1e51b: Status 404 returned error can't find the container with id 3b1a56fc62c76c3fba6b672bd8092deaa343e8ae48abac7fd6adbb4cf2f1e51b Jun 05 10:59:48.410891 ip-10-0-138-107 kubenswrapper[2580]: I0605 10:59:48.410814 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" event={"ID":"e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5","Type":"ContainerStarted","Data":"3b1a56fc62c76c3fba6b672bd8092deaa343e8ae48abac7fd6adbb4cf2f1e51b"} Jun 05 11:00:59.759524 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:00:59.759489 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" event={"ID":"e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5","Type":"ContainerStarted","Data":"f5f4016d0d7a4975c6b668e485dede719ef42dfc182543d3e54d1b4487c764ab"} Jun 05 11:00:59.774701 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:00:59.774652 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" podStartSLOduration=1.617015673 podStartE2EDuration="1m13.774637837s" totalImagesPullingTime="1m12.157622164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 10:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:00:59.77304199 +0000 UTC m=+848.560489807" watchObservedRunningTime="2026-06-05 11:00:59.774637837 +0000 UTC m=+848.562085650" Jun 05 11:01:01.863633 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:01.863606 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dqhpr_test-trainjob-jml7z-node-0-0-7jdbs_e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5/node/0.log" Jun 05 11:01:02.773675 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:02.773640 2580 generic.go:356] "Generic (PLEG): container finished" podID="e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5" containerID="f5f4016d0d7a4975c6b668e485dede719ef42dfc182543d3e54d1b4487c764ab" exitCode=0 Jun 05 11:01:02.773846 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:02.773714 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" event={"ID":"e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5","Type":"ContainerDied","Data":"f5f4016d0d7a4975c6b668e485dede719ef42dfc182543d3e54d1b4487c764ab"} Jun 05 11:01:03.930688 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:03.930656 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" Jun 05 11:01:04.078386 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:04.078293 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cwl9\" (UniqueName: \"kubernetes.io/projected/e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5-kube-api-access-9cwl9\") pod \"e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5\" (UID: \"e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5\") " Jun 05 11:01:04.080673 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:04.080639 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5-kube-api-access-9cwl9" (OuterVolumeSpecName: "kube-api-access-9cwl9") pod "e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5" (UID: "e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5"). InnerVolumeSpecName "kube-api-access-9cwl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:01:04.179218 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:04.179185 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cwl9\" (UniqueName: \"kubernetes.io/projected/e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5-kube-api-access-9cwl9\") on node \"ip-10-0-138-107.ec2.internal\" DevicePath \"\"" Jun 05 11:01:04.783734 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:04.783695 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" event={"ID":"e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5","Type":"ContainerDied","Data":"3b1a56fc62c76c3fba6b672bd8092deaa343e8ae48abac7fd6adbb4cf2f1e51b"} Jun 05 11:01:04.783734 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:04.783740 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b1a56fc62c76c3fba6b672bd8092deaa343e8ae48abac7fd6adbb4cf2f1e51b" Jun 05 11:01:04.784051 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:04.783707 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs" Jun 05 11:01:04.866944 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:04.866919 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dqhpr_test-trainjob-jml7z-node-0-0-7jdbs_e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5/node/0.log" Jun 05 11:01:05.220497 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:05.220424 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-dqhpr_test-trainjob-jml7z-node-0-0-7jdbs_e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5/node/0.log" Jun 05 11:01:10.247339 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:10.247300 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs"] Jun 05 11:01:10.251282 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:10.251259 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-dqhpr/test-trainjob-jml7z-node-0-0-7jdbs"] Jun 05 11:01:11.653187 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:11.653147 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5" path="/var/lib/kubelet/pods/e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5/volumes" Jun 05 11:01:22.529566 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:22.529532 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-tfpp5_675fa654-d03f-404d-975b-f64e7dca7004/manager/0.log" Jun 05 11:01:22.973090 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:22.973003 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-tfpp5_675fa654-d03f-404d-975b-f64e7dca7004/manager/0.log" Jun 05 11:01:23.420575 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:23.420546 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-tfpp5_675fa654-d03f-404d-975b-f64e7dca7004/manager/0.log" Jun 05 11:01:59.450879 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.450834 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-54nwg/must-gather-g7tdp"] Jun 05 11:01:59.451346 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.451179 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5" containerName="node" Jun 05 11:01:59.451346 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.451190 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5" containerName="node" Jun 05 11:01:59.451346 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.451244 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4f85a1f-0a10-4f8b-82a1-58f2ccd55af5" containerName="node" Jun 05 11:01:59.453284 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.453264 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54nwg/must-gather-g7tdp" Jun 05 11:01:59.456074 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.456055 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-54nwg\"/\"default-dockercfg-4tfvq\"" Jun 05 11:01:59.456744 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.456725 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-54nwg\"/\"openshift-service-ca.crt\"" Jun 05 11:01:59.456744 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.456736 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-54nwg\"/\"kube-root-ca.crt\"" Jun 05 11:01:59.462266 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.462246 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-54nwg/must-gather-g7tdp"] Jun 05 11:01:59.543537 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.543501 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3f82d8fb-57ce-4c3d-9156-d20f9b9ac605-must-gather-output\") pod \"must-gather-g7tdp\" (UID: \"3f82d8fb-57ce-4c3d-9156-d20f9b9ac605\") " pod="openshift-must-gather-54nwg/must-gather-g7tdp" Jun 05 11:01:59.543537 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.543538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbhxc\" (UniqueName: \"kubernetes.io/projected/3f82d8fb-57ce-4c3d-9156-d20f9b9ac605-kube-api-access-sbhxc\") pod \"must-gather-g7tdp\" (UID: \"3f82d8fb-57ce-4c3d-9156-d20f9b9ac605\") " pod="openshift-must-gather-54nwg/must-gather-g7tdp" Jun 05 11:01:59.644999 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.644958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3f82d8fb-57ce-4c3d-9156-d20f9b9ac605-must-gather-output\") pod \"must-gather-g7tdp\" (UID: \"3f82d8fb-57ce-4c3d-9156-d20f9b9ac605\") " pod="openshift-must-gather-54nwg/must-gather-g7tdp" Jun 05 11:01:59.644999 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.644996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbhxc\" (UniqueName: \"kubernetes.io/projected/3f82d8fb-57ce-4c3d-9156-d20f9b9ac605-kube-api-access-sbhxc\") pod \"must-gather-g7tdp\" (UID: \"3f82d8fb-57ce-4c3d-9156-d20f9b9ac605\") " pod="openshift-must-gather-54nwg/must-gather-g7tdp" Jun 05 11:01:59.645320 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.645299 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3f82d8fb-57ce-4c3d-9156-d20f9b9ac605-must-gather-output\") pod \"must-gather-g7tdp\" (UID: \"3f82d8fb-57ce-4c3d-9156-d20f9b9ac605\") " pod="openshift-must-gather-54nwg/must-gather-g7tdp" Jun 05 11:01:59.653618 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.653590 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbhxc\" (UniqueName: \"kubernetes.io/projected/3f82d8fb-57ce-4c3d-9156-d20f9b9ac605-kube-api-access-sbhxc\") pod \"must-gather-g7tdp\" (UID: \"3f82d8fb-57ce-4c3d-9156-d20f9b9ac605\") " pod="openshift-must-gather-54nwg/must-gather-g7tdp" Jun 05 11:01:59.762614 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.762582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54nwg/must-gather-g7tdp" Jun 05 11:01:59.889299 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:01:59.889217 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-54nwg/must-gather-g7tdp"] Jun 05 11:01:59.891894 ip-10-0-138-107 kubenswrapper[2580]: W0605 11:01:59.891865 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f82d8fb_57ce_4c3d_9156_d20f9b9ac605.slice/crio-d66d4a94c5690cd49d8333ea1979c79de9d0c7c51b950de1f0c0cd6d8c7c903d WatchSource:0}: Error finding container d66d4a94c5690cd49d8333ea1979c79de9d0c7c51b950de1f0c0cd6d8c7c903d: Status 404 returned error can't find the container with id d66d4a94c5690cd49d8333ea1979c79de9d0c7c51b950de1f0c0cd6d8c7c903d Jun 05 11:02:00.009390 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:00.009350 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54nwg/must-gather-g7tdp" event={"ID":"3f82d8fb-57ce-4c3d-9156-d20f9b9ac605","Type":"ContainerStarted","Data":"d66d4a94c5690cd49d8333ea1979c79de9d0c7c51b950de1f0c0cd6d8c7c903d"} Jun 05 11:02:01.017231 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:01.017148 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54nwg/must-gather-g7tdp" event={"ID":"3f82d8fb-57ce-4c3d-9156-d20f9b9ac605","Type":"ContainerStarted","Data":"37445188e1439eebae1cf9ba3c0178f18eb3949073e5df2829b4ee364deaa24c"} Jun 05 11:02:02.025838 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:02.025789 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54nwg/must-gather-g7tdp" event={"ID":"3f82d8fb-57ce-4c3d-9156-d20f9b9ac605","Type":"ContainerStarted","Data":"59d40fcfdb169fc20d53f96fbd7e402685faa660915fe69ce220ea5dffc39fc5"} Jun 05 11:02:02.041471 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:02.041408 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-54nwg/must-gather-g7tdp" podStartSLOduration=2.062011307 podStartE2EDuration="3.041386571s" totalImagesPullingTime="979.375264ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:02:02.040503435 +0000 UTC m=+910.827951250" watchObservedRunningTime="2026-06-05 11:02:02.041386571 +0000 UTC m=+910.828834386" Jun 05 11:02:02.247007 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:02.246972 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lm5dk_bcdb32b6-c598-4833-9f6c-8bd52ecc232d/global-pull-secret-syncer/0.log" Jun 05 11:02:02.343778 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:02.343698 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qh698_641916f0-a44b-4d82-bdb9-188e363ca590/konnectivity-agent/0.log" Jun 05 11:02:02.414030 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:02.414003 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-107.ec2.internal_a0fd7eff5e644b9c4f6c4c8f52a7fb9a/haproxy/0.log" Jun 05 11:02:06.439795 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:06.439745 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-7nqtz_13016b13-c77b-4566-b7d6-20fedbe73ff2/cluster-monitoring-operator/0.log" Jun 05 11:02:06.586813 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:06.586641 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-jc4sd_00c25a2c-4695-4f65-9f2a-ddaa12c6ee23/monitoring-plugin/0.log" Jun 05 11:02:06.635458 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:06.635410 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4p685_06bb21c6-fc49-4cd2-a274-c3476391a307/node-exporter/0.log" Jun 05 11:02:06.659929 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:06.659831 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4p685_06bb21c6-fc49-4cd2-a274-c3476391a307/kube-rbac-proxy/0.log" Jun 05 11:02:06.688087 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:06.688061 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4p685_06bb21c6-fc49-4cd2-a274-c3476391a307/init-textfile/0.log" Jun 05 11:02:06.877539 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:06.877466 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wrwhc_d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5/kube-rbac-proxy-main/0.log" Jun 05 11:02:06.905633 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:06.905603 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wrwhc_d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5/kube-rbac-proxy-self/0.log" Jun 05 11:02:06.930863 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:06.930755 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wrwhc_d8972a8a-eaf3-4f5a-b7b5-15fbb4e8a2d5/openshift-state-metrics/0.log" Jun 05 11:02:06.975115 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:06.975084 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45dcba37-aaed-4517-8993-4d7ec7fe063d/prometheus/0.log" Jun 05 11:02:06.996691 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:06.996649 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45dcba37-aaed-4517-8993-4d7ec7fe063d/config-reloader/0.log" Jun 05 11:02:07.023327 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.023290 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45dcba37-aaed-4517-8993-4d7ec7fe063d/thanos-sidecar/0.log" Jun 05 11:02:07.048875 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.048786 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45dcba37-aaed-4517-8993-4d7ec7fe063d/kube-rbac-proxy-web/0.log" Jun 05 11:02:07.073055 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.073027 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45dcba37-aaed-4517-8993-4d7ec7fe063d/kube-rbac-proxy/0.log" Jun 05 11:02:07.102475 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.101742 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45dcba37-aaed-4517-8993-4d7ec7fe063d/kube-rbac-proxy-thanos/0.log" Jun 05 11:02:07.124721 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.124593 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45dcba37-aaed-4517-8993-4d7ec7fe063d/init-config-reloader/0.log" Jun 05 11:02:07.161035 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.160901 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-hmt65_c75dd63d-ff5c-4130-a7ac-6d09575c6cb4/prometheus-operator/0.log" Jun 05 11:02:07.183850 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.183781 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-hmt65_c75dd63d-ff5c-4130-a7ac-6d09575c6cb4/kube-rbac-proxy/0.log" Jun 05 11:02:07.319512 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.319444 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f9cb469b9-7hgbs_eeedb931-d311-4378-8b29-a1eb5fa1a844/thanos-query/0.log" Jun 05 11:02:07.343854 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.343822 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f9cb469b9-7hgbs_eeedb931-d311-4378-8b29-a1eb5fa1a844/kube-rbac-proxy-web/0.log" Jun 05 11:02:07.368448 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.368409 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f9cb469b9-7hgbs_eeedb931-d311-4378-8b29-a1eb5fa1a844/kube-rbac-proxy/0.log" Jun 05 11:02:07.393460 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.393422 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f9cb469b9-7hgbs_eeedb931-d311-4378-8b29-a1eb5fa1a844/prom-label-proxy/0.log" Jun 05 11:02:07.418530 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.418441 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f9cb469b9-7hgbs_eeedb931-d311-4378-8b29-a1eb5fa1a844/kube-rbac-proxy-rules/0.log" Jun 05 11:02:07.441815 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:07.441779 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f9cb469b9-7hgbs_eeedb931-d311-4378-8b29-a1eb5fa1a844/kube-rbac-proxy-metrics/0.log" Jun 05 11:02:10.189364 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.189325 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-wr94x_4587c133-6966-46d6-81c7-90b3b8956c4b/volume-data-source-validator/0.log" Jun 05 11:02:10.243136 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.243087 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l"] Jun 05 11:02:10.247111 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.247074 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.255874 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.255832 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l"] Jun 05 11:02:10.352633 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.352588 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-proc\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.352821 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.352645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-lib-modules\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.352821 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.352712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-podres\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.352821 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.352788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zll9v\" (UniqueName: \"kubernetes.io/projected/217586d1-e9e4-4c29-b894-672c687c4d36-kube-api-access-zll9v\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.352934 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.352848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-sys\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.454340 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.454248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-proc\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.454340 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.454300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-lib-modules\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.454340 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.454332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-podres\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.454632 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.454366 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-proc\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.454632 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.454378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zll9v\" (UniqueName: \"kubernetes.io/projected/217586d1-e9e4-4c29-b894-672c687c4d36-kube-api-access-zll9v\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.454632 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.454472 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-sys\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.454632 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.454605 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-sys\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.454906 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.454726 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-lib-modules\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.454906 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.454807 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/217586d1-e9e4-4c29-b894-672c687c4d36-podres\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.462123 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.462099 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zll9v\" (UniqueName: \"kubernetes.io/projected/217586d1-e9e4-4c29-b894-672c687c4d36-kube-api-access-zll9v\") pod \"perf-node-gather-daemonset-cqr8l\" (UID: \"217586d1-e9e4-4c29-b894-672c687c4d36\") " pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.566234 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.566199 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:10.728855 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:10.728764 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l"] Jun 05 11:02:11.081243 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:11.081198 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" event={"ID":"217586d1-e9e4-4c29-b894-672c687c4d36","Type":"ContainerStarted","Data":"dd800f235f221883dd30d09c9121af89f357c9b1ede3ec794899525e82b20f4b"} Jun 05 11:02:11.081427 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:11.081264 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" event={"ID":"217586d1-e9e4-4c29-b894-672c687c4d36","Type":"ContainerStarted","Data":"4d78a0c269fce78b58b69dd1084e64c41e76feda50ccaff5a2d004f91892adb9"} Jun 05 11:02:11.081427 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:11.081382 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:11.100141 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:11.100084 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" podStartSLOduration=1.100067994 podStartE2EDuration="1.100067994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:02:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:02:11.097974208 +0000 UTC m=+919.885422022" watchObservedRunningTime="2026-06-05 11:02:11.100067994 +0000 UTC m=+919.887515808" Jun 05 11:02:11.140731 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:11.140697 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mh4n9_767b7136-2858-4788-8ddb-6ccf5300b835/dns/0.log" Jun 05 11:02:11.162321 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:11.162296 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mh4n9_767b7136-2858-4788-8ddb-6ccf5300b835/kube-rbac-proxy/0.log" Jun 05 11:02:11.185312 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:11.185283 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4fz2m_3fc2b3f4-5d2e-4654-8748-770ab05d667b/dns-node-resolver/0.log" Jun 05 11:02:11.704001 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:11.703969 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lwdlg_79890b97-8df2-4cbf-9076-358cf6ca8e70/node-ca/0.log" Jun 05 11:02:12.398578 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:12.398547 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bc5f8d7d7-g4q9q_2005ddad-ae9b-4f45-b0e5-f6181daff90a/router/0.log" Jun 05 11:02:12.720978 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:12.720901 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5k57r_1468658a-02c9-4c80-a102-f338a490caf3/serve-healthcheck-canary/0.log" Jun 05 11:02:13.195492 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:13.195460 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmxf7_fab1fccb-56a6-4386-8611-0d496c5e8077/kube-rbac-proxy/0.log" Jun 05 11:02:13.216071 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:13.216041 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmxf7_fab1fccb-56a6-4386-8611-0d496c5e8077/exporter/0.log" Jun 05 11:02:13.238919 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:13.238889 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmxf7_fab1fccb-56a6-4386-8611-0d496c5e8077/extractor/0.log" Jun 05 11:02:17.099138 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:17.099097 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-54nwg/perf-node-gather-daemonset-cqr8l" Jun 05 11:02:17.993275 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:17.993247 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-8gnhr_47f99db4-d0bf-40e1-8ed6-22b2df1c687f/migrator/0.log" Jun 05 11:02:18.013726 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:18.013698 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-8gnhr_47f99db4-d0bf-40e1-8ed6-22b2df1c687f/graceful-termination/0.log" Jun 05 11:02:18.314402 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:18.314352 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-9v6m7_b914a01a-b6dd-49ad-8aff-7fb0880e3e63/kube-storage-version-migrator-operator/1.log" Jun 05 11:02:18.315524 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:18.315497 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-9v6m7_b914a01a-b6dd-49ad-8aff-7fb0880e3e63/kube-storage-version-migrator-operator/0.log" Jun 05 11:02:19.312484 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:19.312459 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54df8_e7871c10-514e-415d-ab43-518a6358a6db/kube-multus-additional-cni-plugins/0.log" Jun 05 11:02:19.336682 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:19.336652 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54df8_e7871c10-514e-415d-ab43-518a6358a6db/egress-router-binary-copy/0.log" Jun 05 11:02:19.359519 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:19.359489 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54df8_e7871c10-514e-415d-ab43-518a6358a6db/cni-plugins/0.log" Jun 05 11:02:19.380253 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:19.380187 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54df8_e7871c10-514e-415d-ab43-518a6358a6db/bond-cni-plugin/0.log" Jun 05 11:02:19.404610 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:19.404524 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54df8_e7871c10-514e-415d-ab43-518a6358a6db/routeoverride-cni/0.log" Jun 05 11:02:19.427860 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:19.427827 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54df8_e7871c10-514e-415d-ab43-518a6358a6db/whereabouts-cni-bincopy/0.log" Jun 05 11:02:19.452884 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:19.452853 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54df8_e7871c10-514e-415d-ab43-518a6358a6db/whereabouts-cni/0.log" Jun 05 11:02:19.868723 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:19.868583 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mrckg_2dc070cf-093c-4d58-a4f5-a2fd871a211b/kube-multus/0.log" Jun 05 11:02:20.019612 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:20.019541 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w5msc_8206f9d1-eeae-4107-8ec4-947a6f0f34a2/network-metrics-daemon/0.log" Jun 05 11:02:20.039509 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:20.039480 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w5msc_8206f9d1-eeae-4107-8ec4-947a6f0f34a2/kube-rbac-proxy/0.log" Jun 05 11:02:20.739670 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:20.739641 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ghh4r_f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c/ovn-controller/0.log" Jun 05 11:02:20.758830 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:20.758801 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ghh4r_f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c/ovn-acl-logging/0.log" Jun 05 11:02:20.785995 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:20.785966 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ghh4r_f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c/kube-rbac-proxy-node/0.log" Jun 05 11:02:20.810568 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:20.810532 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ghh4r_f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 11:02:20.828344 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:20.828314 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ghh4r_f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c/northd/0.log" Jun 05 11:02:20.849395 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:20.849364 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ghh4r_f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c/nbdb/0.log" Jun 05 11:02:20.874884 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:20.874856 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ghh4r_f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c/sbdb/0.log" Jun 05 11:02:20.919511 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:20.919483 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ghh4r_f8f3bcdf-51bb-4e8a-9c4b-b224351abb8c/ovnkube-controller/0.log" Jun 05 11:02:22.298250 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:22.298219 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-fs92f_58ee4673-7463-4ebe-a6ea-c07e06748d08/check-endpoints/0.log" Jun 05 11:02:22.371209 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:22.371160 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xnbrx_6d815734-8fd9-4443-9343-79861f036e8f/network-check-target-container/0.log" Jun 05 11:02:23.241116 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:23.241089 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-knrgr_422e93d0-0b10-4483-9e12-5f57cfc85714/iptables-alerter/0.log" Jun 05 11:02:23.893927 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:23.893898 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-zd72w_aca12326-5f8f-4534-aaa1-6bc006550b18/tuned/0.log" Jun 05 11:02:26.498050 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:26.497962 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-ptkvq_6ff9bf8c-fe4e-429e-bc75-670b0419ce27/service-ca-operator/1.log" Jun 05 11:02:26.499286 ip-10-0-138-107 kubenswrapper[2580]: I0605 11:02:26.499245 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-ptkvq_6ff9bf8c-fe4e-429e-bc75-670b0419ce27/service-ca-operator/0.log"