Jun 04 23:51:35.420801 ip-10-0-128-106 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 04 23:51:35.420811 ip-10-0-128-106 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 04 23:51:35.420818 ip-10-0-128-106 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 04 23:51:35.420962 ip-10-0-128-106 systemd[1]: Failed to start Kubernetes Kubelet. Jun 04 23:51:46.553800 ip-10-0-128-106 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 04 23:51:46.553819 ip-10-0-128-106 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7a4ffbfff8b94fd199292fde156251fa -- Jun 04 23:54:31.197045 ip-10-0-128-106 systemd[1]: Starting Kubernetes Kubelet... Jun 04 23:54:31.657676 ip-10-0-128-106 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 04 23:54:31.657676 ip-10-0-128-106 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 04 23:54:31.657676 ip-10-0-128-106 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 04 23:54:31.657676 ip-10-0-128-106 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 04 23:54:31.657676 ip-10-0-128-106 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 04 23:54:31.659703 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.659590 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 04 23:54:31.666354 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666334 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:31.666354 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666353 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666357 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666360 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666365 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666376 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666380 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666383 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666386 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666389 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666391 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666394 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666397 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666400 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666404 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666407 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666410 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666413 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666416 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666418 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666421 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:31.666426 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666423 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666425 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666428 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666431 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666433 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666436 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666439 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666442 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666444 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666448 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666450 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666453 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666456 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666459 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666461 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666464 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666466 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666469 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666471 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666474 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:31.666921 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666476 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666479 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666481 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666484 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666486 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666489 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666491 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666494 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666497 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666500 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666502 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666504 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666507 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666510 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666513 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666515 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666518 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666521 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666524 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666527 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:31.667444 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666529 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666532 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666535 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666538 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666540 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666542 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666547 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666550 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666553 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666557 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666559 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666562 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666565 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666568 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666570 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666573 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666575 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666578 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666580 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:31.667945 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666584 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666587 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666590 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666593 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666598 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666600 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666604 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666607 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666609 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666623 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666626 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666629 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666632 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666634 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666637 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666639 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666642 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666645 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.666648 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667408 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:31.668388 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667415 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667418 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667421 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667424 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667426 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667429 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667431 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667434 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667437 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667440 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667442 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667445 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667448 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667451 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667453 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667456 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667459 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667462 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667465 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:31.668907 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667468 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667471 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667474 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667476 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667479 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667482 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667485 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667487 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667490 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667492 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667496 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667498 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667501 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667504 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667506 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667509 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667511 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667514 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667516 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667519 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:31.669730 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667521 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667541 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667544 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667548 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667552 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667555 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667558 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667560 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667563 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667566 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667569 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667573 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667577 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667580 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667583 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667586 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667589 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667591 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667594 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:31.670318 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667597 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667600 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667602 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667605 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667608 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667611 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667628 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667631 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667633 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667637 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667640 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667642 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667645 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667650 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667653 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667656 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667659 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667662 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667665 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:31.670806 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667667 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667670 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667672 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667675 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667678 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667680 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667684 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667687 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667689 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667693 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667696 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667699 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667702 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667705 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667707 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667710 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667713 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667715 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667718 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667721 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:31.671283 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.667723 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668104 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668109 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668112 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668116 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668120 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668123 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668126 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668129 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668132 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668134 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668137 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668139 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668143 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668145 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668148 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668150 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668153 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668156 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:31.671809 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668159 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668161 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668164 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668167 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668169 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668172 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668174 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668177 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668179 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668182 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668184 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668187 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668190 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668192 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668195 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668197 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668200 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668202 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668205 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668208 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:31.672282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668210 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668212 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668215 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668217 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668220 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668222 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668225 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668228 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668231 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668233 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668236 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668238 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668241 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668244 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668247 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668249 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668252 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668254 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668257 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668259 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:31.672796 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668262 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668264 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668267 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668269 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668272 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668275 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668277 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668279 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668282 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668285 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668288 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668290 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668293 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668295 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668298 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668300 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668302 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668305 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668307 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:31.673282 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668310 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668314 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668317 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668322 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668325 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668328 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668331 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668334 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668336 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668339 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668341 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668344 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668346 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668349 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668351 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668354 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668356 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668359 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668362 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:31.673770 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668364 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668367 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.668370 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668450 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668458 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668465 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668472 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668478 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668482 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668489 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668496 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668500 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668503 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668507 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668510 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668513 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668520 2580 flags.go:64] FLAG: --cgroup-root="" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668523 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668526 2580 flags.go:64] FLAG: --client-ca-file="" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668529 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668532 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668536 2580 flags.go:64] FLAG: --cluster-domain="" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668539 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668542 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 04 23:54:31.674248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668545 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668549 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668553 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668556 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668559 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668562 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668565 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668568 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668571 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668575 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668578 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668583 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668586 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668589 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668592 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668595 2580 flags.go:64] FLAG: --enable-server="true" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668598 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668603 2580 flags.go:64] FLAG: --event-burst="100" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668606 2580 flags.go:64] FLAG: --event-qps="50" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668609 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668626 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668629 2580 flags.go:64] FLAG: --eviction-hard="" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668634 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668636 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668641 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 04 23:54:31.674852 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668653 2580 flags.go:64] FLAG: --eviction-soft="" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668656 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668659 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668663 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668666 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668669 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668672 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668675 2580 flags.go:64] FLAG: --feature-gates="" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668679 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668682 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668685 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668688 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668691 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668694 2580 flags.go:64] FLAG: --help="false" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668697 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-128-106.ec2.internal" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668700 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668748 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668797 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668805 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668811 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668816 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668821 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668826 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 04 23:54:31.675453 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668831 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668836 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668848 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668854 2580 flags.go:64] FLAG: --kube-reserved="" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668962 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.668992 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669000 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669006 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669013 2580 flags.go:64] FLAG: --lock-file="" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669019 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669025 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669032 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669061 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669067 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669072 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669077 2580 flags.go:64] FLAG: --logging-format="text" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669083 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669089 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669094 2580 flags.go:64] FLAG: --manifest-url="" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669099 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669112 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669118 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669125 2580 flags.go:64] FLAG: --max-pods="110" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669131 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669135 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 04 23:54:31.676078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669140 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669146 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669151 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669156 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669166 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669179 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669186 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669191 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669196 2580 flags.go:64] FLAG: --pod-cidr="" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669201 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669211 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669222 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669229 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669235 2580 flags.go:64] FLAG: --port="10250" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669240 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669245 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07a744284b8699330" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669251 2580 flags.go:64] FLAG: --qos-reserved="" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669257 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669262 2580 flags.go:64] FLAG: --register-node="true" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669272 2580 flags.go:64] FLAG: --register-with-taints="" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669279 2580 flags.go:64] FLAG: --registry-burst="10" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669284 2580 flags.go:64] FLAG: --registry-qps="5" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669289 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669294 2580 flags.go:64] FLAG: --reserved-memory="" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669300 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 04 23:54:31.676801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669306 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669311 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669316 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669326 2580 flags.go:64] FLAG: --runonce="false" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669331 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669336 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669342 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669347 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669352 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669357 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669362 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669373 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669378 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669384 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669389 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669394 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669399 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669405 2580 flags.go:64] FLAG: --system-cgroups="" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669410 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669427 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669433 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669438 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669447 2580 flags.go:64] FLAG: --tls-min-version="" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669452 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669456 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 04 23:54:31.677452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669461 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669466 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669476 2580 flags.go:64] FLAG: --v="2" Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669483 2580 flags.go:64] FLAG: --version="false" Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669491 2580 flags.go:64] FLAG: --vmodule="" Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669498 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.669504 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670025 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670035 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670039 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670042 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670048 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670052 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670055 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670058 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670061 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670063 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670066 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670069 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670071 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670074 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:31.678092 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670077 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670079 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670082 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670085 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670087 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670090 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670093 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670095 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670099 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670105 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670110 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670113 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670116 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670119 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670122 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670125 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670128 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670130 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670133 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670136 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:31.678663 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670139 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670141 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670145 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670148 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670151 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670154 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670157 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670159 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670162 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670166 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670170 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670173 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670175 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670178 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670181 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670183 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670186 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670189 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670191 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:31.679161 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670194 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670198 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670201 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670204 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670207 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670209 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670212 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670214 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670217 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670220 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670222 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670225 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670228 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670230 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670233 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670237 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670240 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670242 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670245 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670248 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:31.679649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670250 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670253 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670256 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670259 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670262 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670264 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670267 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670269 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670272 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670275 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670277 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670280 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670282 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670285 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670289 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670291 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670294 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670297 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670301 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:31.680180 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670304 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670307 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670310 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670313 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670316 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670318 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.670321 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.670987 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.677806 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.677824 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.677846 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.677851 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677908 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677915 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677918 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:31.680668 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677921 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677924 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677927 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677930 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677933 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677936 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677939 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677942 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677944 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677947 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677949 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677952 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677955 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677957 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677960 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677963 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677965 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677968 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677972 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677974 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:31.681087 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677977 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677980 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677982 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677984 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677987 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677990 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677993 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677996 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.677998 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678001 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678003 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678006 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678008 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678011 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678014 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678016 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678019 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678022 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678024 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678027 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:31.681576 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678029 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678032 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678034 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678037 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678039 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678042 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678044 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678047 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678049 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678052 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678056 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678059 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678062 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678065 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678067 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678070 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678072 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678075 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678078 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:31.682083 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678080 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678083 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678085 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678088 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678090 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678093 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678096 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678098 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678101 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678105 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678108 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678111 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678113 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678116 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678119 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678121 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678124 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678126 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678129 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678131 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:31.682637 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678134 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678136 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678139 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678141 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678144 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678147 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678152 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678155 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678158 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678162 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678166 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678169 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678172 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678175 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678178 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678181 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:31.683155 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678184 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.678189 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678329 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678335 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678338 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678341 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678344 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678348 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678351 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678354 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678356 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678359 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678362 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678365 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678367 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:31.683611 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678370 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678372 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678375 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678378 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678380 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678383 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678385 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678388 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678391 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678394 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678396 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678399 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678401 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678404 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678406 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678409 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678412 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678414 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678417 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:31.684033 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678419 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678422 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678424 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678427 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678429 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678432 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678434 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678437 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678439 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678442 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678444 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678447 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678449 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678452 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678454 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678457 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678460 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678462 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678465 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678468 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:31.684518 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678470 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678473 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678476 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678478 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678481 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678485 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678488 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678491 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678494 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678497 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678500 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678503 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678506 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678508 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678511 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678514 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678516 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678519 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678521 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:31.685492 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678524 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678526 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678529 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678531 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678534 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678536 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678539 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678541 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678544 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678547 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678550 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678552 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678555 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678558 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678560 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678563 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678566 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678569 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678572 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678574 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:31.686035 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678576 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678579 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678582 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678584 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678587 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678589 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678593 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:31.678596 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.678600 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.678747 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.680805 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.682387 2580 server.go:1019] "Starting client certificate rotation" Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.682500 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 04 23:54:31.686744 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.682554 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 04 23:54:31.687199 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.685587 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 04 23:54:31.687199 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.686750 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 04 23:54:31.697227 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.697200 2580 log.go:25] "Validated CRI v1 runtime API" Jun 04 23:54:31.701966 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.701947 2580 log.go:25] "Validated CRI v1 image API" Jun 04 23:54:31.702784 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.702763 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 04 23:54:31.705803 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.705779 2580 fs.go:135] Filesystem UUIDs: map[4de1a147-894b-48d9-a407-e9d66cc99a8e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bc4b6508-e3a3-4eeb-9f7e-4932144b4be7:/dev/nvme0n1p3] Jun 04 23:54:31.705876 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.705802 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 04 23:54:31.712677 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.712535 2580 manager.go:216] Machine: {Timestamp:2026-06-04 23:54:31.711215506 +0000 UTC m=+0.377415342 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100085 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe23440bde0fe8afe7c46a545f541 SystemUUID:ec2fe234-40bd-e0fe-8afe-7c46a545f541 BootID:7a4ffbff-f8b9-4fd1-9929-2fde156251fa Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:31:56:91:5a:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:31:56:91:5a:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:c1:49:5f:62:2a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 04 23:54:31.712677 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.712660 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 04 23:54:31.712864 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.712824 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 04 23:54:31.713234 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.713216 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 04 23:54:31.716340 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.716313 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 04 23:54:31.716485 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.716344 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-106.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 04 23:54:31.717178 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.717168 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 04 23:54:31.717212 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.717181 2580 container_manager_linux.go:309] "Creating device plugin manager" Jun 04 23:54:31.717212 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.717189 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 04 23:54:31.718016 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.718004 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 04 23:54:31.718924 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.718914 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 04 23:54:31.721690 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.721678 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 04 23:54:31.721802 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.721793 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 04 23:54:31.721833 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.721824 2580 kubelet.go:486] "Attempting to sync node with API server" Jun 04 23:54:31.721864 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.721834 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 04 23:54:31.721864 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.721852 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 04 23:54:31.721864 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.721864 2580 kubelet.go:398] "Adding apiserver pod source" Jun 04 23:54:31.721938 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.721874 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 04 23:54:31.722537 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.722522 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 04 23:54:31.722675 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.722548 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 04 23:54:31.725275 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.725260 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 04 23:54:31.726732 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.726719 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 04 23:54:31.726784 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.726750 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 04 23:54:31.727809 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727798 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 04 23:54:31.727856 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727816 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 04 23:54:31.727856 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727822 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 04 23:54:31.727856 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727828 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 04 23:54:31.727856 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727837 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 04 23:54:31.727856 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727845 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 04 23:54:31.727856 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727856 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 04 23:54:31.728000 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727862 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 04 23:54:31.728000 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727869 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 04 23:54:31.728000 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727874 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 04 23:54:31.728000 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727888 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 04 23:54:31.728000 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.727894 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 04 23:54:31.728892 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.728881 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 04 23:54:31.728924 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.728894 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 04 23:54:31.731892 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.731874 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-whvtt" Jun 04 23:54:31.732351 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.732338 2580 server.go:1268] "Started kubelet" Jun 04 23:54:31.732672 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.732469 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 04 23:54:31.732743 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.732437 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 04 23:54:31.732743 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.732726 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 04 23:54:31.733095 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.733064 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 04 23:54:31.733161 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.733135 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 04 23:54:31.733293 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.733266 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 04 23:54:31.733406 ip-10-0-128-106 systemd[1]: Started Kubernetes Kubelet. Jun 04 23:54:31.735226 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.735212 2580 server.go:310] "Adding debug handlers to kubelet server" Jun 04 23:54:31.736882 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.736864 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-whvtt" Jun 04 23:54:31.737542 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.737524 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 04 23:54:31.739281 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.738045 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-106.ec2.internal.18b605f97a876220 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-106.ec2.internal,UID:ip-10-0-128-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-106.ec2.internal,},FirstTimestamp:2026-06-04 23:54:31.732298272 +0000 UTC m=+0.398498081,LastTimestamp:2026-06-04 23:54:31.732298272 +0000 UTC m=+0.398498081,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-106.ec2.internal,}" Jun 04 23:54:31.740410 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.740391 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 04 23:54:31.741744 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.741729 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 04 23:54:31.741837 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.741743 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 04 23:54:31.741837 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.741806 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:31.742345 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.742315 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 04 23:54:31.742345 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.742337 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 04 23:54:31.742503 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.742313 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 04 23:54:31.742592 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.742492 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 04 23:54:31.742592 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.742594 2580 reconciler.go:29] "Reconciler: start to sync state" Jun 04 23:54:31.743080 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.743064 2580 factory.go:55] Registering systemd factory Jun 04 23:54:31.743144 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.743102 2580 factory.go:223] Registration of the systemd container factory successfully Jun 04 23:54:31.743348 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.743330 2580 factory.go:153] Registering CRI-O factory Jun 04 23:54:31.743348 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.743351 2580 factory.go:223] Registration of the crio container factory successfully Jun 04 23:54:31.743458 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.743407 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 04 23:54:31.743458 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.743432 2580 factory.go:103] Registering Raw factory Jun 04 23:54:31.743458 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.743446 2580 manager.go:1196] Started watching for new ooms in manager Jun 04 23:54:31.747487 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.746001 2580 manager.go:349] Starting recovery of all containers Jun 04 23:54:31.747487 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.747094 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 04 23:54:31.752353 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.752325 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-106.ec2.internal\" not found" node="ip-10-0-128-106.ec2.internal" Jun 04 23:54:31.757235 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.757221 2580 manager.go:354] Recovery completed Jun 04 23:54:31.761662 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.761650 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:31.764801 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.764779 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:31.764908 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.764814 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:31.764908 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.764829 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:31.765359 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.765343 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 04 23:54:31.765359 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.765354 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:31.765482 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.765356 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 04 23:54:31.765482 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.765397 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 04 23:54:31.766466 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.766454 2580 policy_none.go:49] "None policy: Start" Jun 04 23:54:31.766514 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.766470 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 04 23:54:31.766514 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.766480 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 04 23:54:31.766668 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.766573 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:31.766668 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.766599 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:31.766668 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.766628 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:31.767483 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.767472 2580 policy_none.go:47] "Start" Jun 04 23:54:31.800423 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.800221 2580 manager.go:337] "Starting Device Plugin manager" Jun 04 23:54:31.813836 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.800467 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 04 23:54:31.813836 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.800479 2580 server.go:87] "Starting device plugin registration server" Jun 04 23:54:31.813836 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.800732 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 04 23:54:31.813836 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.800742 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 04 23:54:31.813836 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.800844 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 04 23:54:31.813836 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.800930 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 04 23:54:31.813836 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.800938 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 04 23:54:31.813836 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.801563 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 04 23:54:31.813836 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.801602 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:31.813836 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.812841 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 04 23:54:31.814320 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.814077 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 04 23:54:31.814320 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.814111 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 04 23:54:31.814320 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.814131 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jun 04 23:54:31.814320 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.814212 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 04 23:54:31.816435 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.816420 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 04 23:54:31.901294 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.901243 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:31.902232 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.902211 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:31.902321 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.902250 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:31.902321 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.902260 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:31.902321 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.902284 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-106.ec2.internal" Jun 04 23:54:31.908708 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.908665 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-106.ec2.internal" Jun 04 23:54:31.908708 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.908688 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-106.ec2.internal\": node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:31.914309 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.914288 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-106.ec2.internal"] Jun 04 23:54:31.914405 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.914347 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:31.915430 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.915414 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:31.915549 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.915444 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:31.915549 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.915454 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:31.916816 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.916803 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:31.916915 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.916901 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" Jun 04 23:54:31.916954 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.916941 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:31.917530 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.917515 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:31.917607 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.917515 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:31.917607 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.917543 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:31.917607 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.917553 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:31.917607 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.917558 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:31.917607 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.917568 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:31.918761 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.918743 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-106.ec2.internal" Jun 04 23:54:31.918868 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.918773 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:31.919476 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.919462 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:31.919542 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.919492 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:31.919542 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.919505 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:31.922300 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.922280 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:31.944279 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.944256 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/353c7dc21f59e18f3871260a1d811780-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal\" (UID: \"353c7dc21f59e18f3871260a1d811780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" Jun 04 23:54:31.944421 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.944283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/353c7dc21f59e18f3871260a1d811780-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal\" (UID: \"353c7dc21f59e18f3871260a1d811780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" Jun 04 23:54:31.944421 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:31.944301 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/465f1a8207a3957dd83ec2f235253e60-config\") pod \"kube-apiserver-proxy-ip-10-0-128-106.ec2.internal\" (UID: \"465f1a8207a3957dd83ec2f235253e60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-106.ec2.internal" Jun 04 23:54:31.944499 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.944424 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-106.ec2.internal\" not found" node="ip-10-0-128-106.ec2.internal" Jun 04 23:54:31.948919 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:31.948903 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-106.ec2.internal\" not found" node="ip-10-0-128-106.ec2.internal" Jun 04 23:54:32.022932 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:32.022903 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:32.045400 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.045379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/465f1a8207a3957dd83ec2f235253e60-config\") pod \"kube-apiserver-proxy-ip-10-0-128-106.ec2.internal\" (UID: \"465f1a8207a3957dd83ec2f235253e60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-106.ec2.internal" Jun 04 23:54:32.045495 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.045415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/353c7dc21f59e18f3871260a1d811780-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal\" (UID: \"353c7dc21f59e18f3871260a1d811780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" Jun 04 23:54:32.045495 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.045433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/353c7dc21f59e18f3871260a1d811780-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal\" (UID: \"353c7dc21f59e18f3871260a1d811780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" Jun 04 23:54:32.045495 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.045465 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/353c7dc21f59e18f3871260a1d811780-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal\" (UID: \"353c7dc21f59e18f3871260a1d811780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" Jun 04 23:54:32.045495 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.045479 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/465f1a8207a3957dd83ec2f235253e60-config\") pod \"kube-apiserver-proxy-ip-10-0-128-106.ec2.internal\" (UID: \"465f1a8207a3957dd83ec2f235253e60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-106.ec2.internal" Jun 04 23:54:32.045639 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.045490 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/353c7dc21f59e18f3871260a1d811780-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal\" (UID: \"353c7dc21f59e18f3871260a1d811780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" Jun 04 23:54:32.123035 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:32.122999 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:32.223767 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:32.223669 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:32.248085 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.248060 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" Jun 04 23:54:32.253428 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.253406 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-106.ec2.internal" Jun 04 23:54:32.324040 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:32.324000 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:32.424580 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:32.424558 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:32.525154 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:32.525078 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:32.625680 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:32.625647 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:32.681470 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.681350 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 04 23:54:32.682160 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.681525 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 04 23:54:32.682160 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.681527 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 04 23:54:32.726038 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:32.726012 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:32.729812 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:32.729771 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465f1a8207a3957dd83ec2f235253e60.slice/crio-7e70e88efbde650d944fc8ad6824aa71bd854835ed9772995ab6a5569f83f944 WatchSource:0}: Error finding container 7e70e88efbde650d944fc8ad6824aa71bd854835ed9772995ab6a5569f83f944: Status 404 returned error can't find the container with id 7e70e88efbde650d944fc8ad6824aa71bd854835ed9772995ab6a5569f83f944 Jun 04 23:54:32.730303 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:32.730278 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod353c7dc21f59e18f3871260a1d811780.slice/crio-0bf492dde5d151cfbb533b123a48df5a751eefb091cc3375210ad47ccb222eb0 WatchSource:0}: Error finding container 0bf492dde5d151cfbb533b123a48df5a751eefb091cc3375210ad47ccb222eb0: Status 404 returned error can't find the container with id 0bf492dde5d151cfbb533b123a48df5a751eefb091cc3375210ad47ccb222eb0 Jun 04 23:54:32.736552 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.736530 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 04 23:54:32.741206 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.741155 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-03 23:49:31 +0000 UTC" deadline="2027-11-26 10:25:46.410513314 +0000 UTC" Jun 04 23:54:32.741206 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.741204 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12946h31m13.66931214s" Jun 04 23:54:32.817608 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.817498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-106.ec2.internal" event={"ID":"465f1a8207a3957dd83ec2f235253e60","Type":"ContainerStarted","Data":"7e70e88efbde650d944fc8ad6824aa71bd854835ed9772995ab6a5569f83f944"} Jun 04 23:54:32.818503 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.818479 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" event={"ID":"353c7dc21f59e18f3871260a1d811780","Type":"ContainerStarted","Data":"0bf492dde5d151cfbb533b123a48df5a751eefb091cc3375210ad47ccb222eb0"} Jun 04 23:54:32.826664 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:32.826640 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:32.927170 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:32.927133 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-106.ec2.internal\" not found" Jun 04 23:54:32.981183 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:32.981151 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 04 23:54:33.042171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.042136 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" Jun 04 23:54:33.051749 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.051725 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 04 23:54:33.052537 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.052518 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 04 23:54:33.053591 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.053573 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-106.ec2.internal" Jun 04 23:54:33.063562 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.063541 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 04 23:54:33.508099 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.508067 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 04 23:54:33.723317 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.723281 2580 apiserver.go:52] "Watching apiserver" Jun 04 23:54:33.729597 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.729571 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 04 23:54:33.731095 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.731057 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-4h5mh","openshift-ovn-kubernetes/ovnkube-node-rx6tr","kube-system/global-pull-secret-syncer-75l44","kube-system/kube-apiserver-proxy-ip-10-0-128-106.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd","openshift-cluster-node-tuning-operator/tuned-2hgwg","openshift-dns/node-resolver-jslst","openshift-image-registry/node-ca-b5snc","openshift-multus/multus-additional-cni-plugins-cd4jh","openshift-multus/network-metrics-daemon-mfdvb","kube-system/konnectivity-agent-sf7nj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal","openshift-multus/multus-h9626","openshift-network-diagnostics/network-check-target-hmn77"] Jun 04 23:54:33.732364 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.732341 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:33.732482 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:33.732437 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:33.733660 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.733640 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.734973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.734947 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:33.735096 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:33.735025 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:33.736170 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.736145 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 04 23:54:33.736300 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.736280 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 04 23:54:33.736374 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.736350 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 04 23:54:33.736519 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.736497 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 04 23:54:33.736983 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.736645 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 04 23:54:33.736983 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.736497 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-99rzm\"" Jun 04 23:54:33.736983 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.736718 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 04 23:54:33.736983 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.736846 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h9626" Jun 04 23:54:33.737818 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.737799 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.739012 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.738986 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.739843 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.739785 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 04 23:54:33.739946 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.739865 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gvplf\"" Jun 04 23:54:33.740041 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.739944 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 04 23:54:33.740665 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.740220 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 04 23:54:33.740665 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.740586 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 04 23:54:33.741884 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.741058 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6mvx7\"" Jun 04 23:54:33.741884 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.741171 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 04 23:54:33.741884 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.741192 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 04 23:54:33.741884 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.741588 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:33.742556 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.742074 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 04 23:54:33.742556 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.742332 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 04 23:54:33.742556 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.742472 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 04 23:54:33.743121 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.743047 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-llx9j\"" Jun 04 23:54:33.743693 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.743322 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 04 23:54:33.745236 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.744509 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5snc" Jun 04 23:54:33.746417 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.746055 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 04 23:54:33.746417 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.746073 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.746417 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.746127 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 04 23:54:33.746417 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.746077 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rbtc5\"" Jun 04 23:54:33.747429 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.747408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jslst" Jun 04 23:54:33.748075 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.748054 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 04 23:54:33.748199 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.748057 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 04 23:54:33.748262 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.748235 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dn4xk\"" Jun 04 23:54:33.748262 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.748241 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 04 23:54:33.748680 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.748659 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 04 23:54:33.748824 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.748804 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cjz2t\"" Jun 04 23:54:33.748932 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.748854 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4h5mh" Jun 04 23:54:33.748932 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.748872 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 04 23:54:33.749696 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.749680 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 04 23:54:33.749860 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.749844 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 04 23:54:33.749925 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.749845 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p4m86\"" Jun 04 23:54:33.750153 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.750137 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:33.750230 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:33.750210 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:33.750895 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.750852 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 04 23:54:33.751278 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.751252 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mh8qm\"" Jun 04 23:54:33.751365 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.751344 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 04 23:54:33.751644 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.751608 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 04 23:54:33.754045 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-var-lib-cni-multus\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.754148 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-registration-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.754148 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:33.754148 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-run\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.754148 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754104 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-system-cni-dir\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.754148 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754125 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-tuned\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.754148 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-systemd-units\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.754450 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754204 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-run-openvswitch\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.754450 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754223 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.754450 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754250 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-sysctl-conf\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.754450 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754300 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-sys\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.754450 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754326 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfdz5\" (UniqueName: \"kubernetes.io/projected/09fa269c-7602-4596-9168-16eeee6b7f58-kube-api-access-lfdz5\") pod \"node-ca-b5snc\" (UID: \"09fa269c-7602-4596-9168-16eeee6b7f58\") " pod="openshift-image-registry/node-ca-b5snc" Jun 04 23:54:33.754450 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754366 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-socket-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.754450 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-kubelet\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.754450 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-cni-netd\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754464 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-run-k8s-cni-cncf-io\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-sys-fs\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-modprobe-d\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-systemd\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-run-netns\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754604 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-run-ovn\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754643 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e70866f5-2cae-4748-826e-b5442dfd9bfd-ovn-node-metrics-cert\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754667 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-var-lib-kubelet\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754688 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0d775f2-7e3c-45ef-a4ea-c6576050636e-tmp\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754723 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e70866f5-2cae-4748-826e-b5442dfd9bfd-ovnkube-script-lib\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-sysconfig\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.754799 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754780 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20a20195-7660-4bd9-b226-935cb0e052cd-konnectivity-ca\") pod \"konnectivity-agent-sf7nj\" (UID: \"20a20195-7660-4bd9-b226-935cb0e052cd\") " pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754819 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09fa269c-7602-4596-9168-16eeee6b7f58-serviceca\") pod \"node-ca-b5snc\" (UID: \"09fa269c-7602-4596-9168-16eeee6b7f58\") " pod="openshift-image-registry/node-ca-b5snc" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e70866f5-2cae-4748-826e-b5442dfd9bfd-env-overrides\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754904 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5lmd\" (UniqueName: \"kubernetes.io/projected/e70866f5-2cae-4748-826e-b5442dfd9bfd-kube-api-access-j5lmd\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754923 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-conf-dir\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.754966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-run-multus-certs\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-log-socket\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755019 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-cni-dir\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755037 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-daemon-config\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755052 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-lib-modules\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-cnibin\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755121 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm628\" (UniqueName: \"kubernetes.io/projected/a0d775f2-7e3c-45ef-a4ea-c6576050636e-kube-api-access-qm628\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755136 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-slash\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755164 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-run-ovn-kubernetes\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-kubernetes\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755211 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncck2\" (UniqueName: \"kubernetes.io/projected/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-kube-api-access-ncck2\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755237 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-cni-bin\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.755344 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755269 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-var-lib-kubelet\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755301 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-hostroot\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-etc-kubernetes\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755363 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-host\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20a20195-7660-4bd9-b226-935cb0e052cd-agent-certs\") pod \"konnectivity-agent-sf7nj\" (UID: \"20a20195-7660-4bd9-b226-935cb0e052cd\") " pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09fa269c-7602-4596-9168-16eeee6b7f58-host\") pod \"node-ca-b5snc\" (UID: \"09fa269c-7602-4596-9168-16eeee6b7f58\") " pod="openshift-image-registry/node-ca-b5snc" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-var-lib-openvswitch\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755460 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-device-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755476 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsk2b\" (UniqueName: \"kubernetes.io/projected/f372007d-348e-49ec-8db8-827c62793edb-kube-api-access-zsk2b\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755491 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-run-systemd\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755505 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-node-log\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e70866f5-2cae-4748-826e-b5442dfd9bfd-ovnkube-config\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755561 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-os-release\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-cni-binary-copy\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755680 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgft9\" (UniqueName: \"kubernetes.io/projected/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-kube-api-access-sgft9\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-sysctl-d\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.756129 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755736 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-etc-openvswitch\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.756934 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755763 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-var-lib-cni-bin\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.756934 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755795 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.756934 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755815 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlmkq\" (UniqueName: \"kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq\") pod \"network-check-target-hmn77\" (UID: \"70f39a44-5d89-41a9-8231-a54b49e3c8a3\") " pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:33.756934 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755838 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-socket-dir-parent\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.756934 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755855 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 04 23:54:33.756934 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.755869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-run-netns\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.773845 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.773824 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kvqsq" Jun 04 23:54:33.780779 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.780757 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kvqsq" Jun 04 23:54:33.796371 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.796349 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 04 23:54:33.843693 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.843638 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 04 23:54:33.856232 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e70866f5-2cae-4748-826e-b5442dfd9bfd-ovnkube-script-lib\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.856232 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-sysconfig\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.856426 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20a20195-7660-4bd9-b226-935cb0e052cd-konnectivity-ca\") pod \"konnectivity-agent-sf7nj\" (UID: \"20a20195-7660-4bd9-b226-935cb0e052cd\") " pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:33.856426 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09fa269c-7602-4596-9168-16eeee6b7f58-serviceca\") pod \"node-ca-b5snc\" (UID: \"09fa269c-7602-4596-9168-16eeee6b7f58\") " pod="openshift-image-registry/node-ca-b5snc" Jun 04 23:54:33.856426 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e70866f5-2cae-4748-826e-b5442dfd9bfd-env-overrides\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.856426 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856323 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-sysconfig\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.856426 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5lmd\" (UniqueName: \"kubernetes.io/projected/e70866f5-2cae-4748-826e-b5442dfd9bfd-kube-api-access-j5lmd\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.856426 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856385 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-conf-dir\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-run-multus-certs\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-log-socket\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856487 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-cni-dir\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856484 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-conf-dir\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-daemon-config\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-lib-modules\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-cnibin\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm628\" (UniqueName: \"kubernetes.io/projected/a0d775f2-7e3c-45ef-a4ea-c6576050636e-kube-api-access-qm628\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856638 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-slash\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-run-ovn-kubernetes\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856679 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-kubernetes\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856702 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-lib-modules\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.856707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856707 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da06910d-4f1c-4d28-a21a-bb59e3f32252-iptables-alerter-script\") pod \"iptables-alerter-4h5mh\" (UID: \"da06910d-4f1c-4d28-a21a-bb59e3f32252\") " pod="openshift-network-operator/iptables-alerter-4h5mh" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856734 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-cnibin\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856766 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncck2\" (UniqueName: \"kubernetes.io/projected/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-kube-api-access-ncck2\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856789 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-slash\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-cni-bin\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856829 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-cni-bin\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856879 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-cnibin\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856934 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-run-ovn-kubernetes\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.856978 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-kubernetes\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857005 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e70866f5-2cae-4748-826e-b5442dfd9bfd-env-overrides\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857052 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-log-socket\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857077 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-daemon-config\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857096 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-run-multus-certs\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857128 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-cni-dir\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857150 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09fa269c-7602-4596-9168-16eeee6b7f58-serviceca\") pod \"node-ca-b5snc\" (UID: \"09fa269c-7602-4596-9168-16eeee6b7f58\") " pod="openshift-image-registry/node-ca-b5snc" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857166 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e70866f5-2cae-4748-826e-b5442dfd9bfd-ovnkube-script-lib\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-var-lib-kubelet\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857220 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-var-lib-kubelet\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.857305 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857268 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-hostroot\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857298 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-etc-kubernetes\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857318 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-host\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857320 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-hostroot\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857329 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-etc-kubernetes\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20a20195-7660-4bd9-b226-935cb0e052cd-agent-certs\") pod \"konnectivity-agent-sf7nj\" (UID: \"20a20195-7660-4bd9-b226-935cb0e052cd\") " pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857366 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-host\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-system-cni-dir\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09fa269c-7602-4596-9168-16eeee6b7f58-host\") pod \"node-ca-b5snc\" (UID: \"09fa269c-7602-4596-9168-16eeee6b7f58\") " pod="openshift-image-registry/node-ca-b5snc" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857417 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-var-lib-openvswitch\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857446 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09fa269c-7602-4596-9168-16eeee6b7f58-host\") pod \"node-ca-b5snc\" (UID: \"09fa269c-7602-4596-9168-16eeee6b7f58\") " pod="openshift-image-registry/node-ca-b5snc" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-device-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsk2b\" (UniqueName: \"kubernetes.io/projected/f372007d-348e-49ec-8db8-827c62793edb-kube-api-access-zsk2b\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8b814b6-a60f-48c6-b54c-747d9e98255d-cni-binary-copy\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857556 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-device-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857556 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-var-lib-openvswitch\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x844f\" (UniqueName: \"kubernetes.io/projected/12da72fc-3b84-4c07-b99c-ffe403e16866-kube-api-access-x844f\") pod \"node-resolver-jslst\" (UID: \"12da72fc-3b84-4c07-b99c-ffe403e16866\") " pod="openshift-dns/node-resolver-jslst" Jun 04 23:54:33.858143 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857653 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-run-systemd\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857677 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-node-log\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857692 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20a20195-7660-4bd9-b226-935cb0e052cd-konnectivity-ca\") pod \"konnectivity-agent-sf7nj\" (UID: \"20a20195-7660-4bd9-b226-935cb0e052cd\") " pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857706 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-run-systemd\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857716 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e70866f5-2cae-4748-826e-b5442dfd9bfd-ovnkube-config\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-os-release\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857795 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-cni-binary-copy\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857818 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgft9\" (UniqueName: \"kubernetes.io/projected/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-kube-api-access-sgft9\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857824 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-node-log\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-sysctl-d\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-etc-openvswitch\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857893 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-var-lib-cni-bin\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.857980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdea4aec-b853-4f61-a9d2-8f49e919ff54-kubelet-config\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdea4aec-b853-4f61-a9d2-8f49e919ff54-dbus\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:33.858931 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8b814b6-a60f-48c6-b54c-747d9e98255d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858077 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmkq\" (UniqueName: \"kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq\") pod \"network-check-target-hmn77\" (UID: \"70f39a44-5d89-41a9-8231-a54b49e3c8a3\") " pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858101 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-socket-dir-parent\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858165 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-run-netns\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858188 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e70866f5-2cae-4748-826e-b5442dfd9bfd-ovnkube-config\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-var-lib-cni-multus\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-registration-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858240 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-var-lib-cni-multus\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858266 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8b814b6-a60f-48c6-b54c-747d9e98255d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858295 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-run\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858333 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-cni-binary-copy\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-os-release\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-system-cni-dir\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-tuned\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxk6\" (UniqueName: \"kubernetes.io/projected/da06910d-4f1c-4d28-a21a-bb59e3f32252-kube-api-access-pxxk6\") pod \"iptables-alerter-4h5mh\" (UID: \"da06910d-4f1c-4d28-a21a-bb59e3f32252\") " pod="openshift-network-operator/iptables-alerter-4h5mh" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:33.859505 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858469 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-os-release\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858474 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wm2h\" (UniqueName: \"kubernetes.io/projected/b8b814b6-a60f-48c6-b54c-747d9e98255d-kube-api-access-9wm2h\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858509 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858517 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-systemd-units\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858538 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-registration-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858566 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-run-openvswitch\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:33.858645 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:33.858703 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs podName:94ed26b6-3c80-446a-9d43-8fa9d78a5e13 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:34.358684094 +0000 UTC m=+3.024883892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs") pod "network-metrics-daemon-mfdvb" (UID: "94ed26b6-3c80-446a-9d43-8fa9d78a5e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858698 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-system-cni-dir\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858751 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-sysctl-conf\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858778 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-run\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858807 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-multus-socket-dir-parent\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858850 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-run-netns\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858645 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-sysctl-conf\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858859 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-sysctl-d\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858914 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-sys\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.860298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858935 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-etc-openvswitch\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858941 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfdz5\" (UniqueName: \"kubernetes.io/projected/09fa269c-7602-4596-9168-16eeee6b7f58-kube-api-access-lfdz5\") pod \"node-ca-b5snc\" (UID: \"09fa269c-7602-4596-9168-16eeee6b7f58\") " pod="openshift-image-registry/node-ca-b5snc" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.858992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-socket-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-run-openvswitch\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859027 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da06910d-4f1c-4d28-a21a-bb59e3f32252-host-slash\") pod \"iptables-alerter-4h5mh\" (UID: \"da06910d-4f1c-4d28-a21a-bb59e3f32252\") " pod="openshift-network-operator/iptables-alerter-4h5mh" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859054 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859058 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-systemd-units\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12da72fc-3b84-4c07-b99c-ffe403e16866-tmp-dir\") pod \"node-resolver-jslst\" (UID: \"12da72fc-3b84-4c07-b99c-ffe403e16866\") " pod="openshift-dns/node-resolver-jslst" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859128 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-kubelet\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859152 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-cni-netd\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859166 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-sys\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859178 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-socket-dir\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-run-k8s-cni-cncf-io\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859212 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-cni-netd\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859227 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-var-lib-cni-bin\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-sys-fs\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.861171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859263 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-kubelet\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859287 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-modprobe-d\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859306 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-sys-fs\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859320 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f372007d-348e-49ec-8db8-827c62793edb-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859325 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-systemd\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-run-netns\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859361 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-host-run-k8s-cni-cncf-io\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859365 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-systemd\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-run-ovn\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-host-run-netns\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e70866f5-2cae-4748-826e-b5442dfd9bfd-ovn-node-metrics-cert\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859415 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e70866f5-2cae-4748-826e-b5442dfd9bfd-run-ovn\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859408 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-modprobe-d\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-var-lib-kubelet\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0d775f2-7e3c-45ef-a4ea-c6576050636e-tmp\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859519 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0d775f2-7e3c-45ef-a4ea-c6576050636e-var-lib-kubelet\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.859520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12da72fc-3b84-4c07-b99c-ffe403e16866-hosts-file\") pod \"node-resolver-jslst\" (UID: \"12da72fc-3b84-4c07-b99c-ffe403e16866\") " pod="openshift-dns/node-resolver-jslst" Jun 04 23:54:33.861973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.861974 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0d775f2-7e3c-45ef-a4ea-c6576050636e-etc-tuned\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.862833 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.862462 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0d775f2-7e3c-45ef-a4ea-c6576050636e-tmp\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.862963 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.862916 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e70866f5-2cae-4748-826e-b5442dfd9bfd-ovn-node-metrics-cert\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.863292 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.863247 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20a20195-7660-4bd9-b226-935cb0e052cd-agent-certs\") pod \"konnectivity-agent-sf7nj\" (UID: \"20a20195-7660-4bd9-b226-935cb0e052cd\") " pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:33.864855 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:33.864829 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:33.864961 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:33.864860 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:33.864961 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:33.864874 2580 projected.go:196] Error preparing data for projected volume kube-api-access-xlmkq for pod openshift-network-diagnostics/network-check-target-hmn77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:33.864961 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:33.864954 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq podName:70f39a44-5d89-41a9-8231-a54b49e3c8a3 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:34.36492801 +0000 UTC m=+3.031127809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xlmkq" (UniqueName: "kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq") pod "network-check-target-hmn77" (UID: "70f39a44-5d89-41a9-8231-a54b49e3c8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:33.865435 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.865416 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncck2\" (UniqueName: \"kubernetes.io/projected/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-kube-api-access-ncck2\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:33.865754 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.865498 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5lmd\" (UniqueName: \"kubernetes.io/projected/e70866f5-2cae-4748-826e-b5442dfd9bfd-kube-api-access-j5lmd\") pod \"ovnkube-node-rx6tr\" (UID: \"e70866f5-2cae-4748-826e-b5442dfd9bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:33.865754 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.865706 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsk2b\" (UniqueName: \"kubernetes.io/projected/f372007d-348e-49ec-8db8-827c62793edb-kube-api-access-zsk2b\") pod \"aws-ebs-csi-driver-node-q9jqd\" (UID: \"f372007d-348e-49ec-8db8-827c62793edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:33.865950 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.865925 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgft9\" (UniqueName: \"kubernetes.io/projected/b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23-kube-api-access-sgft9\") pod \"multus-h9626\" (UID: \"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23\") " pod="openshift-multus/multus-h9626" Jun 04 23:54:33.866004 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.865955 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm628\" (UniqueName: \"kubernetes.io/projected/a0d775f2-7e3c-45ef-a4ea-c6576050636e-kube-api-access-qm628\") pod \"tuned-2hgwg\" (UID: \"a0d775f2-7e3c-45ef-a4ea-c6576050636e\") " pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:33.866846 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.866827 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfdz5\" (UniqueName: \"kubernetes.io/projected/09fa269c-7602-4596-9168-16eeee6b7f58-kube-api-access-lfdz5\") pod \"node-ca-b5snc\" (UID: \"09fa269c-7602-4596-9168-16eeee6b7f58\") " pod="openshift-image-registry/node-ca-b5snc" Jun 04 23:54:33.960704 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960664 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8b814b6-a60f-48c6-b54c-747d9e98255d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.960704 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-os-release\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.960971 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxk6\" (UniqueName: \"kubernetes.io/projected/da06910d-4f1c-4d28-a21a-bb59e3f32252-kube-api-access-pxxk6\") pod \"iptables-alerter-4h5mh\" (UID: \"da06910d-4f1c-4d28-a21a-bb59e3f32252\") " pod="openshift-network-operator/iptables-alerter-4h5mh" Jun 04 23:54:33.960971 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:33.960971 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960766 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wm2h\" (UniqueName: \"kubernetes.io/projected/b8b814b6-a60f-48c6-b54c-747d9e98255d-kube-api-access-9wm2h\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.960971 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960795 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da06910d-4f1c-4d28-a21a-bb59e3f32252-host-slash\") pod \"iptables-alerter-4h5mh\" (UID: \"da06910d-4f1c-4d28-a21a-bb59e3f32252\") " pod="openshift-network-operator/iptables-alerter-4h5mh" Jun 04 23:54:33.960971 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.960971 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12da72fc-3b84-4c07-b99c-ffe403e16866-tmp-dir\") pod \"node-resolver-jslst\" (UID: \"12da72fc-3b84-4c07-b99c-ffe403e16866\") " pod="openshift-dns/node-resolver-jslst" Jun 04 23:54:33.960971 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960872 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12da72fc-3b84-4c07-b99c-ffe403e16866-hosts-file\") pod \"node-resolver-jslst\" (UID: \"12da72fc-3b84-4c07-b99c-ffe403e16866\") " pod="openshift-dns/node-resolver-jslst" Jun 04 23:54:33.960971 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da06910d-4f1c-4d28-a21a-bb59e3f32252-iptables-alerter-script\") pod \"iptables-alerter-4h5mh\" (UID: \"da06910d-4f1c-4d28-a21a-bb59e3f32252\") " pod="openshift-network-operator/iptables-alerter-4h5mh" Jun 04 23:54:33.960971 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960913 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-cnibin\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.960971 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-system-cni-dir\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.960971 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.960966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8b814b6-a60f-48c6-b54c-747d9e98255d-cni-binary-copy\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.961459 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x844f\" (UniqueName: \"kubernetes.io/projected/12da72fc-3b84-4c07-b99c-ffe403e16866-kube-api-access-x844f\") pod \"node-resolver-jslst\" (UID: \"12da72fc-3b84-4c07-b99c-ffe403e16866\") " pod="openshift-dns/node-resolver-jslst" Jun 04 23:54:33.961459 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961038 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdea4aec-b853-4f61-a9d2-8f49e919ff54-kubelet-config\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:33.961459 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961065 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-os-release\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.961459 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdea4aec-b853-4f61-a9d2-8f49e919ff54-dbus\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:33.961459 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8b814b6-a60f-48c6-b54c-747d9e98255d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.961459 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961156 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bdea4aec-b853-4f61-a9d2-8f49e919ff54-dbus\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:33.961459 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:33.961206 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:33.961459 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961344 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8b814b6-a60f-48c6-b54c-747d9e98255d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.961459 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:33.961359 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret podName:bdea4aec-b853-4f61-a9d2-8f49e919ff54 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:34.46133908 +0000 UTC m=+3.127538891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret") pod "global-pull-secret-syncer-75l44" (UID: "bdea4aec-b853-4f61-a9d2-8f49e919ff54") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:33.961459 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961375 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.961459 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961443 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da06910d-4f1c-4d28-a21a-bb59e3f32252-host-slash\") pod \"iptables-alerter-4h5mh\" (UID: \"da06910d-4f1c-4d28-a21a-bb59e3f32252\") " pod="openshift-network-operator/iptables-alerter-4h5mh" Jun 04 23:54:33.962069 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961498 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-system-cni-dir\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.962069 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961520 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12da72fc-3b84-4c07-b99c-ffe403e16866-tmp-dir\") pod \"node-resolver-jslst\" (UID: \"12da72fc-3b84-4c07-b99c-ffe403e16866\") " pod="openshift-dns/node-resolver-jslst" Jun 04 23:54:33.962069 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961558 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8b814b6-a60f-48c6-b54c-747d9e98255d-cnibin\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.962069 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961628 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12da72fc-3b84-4c07-b99c-ffe403e16866-hosts-file\") pod \"node-resolver-jslst\" (UID: \"12da72fc-3b84-4c07-b99c-ffe403e16866\") " pod="openshift-dns/node-resolver-jslst" Jun 04 23:54:33.962069 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961836 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8b814b6-a60f-48c6-b54c-747d9e98255d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.962069 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961888 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bdea4aec-b853-4f61-a9d2-8f49e919ff54-kubelet-config\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:33.962069 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.961971 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8b814b6-a60f-48c6-b54c-747d9e98255d-cni-binary-copy\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:33.962069 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.962060 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da06910d-4f1c-4d28-a21a-bb59e3f32252-iptables-alerter-script\") pod \"iptables-alerter-4h5mh\" (UID: \"da06910d-4f1c-4d28-a21a-bb59e3f32252\") " pod="openshift-network-operator/iptables-alerter-4h5mh" Jun 04 23:54:33.969728 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.969701 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x844f\" (UniqueName: \"kubernetes.io/projected/12da72fc-3b84-4c07-b99c-ffe403e16866-kube-api-access-x844f\") pod \"node-resolver-jslst\" (UID: \"12da72fc-3b84-4c07-b99c-ffe403e16866\") " pod="openshift-dns/node-resolver-jslst" Jun 04 23:54:33.969864 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.969823 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxk6\" (UniqueName: \"kubernetes.io/projected/da06910d-4f1c-4d28-a21a-bb59e3f32252-kube-api-access-pxxk6\") pod \"iptables-alerter-4h5mh\" (UID: \"da06910d-4f1c-4d28-a21a-bb59e3f32252\") " pod="openshift-network-operator/iptables-alerter-4h5mh" Jun 04 23:54:33.969864 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:33.969826 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wm2h\" (UniqueName: \"kubernetes.io/projected/b8b814b6-a60f-48c6-b54c-747d9e98255d-kube-api-access-9wm2h\") pod \"multus-additional-cni-plugins-cd4jh\" (UID: \"b8b814b6-a60f-48c6-b54c-747d9e98255d\") " pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:34.048006 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.047916 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:34.054398 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.054374 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h9626" Jun 04 23:54:34.062043 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.062015 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" Jun 04 23:54:34.067659 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.067636 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" Jun 04 23:54:34.074320 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.074299 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:34.080899 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.080877 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5snc" Jun 04 23:54:34.088503 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.088481 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" Jun 04 23:54:34.095279 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.095257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jslst" Jun 04 23:54:34.101922 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.101901 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4h5mh" Jun 04 23:54:34.363891 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.363807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:34.364028 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:34.363909 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:34.364028 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:34.363983 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs podName:94ed26b6-3c80-446a-9d43-8fa9d78a5e13 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:35.363967616 +0000 UTC m=+4.030167417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs") pod "network-metrics-daemon-mfdvb" (UID: "94ed26b6-3c80-446a-9d43-8fa9d78a5e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:34.465097 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.465059 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmkq\" (UniqueName: \"kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq\") pod \"network-check-target-hmn77\" (UID: \"70f39a44-5d89-41a9-8231-a54b49e3c8a3\") " pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:34.465258 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.465118 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:34.465258 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:34.465231 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:34.465357 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:34.465271 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:34.465357 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:34.465296 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:34.465357 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:34.465300 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret podName:bdea4aec-b853-4f61-a9d2-8f49e919ff54 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:35.465283675 +0000 UTC m=+4.131483478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret") pod "global-pull-secret-syncer-75l44" (UID: "bdea4aec-b853-4f61-a9d2-8f49e919ff54") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:34.465357 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:34.465309 2580 projected.go:196] Error preparing data for projected volume kube-api-access-xlmkq for pod openshift-network-diagnostics/network-check-target-hmn77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:34.465525 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:34.465362 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq podName:70f39a44-5d89-41a9-8231-a54b49e3c8a3 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:35.465345396 +0000 UTC m=+4.131545209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlmkq" (UniqueName: "kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq") pod "network-check-target-hmn77" (UID: "70f39a44-5d89-41a9-8231-a54b49e3c8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:34.536918 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:34.536885 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f5b81a_02f9_461e_ab5a_cdb7c9c5bb23.slice/crio-791299fd01cd74d6dfa18fb663156d26b0c11fa7655b944cf3a651128853b009 WatchSource:0}: Error finding container 791299fd01cd74d6dfa18fb663156d26b0c11fa7655b944cf3a651128853b009: Status 404 returned error can't find the container with id 791299fd01cd74d6dfa18fb663156d26b0c11fa7655b944cf3a651128853b009 Jun 04 23:54:34.537609 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:34.537587 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d775f2_7e3c_45ef_a4ea_c6576050636e.slice/crio-5182f71a39fd0525968a4fbd81674f34ef6008274914d6b08703680e7f852acb WatchSource:0}: Error finding container 5182f71a39fd0525968a4fbd81674f34ef6008274914d6b08703680e7f852acb: Status 404 returned error can't find the container with id 5182f71a39fd0525968a4fbd81674f34ef6008274914d6b08703680e7f852acb Jun 04 23:54:34.539111 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:34.539077 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12da72fc_3b84_4c07_b99c_ffe403e16866.slice/crio-3dc59c84d4b8e300f2dbe41e4f990a17f7c259df35c2dd74261765e56690487b WatchSource:0}: Error finding container 3dc59c84d4b8e300f2dbe41e4f990a17f7c259df35c2dd74261765e56690487b: Status 404 returned error can't find the container with id 3dc59c84d4b8e300f2dbe41e4f990a17f7c259df35c2dd74261765e56690487b Jun 04 23:54:34.540442 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:54:34.540419 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf372007d_348e_49ec_8db8_827c62793edb.slice/crio-8dd0f8f33932c2cf63d262e6cf6fa0d87e8945ca6c96a08bdc394eb33a7fd6ed WatchSource:0}: Error finding container 8dd0f8f33932c2cf63d262e6cf6fa0d87e8945ca6c96a08bdc394eb33a7fd6ed: Status 404 returned error can't find the container with id 8dd0f8f33932c2cf63d262e6cf6fa0d87e8945ca6c96a08bdc394eb33a7fd6ed Jun 04 23:54:34.783471 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.783286 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-03 23:49:33 +0000 UTC" deadline="2027-11-06 01:12:28.777037112 +0000 UTC" Jun 04 23:54:34.783471 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.783468 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12457h17m53.993574363s" Jun 04 23:54:34.816450 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.815164 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:34.816450 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:34.815281 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:34.823842 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.823810 2580 generic.go:356] "Generic (PLEG): container finished" podID="353c7dc21f59e18f3871260a1d811780" containerID="f3090ee1859686570ea6ebe978ca27383a6f80c3c7b6d38e78d6c84147938d47" exitCode=0 Jun 04 23:54:34.823956 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.823891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" event={"ID":"353c7dc21f59e18f3871260a1d811780","Type":"ContainerDied","Data":"f3090ee1859686570ea6ebe978ca27383a6f80c3c7b6d38e78d6c84147938d47"} Jun 04 23:54:34.825029 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.825006 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5snc" event={"ID":"09fa269c-7602-4596-9168-16eeee6b7f58","Type":"ContainerStarted","Data":"e3a720c7ad1f63f68494eadef209e281eb4b54249e5a93e59becca4854149797"} Jun 04 23:54:34.826163 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.826131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4h5mh" event={"ID":"da06910d-4f1c-4d28-a21a-bb59e3f32252","Type":"ContainerStarted","Data":"1acde9956d8971ee5bcd903f3bc9eb2902f35c33956265446cbeda5e3cbda9c8"} Jun 04 23:54:34.827317 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.827279 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h9626" event={"ID":"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23","Type":"ContainerStarted","Data":"791299fd01cd74d6dfa18fb663156d26b0c11fa7655b944cf3a651128853b009"} Jun 04 23:54:34.828702 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.828669 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-106.ec2.internal" event={"ID":"465f1a8207a3957dd83ec2f235253e60","Type":"ContainerStarted","Data":"26a145e787850e0c83998531d16cadcacf9eb5c0beac9b1cb31d648911eca474"} Jun 04 23:54:34.829764 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.829743 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" event={"ID":"f372007d-348e-49ec-8db8-827c62793edb","Type":"ContainerStarted","Data":"8dd0f8f33932c2cf63d262e6cf6fa0d87e8945ca6c96a08bdc394eb33a7fd6ed"} Jun 04 23:54:34.830809 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.830784 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" event={"ID":"a0d775f2-7e3c-45ef-a4ea-c6576050636e","Type":"ContainerStarted","Data":"5182f71a39fd0525968a4fbd81674f34ef6008274914d6b08703680e7f852acb"} Jun 04 23:54:34.831773 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.831754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jslst" event={"ID":"12da72fc-3b84-4c07-b99c-ffe403e16866","Type":"ContainerStarted","Data":"3dc59c84d4b8e300f2dbe41e4f990a17f7c259df35c2dd74261765e56690487b"} Jun 04 23:54:34.832899 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.832881 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" event={"ID":"e70866f5-2cae-4748-826e-b5442dfd9bfd","Type":"ContainerStarted","Data":"8a0645905cb46e234e326744a20d141cc853a3c94dc59c914926ae8e12602c4b"} Jun 04 23:54:34.833860 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.833831 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" event={"ID":"b8b814b6-a60f-48c6-b54c-747d9e98255d","Type":"ContainerStarted","Data":"794e18a14c916ac5cc8395c51be9f83fb2738dade62a4a32057e244fa2013e65"} Jun 04 23:54:34.834699 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.834678 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sf7nj" event={"ID":"20a20195-7660-4bd9-b226-935cb0e052cd","Type":"ContainerStarted","Data":"2efb54fdb37fe612ee960e3f9fbebad819e8b0ce661219423f43f5df67064867"} Jun 04 23:54:34.851086 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:34.851034 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-106.ec2.internal" podStartSLOduration=1.8510134470000001 podStartE2EDuration="1.851013447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:34.850724145 +0000 UTC m=+3.516923966" watchObservedRunningTime="2026-06-04 23:54:34.851013447 +0000 UTC m=+3.517213268" Jun 04 23:54:35.373540 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:35.373503 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:35.373756 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:35.373730 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:35.373826 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:35.373798 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs podName:94ed26b6-3c80-446a-9d43-8fa9d78a5e13 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:37.373778126 +0000 UTC m=+6.039977937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs") pod "network-metrics-daemon-mfdvb" (UID: "94ed26b6-3c80-446a-9d43-8fa9d78a5e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:35.474803 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:35.474755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmkq\" (UniqueName: \"kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq\") pod \"network-check-target-hmn77\" (UID: \"70f39a44-5d89-41a9-8231-a54b49e3c8a3\") " pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:35.474975 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:35.474841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:35.475061 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:35.475001 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:35.475116 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:35.475073 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret podName:bdea4aec-b853-4f61-a9d2-8f49e919ff54 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:37.475050789 +0000 UTC m=+6.141250627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret") pod "global-pull-secret-syncer-75l44" (UID: "bdea4aec-b853-4f61-a9d2-8f49e919ff54") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:35.475649 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:35.475628 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:35.475738 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:35.475657 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:35.475738 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:35.475671 2580 projected.go:196] Error preparing data for projected volume kube-api-access-xlmkq for pod openshift-network-diagnostics/network-check-target-hmn77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:35.475850 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:35.475751 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq podName:70f39a44-5d89-41a9-8231-a54b49e3c8a3 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:37.475732671 +0000 UTC m=+6.141932489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlmkq" (UniqueName: "kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq") pod "network-check-target-hmn77" (UID: "70f39a44-5d89-41a9-8231-a54b49e3c8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:35.784640 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:35.784534 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-03 23:49:33 +0000 UTC" deadline="2027-11-18 11:14:07.48848463 +0000 UTC" Jun 04 23:54:35.784640 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:35.784576 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12755h19m31.703913055s" Jun 04 23:54:35.826161 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:35.826125 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:35.826340 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:35.826310 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:35.826837 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:35.826815 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:35.826964 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:35.826941 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:35.849321 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:35.849283 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" event={"ID":"353c7dc21f59e18f3871260a1d811780","Type":"ContainerStarted","Data":"47114c21df4c43ff4075720564e2f40dee599a6454118f1d055f5404bfc4fdca"} Jun 04 23:54:36.814820 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:36.814789 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:36.815406 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:36.814932 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:37.393134 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:37.393094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:37.393337 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:37.393273 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:37.393400 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:37.393340 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs podName:94ed26b6-3c80-446a-9d43-8fa9d78a5e13 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:41.393321715 +0000 UTC m=+10.059521525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs") pod "network-metrics-daemon-mfdvb" (UID: "94ed26b6-3c80-446a-9d43-8fa9d78a5e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:37.494484 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:37.494442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmkq\" (UniqueName: \"kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq\") pod \"network-check-target-hmn77\" (UID: \"70f39a44-5d89-41a9-8231-a54b49e3c8a3\") " pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:37.494675 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:37.494507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:37.494734 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:37.494673 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:37.494808 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:37.494740 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret podName:bdea4aec-b853-4f61-a9d2-8f49e919ff54 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:41.49472102 +0000 UTC m=+10.160920821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret") pod "global-pull-secret-syncer-75l44" (UID: "bdea4aec-b853-4f61-a9d2-8f49e919ff54") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:37.495192 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:37.495143 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:37.495192 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:37.495165 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:37.495192 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:37.495178 2580 projected.go:196] Error preparing data for projected volume kube-api-access-xlmkq for pod openshift-network-diagnostics/network-check-target-hmn77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:37.495381 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:37.495225 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq podName:70f39a44-5d89-41a9-8231-a54b49e3c8a3 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:41.495209898 +0000 UTC m=+10.161409709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlmkq" (UniqueName: "kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq") pod "network-check-target-hmn77" (UID: "70f39a44-5d89-41a9-8231-a54b49e3c8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:37.815123 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:37.815092 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:37.815595 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:37.815271 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:37.815595 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:37.815308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:37.815595 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:37.815409 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:38.815082 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:38.815047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:38.815269 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:38.815184 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:39.815382 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:39.815348 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:39.815860 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:39.815352 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:39.815860 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:39.815676 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:39.815860 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:39.815504 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:40.814964 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:40.814924 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:40.815153 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:40.815087 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:41.430814 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:41.430775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:41.431271 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:41.430961 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:41.431271 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:41.431030 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs podName:94ed26b6-3c80-446a-9d43-8fa9d78a5e13 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:49.431008773 +0000 UTC m=+18.097208589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs") pod "network-metrics-daemon-mfdvb" (UID: "94ed26b6-3c80-446a-9d43-8fa9d78a5e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:41.531840 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:41.531797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:41.532027 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:41.531891 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmkq\" (UniqueName: \"kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq\") pod \"network-check-target-hmn77\" (UID: \"70f39a44-5d89-41a9-8231-a54b49e3c8a3\") " pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:41.532088 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:41.532047 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:41.532178 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:41.532136 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret podName:bdea4aec-b853-4f61-a9d2-8f49e919ff54 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:49.532113895 +0000 UTC m=+18.198313714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret") pod "global-pull-secret-syncer-75l44" (UID: "bdea4aec-b853-4f61-a9d2-8f49e919ff54") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:41.532241 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:41.532178 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:41.532241 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:41.532205 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:41.532241 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:41.532221 2580 projected.go:196] Error preparing data for projected volume kube-api-access-xlmkq for pod openshift-network-diagnostics/network-check-target-hmn77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:41.532405 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:41.532273 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq podName:70f39a44-5d89-41a9-8231-a54b49e3c8a3 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:49.53225596 +0000 UTC m=+18.198455779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlmkq" (UniqueName: "kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq") pod "network-check-target-hmn77" (UID: "70f39a44-5d89-41a9-8231-a54b49e3c8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:41.815451 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:41.815257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:41.815451 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:41.815379 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:41.815451 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:41.815436 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:41.815785 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:41.815499 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:42.814730 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:42.814688 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:42.815262 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:42.814835 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:43.814887 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:43.814848 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:43.814887 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:43.814866 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:43.815469 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:43.814990 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:43.815469 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:43.815152 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:44.814452 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:44.814426 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:44.814576 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:44.814553 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:45.815047 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:45.815012 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:45.815559 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:45.815012 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:45.815559 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:45.815133 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:45.815559 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:45.815198 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:46.814381 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:46.814347 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:46.814579 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:46.814484 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:47.814630 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:47.814595 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:47.815043 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:47.814593 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:47.815043 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:47.814760 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:47.815043 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:47.814806 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:48.814796 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:48.814758 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:48.815234 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:48.814890 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:49.495162 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:49.495124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:49.495341 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:49.495264 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:49.495417 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:49.495345 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs podName:94ed26b6-3c80-446a-9d43-8fa9d78a5e13 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:05.495324341 +0000 UTC m=+34.161524142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs") pod "network-metrics-daemon-mfdvb" (UID: "94ed26b6-3c80-446a-9d43-8fa9d78a5e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:49.596095 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:49.596051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmkq\" (UniqueName: \"kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq\") pod \"network-check-target-hmn77\" (UID: \"70f39a44-5d89-41a9-8231-a54b49e3c8a3\") " pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:49.596292 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:49.596120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:49.596292 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:49.596228 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:49.596405 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:49.596294 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret podName:bdea4aec-b853-4f61-a9d2-8f49e919ff54 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:05.596275427 +0000 UTC m=+34.262475224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret") pod "global-pull-secret-syncer-75l44" (UID: "bdea4aec-b853-4f61-a9d2-8f49e919ff54") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:49.596405 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:49.596229 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:49.596405 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:49.596334 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:49.596405 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:49.596348 2580 projected.go:196] Error preparing data for projected volume kube-api-access-xlmkq for pod openshift-network-diagnostics/network-check-target-hmn77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:49.596405 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:49.596403 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq podName:70f39a44-5d89-41a9-8231-a54b49e3c8a3 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:05.596384945 +0000 UTC m=+34.262584764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlmkq" (UniqueName: "kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq") pod "network-check-target-hmn77" (UID: "70f39a44-5d89-41a9-8231-a54b49e3c8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:49.814922 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:49.814830 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:49.815369 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:49.814837 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:49.815369 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:49.814978 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:49.815369 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:49.815039 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:50.814771 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:50.814718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:50.814948 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:50.814862 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:51.816008 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:51.815968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:51.816490 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:51.816012 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:51.816490 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:51.816108 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:51.816490 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:51.816238 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:52.815016 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:52.814977 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:52.815170 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:52.815081 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:53.814962 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.814667 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:53.815371 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:53.815088 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:53.815509 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.814672 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:53.815566 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:53.815534 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:53.892366 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.892330 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" event={"ID":"f372007d-348e-49ec-8db8-827c62793edb","Type":"ContainerStarted","Data":"66914add266e99b74c3e9f0a0e9204bd23523abca3f0998c96a9f0ed8d40b963"} Jun 04 23:54:53.893964 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.893936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" event={"ID":"a0d775f2-7e3c-45ef-a4ea-c6576050636e","Type":"ContainerStarted","Data":"6f4613c82007e7fb9dc956575482ce984080f751ea94880de10bc7e7c9dd5ce2"} Jun 04 23:54:53.895721 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.895667 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jslst" event={"ID":"12da72fc-3b84-4c07-b99c-ffe403e16866","Type":"ContainerStarted","Data":"29065d60651d7da0eeb911d25703d624b6e9a31f65be22976d0ebd61d0c95866"} Jun 04 23:54:53.898844 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.898821 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 04 23:54:53.899263 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.899240 2580 generic.go:356] "Generic (PLEG): container finished" podID="e70866f5-2cae-4748-826e-b5442dfd9bfd" containerID="836c52ffb2aa871871674e14ba52ed03be4861f0067a53a5b2fecdf5c22f6595" exitCode=1 Jun 04 23:54:53.899371 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.899318 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" event={"ID":"e70866f5-2cae-4748-826e-b5442dfd9bfd","Type":"ContainerStarted","Data":"e95529d82fc0ce0112441d73922409495b1100090d019ed842052cc845678e9f"} Jun 04 23:54:53.899430 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.899394 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" event={"ID":"e70866f5-2cae-4748-826e-b5442dfd9bfd","Type":"ContainerStarted","Data":"eada1f0609c3388999024a09adb75a0c5ad17e55bae74c395fb195bb8a9f05f2"} Jun 04 23:54:53.899482 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.899457 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" event={"ID":"e70866f5-2cae-4748-826e-b5442dfd9bfd","Type":"ContainerStarted","Data":"470d110de8d5bb26d580b19cfb369ea67516c5fdc4de2672f066418adddea3a2"} Jun 04 23:54:53.899527 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.899505 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" event={"ID":"e70866f5-2cae-4748-826e-b5442dfd9bfd","Type":"ContainerDied","Data":"836c52ffb2aa871871674e14ba52ed03be4861f0067a53a5b2fecdf5c22f6595"} Jun 04 23:54:53.899581 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.899552 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" event={"ID":"e70866f5-2cae-4748-826e-b5442dfd9bfd","Type":"ContainerStarted","Data":"773e91cc00156f21cc8fc9efdc4df0db5186caef24294097a4fc9215fc968db8"} Jun 04 23:54:53.904997 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.904964 2580 generic.go:356] "Generic (PLEG): container finished" podID="b8b814b6-a60f-48c6-b54c-747d9e98255d" containerID="3a4a1a47277e83ce212f1bfbf8705dbd4c4b40f99adb8c827ce20849a9154b04" exitCode=0 Jun 04 23:54:53.905106 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.905045 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" event={"ID":"b8b814b6-a60f-48c6-b54c-747d9e98255d","Type":"ContainerDied","Data":"3a4a1a47277e83ce212f1bfbf8705dbd4c4b40f99adb8c827ce20849a9154b04"} Jun 04 23:54:53.907276 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.907225 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sf7nj" event={"ID":"20a20195-7660-4bd9-b226-935cb0e052cd","Type":"ContainerStarted","Data":"464e225af6daee9cad6927c550ebcfa632f3d74daee6e1264aba17d6d8fd8c9c"} Jun 04 23:54:53.908989 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.908954 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5snc" event={"ID":"09fa269c-7602-4596-9168-16eeee6b7f58","Type":"ContainerStarted","Data":"2c70811e41d0ea1423c9eea0638d4956b7181cefec0c1ec23d92bdff9cf6769c"} Jun 04 23:54:53.910880 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.910855 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h9626" event={"ID":"b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23","Type":"ContainerStarted","Data":"dd5e701960c5bfd7c096e8ad65b65d8e2002c72cd930a7ed28cc2640d1d6d9eb"} Jun 04 23:54:53.911332 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.911298 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2hgwg" podStartSLOduration=4.310310711 podStartE2EDuration="22.911286167s" totalImagesPullingTime="18.600975456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:53.910869837 +0000 UTC m=+22.577069654" watchObservedRunningTime="2026-06-04 23:54:53.911286167 +0000 UTC m=+22.577485985" Jun 04 23:54:53.911675 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.911646 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-106.ec2.internal" podStartSLOduration=20.911637862 podStartE2EDuration="20.911637862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:35.8642638 +0000 UTC m=+4.530463616" watchObservedRunningTime="2026-06-04 23:54:53.911637862 +0000 UTC m=+22.577837681" Jun 04 23:54:53.947568 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.947516 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sf7nj" podStartSLOduration=12.672337645 podStartE2EDuration="22.947498814s" totalImagesPullingTime="10.275161169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:53.94709283 +0000 UTC m=+22.613292649" watchObservedRunningTime="2026-06-04 23:54:53.947498814 +0000 UTC m=+22.613698631" Jun 04 23:54:53.960719 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.960666 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b5snc" podStartSLOduration=4.366183611 podStartE2EDuration="22.96064931s" totalImagesPullingTime="18.594465699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:53.960587002 +0000 UTC m=+22.626786819" watchObservedRunningTime="2026-06-04 23:54:53.96064931 +0000 UTC m=+22.626849128" Jun 04 23:54:53.974267 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.974203 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jslst" podStartSLOduration=3.376452831 podStartE2EDuration="21.974180158s" totalImagesPullingTime="18.597727327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:53.973513739 +0000 UTC m=+22.639713578" watchObservedRunningTime="2026-06-04 23:54:53.974180158 +0000 UTC m=+22.640379978" Jun 04 23:54:53.994798 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:53.994742 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h9626" podStartSLOduration=4.373710287 podStartE2EDuration="22.994721871s" totalImagesPullingTime="18.621011584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:53.994437584 +0000 UTC m=+22.660637421" watchObservedRunningTime="2026-06-04 23:54:53.994721871 +0000 UTC m=+22.660921689" Jun 04 23:54:54.403754 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:54.403719 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 04 23:54:54.815169 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:54.815140 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:54.815991 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:54.815062 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-04T23:54:54.403745836Z","UUID":"43b268a0-9754-4c57-9777-f321b7c89fd8","Handler":null,"Name":"","Endpoint":""} Jun 04 23:54:54.815991 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:54.815291 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:54.816886 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:54.816860 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 04 23:54:54.817016 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:54.816909 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 04 23:54:54.916940 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:54.916871 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 04 23:54:54.917343 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:54.917311 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" event={"ID":"e70866f5-2cae-4748-826e-b5442dfd9bfd","Type":"ContainerStarted","Data":"781f86e94a7755b38e78d77c2ffb3b63e126cf542717ab49e958e8277a4acbea"} Jun 04 23:54:54.918976 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:54.918950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4h5mh" event={"ID":"da06910d-4f1c-4d28-a21a-bb59e3f32252","Type":"ContainerStarted","Data":"a1cd5122a19afd53c84a0092ba985b68ffaee33a0a7b518aff8d3a586bad9524"} Jun 04 23:54:54.920924 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:54.920897 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" event={"ID":"f372007d-348e-49ec-8db8-827c62793edb","Type":"ContainerStarted","Data":"83d716382a200695525b2b8656401f8b4c69cef78fe4c696fb9c75fcbdb5735a"} Jun 04 23:54:55.815022 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:55.814929 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:55.815022 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:55.814966 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:55.815236 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:55.815078 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:55.815236 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:55.815222 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:55.926433 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:55.926382 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" event={"ID":"f372007d-348e-49ec-8db8-827c62793edb","Type":"ContainerStarted","Data":"31719c280d392953edb56c06268a200b7949b474d8f75673a935090368b1accc"} Jun 04 23:54:55.943534 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:55.943473 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jqd" podStartSLOduration=4.4497804 podStartE2EDuration="24.9434512s" totalImagesPullingTime="20.4936708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:55.942647207 +0000 UTC m=+24.608847054" watchObservedRunningTime="2026-06-04 23:54:55.9434512 +0000 UTC m=+24.609651017" Jun 04 23:54:55.944182 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:55.944145 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4h5mh" podStartSLOduration=5.348914833 podStartE2EDuration="23.944133257s" totalImagesPullingTime="18.595218424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:54.93374068 +0000 UTC m=+23.599940499" watchObservedRunningTime="2026-06-04 23:54:55.944133257 +0000 UTC m=+24.610333074" Jun 04 23:54:56.814582 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:56.814539 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:56.814768 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:56.814696 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:56.932135 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:56.932105 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 04 23:54:56.932730 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:56.932552 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" event={"ID":"e70866f5-2cae-4748-826e-b5442dfd9bfd","Type":"ContainerStarted","Data":"b0eaf5c226e2cfe2c1d637f39b4dc005271e720dd608654ac2b8647b8567d5ea"} Jun 04 23:54:57.815009 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:57.814972 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:57.815192 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:57.815124 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:57.815192 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:57.815149 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:57.815302 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:57.815257 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:57.936637 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:57.936445 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" event={"ID":"b8b814b6-a60f-48c6-b54c-747d9e98255d","Type":"ContainerStarted","Data":"d75f520eeaeac498814f92a89b5a200f3d395ea0856704f8d8067b06ae55fe27"} Jun 04 23:54:58.634757 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.634708 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:58.635352 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.635335 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:58.815004 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.814968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:54:58.815184 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:58.815080 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:54:58.941894 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.941814 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 04 23:54:58.942397 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.942183 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" event={"ID":"e70866f5-2cae-4748-826e-b5442dfd9bfd","Type":"ContainerStarted","Data":"5d0b845a05bcab18b364257c6494937f131916b2d0bb2f5297b0d1c2efa918c3"} Jun 04 23:54:58.942535 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.942520 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:58.942645 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.942589 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:58.942710 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.942694 2580 scope.go:117] "RemoveContainer" containerID="836c52ffb2aa871871674e14ba52ed03be4861f0067a53a5b2fecdf5c22f6595" Jun 04 23:54:58.944435 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.944402 2580 generic.go:356] "Generic (PLEG): container finished" podID="b8b814b6-a60f-48c6-b54c-747d9e98255d" containerID="d75f520eeaeac498814f92a89b5a200f3d395ea0856704f8d8067b06ae55fe27" exitCode=0 Jun 04 23:54:58.944527 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.944483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" event={"ID":"b8b814b6-a60f-48c6-b54c-747d9e98255d","Type":"ContainerDied","Data":"d75f520eeaeac498814f92a89b5a200f3d395ea0856704f8d8067b06ae55fe27"} Jun 04 23:54:58.944809 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.944781 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:58.945410 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.945395 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sf7nj" Jun 04 23:54:58.960273 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:58.960248 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:59.815068 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:59.814889 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:54:59.815216 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:59.814956 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:54:59.815216 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:59.815157 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:54:59.815288 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:54:59.815236 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:54:59.950866 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:59.950839 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 04 23:54:59.951334 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:59.951305 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" event={"ID":"e70866f5-2cae-4748-826e-b5442dfd9bfd","Type":"ContainerStarted","Data":"4a94d6d26484bce5ebb1d14336ed72750a440756172e1fd6cc0774c2ed9d507a"} Jun 04 23:54:59.951402 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:59.951386 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:59.957990 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:59.957962 2580 generic.go:356] "Generic (PLEG): container finished" podID="b8b814b6-a60f-48c6-b54c-747d9e98255d" containerID="0f4278c5bbc3736ecbc8c9b4cc334f43a74a94ef450657fe36445d0dd2aa775e" exitCode=0 Jun 04 23:54:59.958156 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:59.957991 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" event={"ID":"b8b814b6-a60f-48c6-b54c-747d9e98255d","Type":"ContainerDied","Data":"0f4278c5bbc3736ecbc8c9b4cc334f43a74a94ef450657fe36445d0dd2aa775e"} Jun 04 23:54:59.968088 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:59.968065 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:54:59.979109 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:54:59.979064 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" podStartSLOduration=10.313158518 podStartE2EDuration="28.979050515s" totalImagesPullingTime="18.665891997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:59.977749278 +0000 UTC m=+28.643949095" watchObservedRunningTime="2026-06-04 23:54:59.979050515 +0000 UTC m=+28.645250333" Jun 04 23:55:00.321458 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:00.321378 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-75l44"] Jun 04 23:55:00.321753 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:00.321732 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:55:00.321869 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:00.321837 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:55:00.324529 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:00.324496 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hmn77"] Jun 04 23:55:00.324688 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:00.324607 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:55:00.324786 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:00.324743 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:55:00.325268 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:00.325235 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mfdvb"] Jun 04 23:55:00.325361 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:00.325346 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:55:00.325514 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:00.325433 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:55:00.963506 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:00.963476 2580 generic.go:356] "Generic (PLEG): container finished" podID="b8b814b6-a60f-48c6-b54c-747d9e98255d" containerID="25c67829e5f608195cc5872cf804db0a47f881b2415f534b14e3a0451417f299" exitCode=0 Jun 04 23:55:00.964130 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:00.963561 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" event={"ID":"b8b814b6-a60f-48c6-b54c-747d9e98255d","Type":"ContainerDied","Data":"25c67829e5f608195cc5872cf804db0a47f881b2415f534b14e3a0451417f299"} Jun 04 23:55:01.815603 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:01.815570 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:55:01.815917 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:01.815649 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:55:01.816047 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:01.815930 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:55:01.816047 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:01.815677 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:55:01.816047 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:01.816011 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:55:01.816209 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:01.816111 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:55:03.815296 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:03.815092 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:55:03.815776 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:03.815092 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:55:03.815776 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:03.815406 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:55:03.815776 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:03.815121 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:55:03.815776 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:03.815483 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:55:03.815776 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:03.815577 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:55:05.518469 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:05.517912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:55:05.518469 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:05.518048 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:55:05.518469 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:05.518121 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs podName:94ed26b6-3c80-446a-9d43-8fa9d78a5e13 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:37.518099822 +0000 UTC m=+66.184299618 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs") pod "network-metrics-daemon-mfdvb" (UID: "94ed26b6-3c80-446a-9d43-8fa9d78a5e13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:55:05.618216 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:05.618178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmkq\" (UniqueName: \"kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq\") pod \"network-check-target-hmn77\" (UID: \"70f39a44-5d89-41a9-8231-a54b49e3c8a3\") " pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:55:05.618437 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:05.618235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:55:05.618437 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:05.618358 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:55:05.618437 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:05.618387 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:55:05.618437 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:05.618417 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:55:05.618437 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:05.618424 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret podName:bdea4aec-b853-4f61-a9d2-8f49e919ff54 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:37.618406529 +0000 UTC m=+66.284606344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret") pod "global-pull-secret-syncer-75l44" (UID: "bdea4aec-b853-4f61-a9d2-8f49e919ff54") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:55:05.618437 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:05.618433 2580 projected.go:196] Error preparing data for projected volume kube-api-access-xlmkq for pod openshift-network-diagnostics/network-check-target-hmn77: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:55:05.618772 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:05.618490 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq podName:70f39a44-5d89-41a9-8231-a54b49e3c8a3 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:37.618472426 +0000 UTC m=+66.284672242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xlmkq" (UniqueName: "kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq") pod "network-check-target-hmn77" (UID: "70f39a44-5d89-41a9-8231-a54b49e3c8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:55:05.814640 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:05.814536 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:55:05.814640 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:05.814553 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:55:05.814640 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:05.814536 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:55:05.814878 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:05.814688 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmn77" podUID="70f39a44-5d89-41a9-8231-a54b49e3c8a3" Jun 04 23:55:05.814878 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:05.814723 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75l44" podUID="bdea4aec-b853-4f61-a9d2-8f49e919ff54" Jun 04 23:55:05.814878 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:05.814815 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:55:05.978283 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:05.978254 2580 generic.go:356] "Generic (PLEG): container finished" podID="b8b814b6-a60f-48c6-b54c-747d9e98255d" containerID="af0fec68942ab98816f400e7b5e1bc706dc6ae42378fdbe81be58a676d0feb18" exitCode=0 Jun 04 23:55:05.978457 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:05.978302 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" event={"ID":"b8b814b6-a60f-48c6-b54c-747d9e98255d","Type":"ContainerDied","Data":"af0fec68942ab98816f400e7b5e1bc706dc6ae42378fdbe81be58a676d0feb18"} Jun 04 23:55:06.119576 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.119372 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-106.ec2.internal" event="NodeReady" Jun 04 23:55:06.119576 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.119504 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 04 23:55:06.161339 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.161304 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vb5c9"] Jun 04 23:55:06.174186 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.174152 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kfcbd"] Jun 04 23:55:06.174330 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.174303 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.177085 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.177061 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 04 23:55:06.177197 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.177067 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 04 23:55:06.177197 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.177115 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zgf9w\"" Jun 04 23:55:06.186219 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.186197 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kfcbd"] Jun 04 23:55:06.186336 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.186227 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vb5c9"] Jun 04 23:55:06.186336 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.186304 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kfcbd" Jun 04 23:55:06.188687 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.188666 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 04 23:55:06.188687 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.188685 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n65nv\"" Jun 04 23:55:06.188824 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.188702 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 04 23:55:06.188824 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.188666 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 04 23:55:06.325388 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.325308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/657f2cdc-9bb9-473b-8995-d0d7dda848c6-tmp-dir\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.325388 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.325342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lkcv\" (UniqueName: \"kubernetes.io/projected/657f2cdc-9bb9-473b-8995-d0d7dda848c6-kube-api-access-5lkcv\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.325388 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.325360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/657f2cdc-9bb9-473b-8995-d0d7dda848c6-config-volume\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.325388 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.325387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dffd8526-aeb4-497c-8db8-baeb9210b45e-cert\") pod \"ingress-canary-kfcbd\" (UID: \"dffd8526-aeb4-497c-8db8-baeb9210b45e\") " pod="openshift-ingress-canary/ingress-canary-kfcbd" Jun 04 23:55:06.325720 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.325402 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv8nf\" (UniqueName: \"kubernetes.io/projected/dffd8526-aeb4-497c-8db8-baeb9210b45e-kube-api-access-kv8nf\") pod \"ingress-canary-kfcbd\" (UID: \"dffd8526-aeb4-497c-8db8-baeb9210b45e\") " pod="openshift-ingress-canary/ingress-canary-kfcbd" Jun 04 23:55:06.325720 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.325455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.426573 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.426535 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dffd8526-aeb4-497c-8db8-baeb9210b45e-cert\") pod \"ingress-canary-kfcbd\" (UID: \"dffd8526-aeb4-497c-8db8-baeb9210b45e\") " pod="openshift-ingress-canary/ingress-canary-kfcbd" Jun 04 23:55:06.426573 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.426574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv8nf\" (UniqueName: \"kubernetes.io/projected/dffd8526-aeb4-497c-8db8-baeb9210b45e-kube-api-access-kv8nf\") pod \"ingress-canary-kfcbd\" (UID: \"dffd8526-aeb4-497c-8db8-baeb9210b45e\") " pod="openshift-ingress-canary/ingress-canary-kfcbd" Jun 04 23:55:06.426845 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.426601 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.426845 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:06.426708 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:55:06.426845 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:06.426759 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls podName:657f2cdc-9bb9-473b-8995-d0d7dda848c6 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:06.92674306 +0000 UTC m=+35.592942856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls") pod "dns-default-vb5c9" (UID: "657f2cdc-9bb9-473b-8995-d0d7dda848c6") : secret "dns-default-metrics-tls" not found Jun 04 23:55:06.426845 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.426821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/657f2cdc-9bb9-473b-8995-d0d7dda848c6-tmp-dir\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.427090 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.426855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lkcv\" (UniqueName: \"kubernetes.io/projected/657f2cdc-9bb9-473b-8995-d0d7dda848c6-kube-api-access-5lkcv\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.427090 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.426876 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/657f2cdc-9bb9-473b-8995-d0d7dda848c6-config-volume\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.427177 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.427134 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/657f2cdc-9bb9-473b-8995-d0d7dda848c6-tmp-dir\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.427385 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.427368 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/657f2cdc-9bb9-473b-8995-d0d7dda848c6-config-volume\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.431125 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.431106 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dffd8526-aeb4-497c-8db8-baeb9210b45e-cert\") pod \"ingress-canary-kfcbd\" (UID: \"dffd8526-aeb4-497c-8db8-baeb9210b45e\") " pod="openshift-ingress-canary/ingress-canary-kfcbd" Jun 04 23:55:06.435749 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.435728 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lkcv\" (UniqueName: \"kubernetes.io/projected/657f2cdc-9bb9-473b-8995-d0d7dda848c6-kube-api-access-5lkcv\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.436219 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.436202 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv8nf\" (UniqueName: \"kubernetes.io/projected/dffd8526-aeb4-497c-8db8-baeb9210b45e-kube-api-access-kv8nf\") pod \"ingress-canary-kfcbd\" (UID: \"dffd8526-aeb4-497c-8db8-baeb9210b45e\") " pod="openshift-ingress-canary/ingress-canary-kfcbd" Jun 04 23:55:06.515267 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.515222 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kfcbd" Jun 04 23:55:06.692098 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.692049 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kfcbd"] Jun 04 23:55:06.696589 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:55:06.696442 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffd8526_aeb4_497c_8db8_baeb9210b45e.slice/crio-8f577eb69cb7ea46b3cba575ed173ee125594dec127172a522d7acd258dc1c8a WatchSource:0}: Error finding container 8f577eb69cb7ea46b3cba575ed173ee125594dec127172a522d7acd258dc1c8a: Status 404 returned error can't find the container with id 8f577eb69cb7ea46b3cba575ed173ee125594dec127172a522d7acd258dc1c8a Jun 04 23:55:06.930251 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.930170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:06.930409 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:06.930330 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:55:06.930409 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:06.930399 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls podName:657f2cdc-9bb9-473b-8995-d0d7dda848c6 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:07.930378226 +0000 UTC m=+36.596578039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls") pod "dns-default-vb5c9" (UID: "657f2cdc-9bb9-473b-8995-d0d7dda848c6") : secret "dns-default-metrics-tls" not found Jun 04 23:55:06.981792 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.981754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kfcbd" event={"ID":"dffd8526-aeb4-497c-8db8-baeb9210b45e","Type":"ContainerStarted","Data":"8f577eb69cb7ea46b3cba575ed173ee125594dec127172a522d7acd258dc1c8a"} Jun 04 23:55:06.986039 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.986003 2580 generic.go:356] "Generic (PLEG): container finished" podID="b8b814b6-a60f-48c6-b54c-747d9e98255d" containerID="f3487084de44b2383595ac2b2ee996bb76b36085454b04572e2f06ecf5973b4f" exitCode=0 Jun 04 23:55:06.986194 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:06.986057 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" event={"ID":"b8b814b6-a60f-48c6-b54c-747d9e98255d","Type":"ContainerDied","Data":"f3487084de44b2383595ac2b2ee996bb76b36085454b04572e2f06ecf5973b4f"} Jun 04 23:55:07.814634 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.814577 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:55:07.814634 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.814595 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:55:07.814634 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.814595 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:55:07.818507 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.818476 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 04 23:55:07.818507 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.818491 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l52sk\"" Jun 04 23:55:07.818507 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.818482 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 04 23:55:07.818771 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.818511 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 04 23:55:07.818771 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.818483 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 04 23:55:07.818771 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.818529 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7szf\"" Jun 04 23:55:07.876311 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.876276 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j"] Jun 04 23:55:07.908946 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.908905 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j"] Jun 04 23:55:07.908946 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.908950 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz"] Jun 04 23:55:07.909176 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.909046 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" Jun 04 23:55:07.911545 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.911522 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 04 23:55:07.911545 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.911535 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 04 23:55:07.911858 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.911844 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 04 23:55:07.911929 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.911888 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-zb958\"" Jun 04 23:55:07.911984 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.911894 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 04 23:55:07.925138 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.925073 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz"] Jun 04 23:55:07.925288 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.925163 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:07.936717 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.936683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:07.936867 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:07.936847 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:55:07.936953 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:07.936936 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls podName:657f2cdc-9bb9-473b-8995-d0d7dda848c6 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:09.936915037 +0000 UTC m=+38.603114847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls") pod "dns-default-vb5c9" (UID: "657f2cdc-9bb9-473b-8995-d0d7dda848c6") : secret "dns-default-metrics-tls" not found Jun 04 23:55:07.944058 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.944037 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 04 23:55:07.992906 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:07.992858 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" event={"ID":"b8b814b6-a60f-48c6-b54c-747d9e98255d","Type":"ContainerStarted","Data":"2c018d6ccb7f65686f7c6050514d375716981e78f7a30c5c1d1a5168556e107f"} Jun 04 23:55:08.013392 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.013339 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cd4jh" podStartSLOduration=8.892163831 podStartE2EDuration="37.013313719s" totalImagesPullingTime="28.121149888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:55:08.012132373 +0000 UTC m=+36.678332252" watchObservedRunningTime="2026-06-04 23:55:08.013313719 +0000 UTC m=+36.679513537" Jun 04 23:55:08.038058 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.038018 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae0e15ca-d4da-40dd-8b8c-df249b410fc3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59b6cbddbd-zg77j\" (UID: \"ae0e15ca-d4da-40dd-8b8c-df249b410fc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" Jun 04 23:55:08.038058 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.038067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n7z9\" (UniqueName: \"kubernetes.io/projected/5375af6f-0110-4b3c-b44a-614488ddf2db-kube-api-access-9n7z9\") pod \"klusterlet-addon-workmgr-7c4d496f98-kgfbz\" (UID: \"5375af6f-0110-4b3c-b44a-614488ddf2db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:08.038290 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.038101 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5375af6f-0110-4b3c-b44a-614488ddf2db-tmp\") pod \"klusterlet-addon-workmgr-7c4d496f98-kgfbz\" (UID: \"5375af6f-0110-4b3c-b44a-614488ddf2db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:08.038290 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.038129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dmpg\" (UniqueName: \"kubernetes.io/projected/ae0e15ca-d4da-40dd-8b8c-df249b410fc3-kube-api-access-5dmpg\") pod \"managed-serviceaccount-addon-agent-59b6cbddbd-zg77j\" (UID: \"ae0e15ca-d4da-40dd-8b8c-df249b410fc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" Jun 04 23:55:08.038290 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.038167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5375af6f-0110-4b3c-b44a-614488ddf2db-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c4d496f98-kgfbz\" (UID: \"5375af6f-0110-4b3c-b44a-614488ddf2db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:08.138828 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.138742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae0e15ca-d4da-40dd-8b8c-df249b410fc3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59b6cbddbd-zg77j\" (UID: \"ae0e15ca-d4da-40dd-8b8c-df249b410fc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" Jun 04 23:55:08.138828 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.138784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n7z9\" (UniqueName: \"kubernetes.io/projected/5375af6f-0110-4b3c-b44a-614488ddf2db-kube-api-access-9n7z9\") pod \"klusterlet-addon-workmgr-7c4d496f98-kgfbz\" (UID: \"5375af6f-0110-4b3c-b44a-614488ddf2db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:08.138828 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.138815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5375af6f-0110-4b3c-b44a-614488ddf2db-tmp\") pod \"klusterlet-addon-workmgr-7c4d496f98-kgfbz\" (UID: \"5375af6f-0110-4b3c-b44a-614488ddf2db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:08.139130 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.138847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dmpg\" (UniqueName: \"kubernetes.io/projected/ae0e15ca-d4da-40dd-8b8c-df249b410fc3-kube-api-access-5dmpg\") pod \"managed-serviceaccount-addon-agent-59b6cbddbd-zg77j\" (UID: \"ae0e15ca-d4da-40dd-8b8c-df249b410fc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" Jun 04 23:55:08.139130 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.138879 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5375af6f-0110-4b3c-b44a-614488ddf2db-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c4d496f98-kgfbz\" (UID: \"5375af6f-0110-4b3c-b44a-614488ddf2db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:08.139298 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.139272 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5375af6f-0110-4b3c-b44a-614488ddf2db-tmp\") pod \"klusterlet-addon-workmgr-7c4d496f98-kgfbz\" (UID: \"5375af6f-0110-4b3c-b44a-614488ddf2db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:08.142508 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.142470 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae0e15ca-d4da-40dd-8b8c-df249b410fc3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59b6cbddbd-zg77j\" (UID: \"ae0e15ca-d4da-40dd-8b8c-df249b410fc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" Jun 04 23:55:08.142649 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.142609 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5375af6f-0110-4b3c-b44a-614488ddf2db-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c4d496f98-kgfbz\" (UID: \"5375af6f-0110-4b3c-b44a-614488ddf2db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:08.154343 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.154317 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dmpg\" (UniqueName: \"kubernetes.io/projected/ae0e15ca-d4da-40dd-8b8c-df249b410fc3-kube-api-access-5dmpg\") pod \"managed-serviceaccount-addon-agent-59b6cbddbd-zg77j\" (UID: \"ae0e15ca-d4da-40dd-8b8c-df249b410fc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" Jun 04 23:55:08.154470 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.154453 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n7z9\" (UniqueName: \"kubernetes.io/projected/5375af6f-0110-4b3c-b44a-614488ddf2db-kube-api-access-9n7z9\") pod \"klusterlet-addon-workmgr-7c4d496f98-kgfbz\" (UID: \"5375af6f-0110-4b3c-b44a-614488ddf2db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:08.229677 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.229634 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" Jun 04 23:55:08.251796 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.251756 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:08.491019 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.490983 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j"] Jun 04 23:55:08.493653 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.493628 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz"] Jun 04 23:55:08.574121 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:55:08.574089 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae0e15ca_d4da_40dd_8b8c_df249b410fc3.slice/crio-eca1c16f7749e2ca0105c1e7ae63325fb1382c731d55b0342205656de5e04bb0 WatchSource:0}: Error finding container eca1c16f7749e2ca0105c1e7ae63325fb1382c731d55b0342205656de5e04bb0: Status 404 returned error can't find the container with id eca1c16f7749e2ca0105c1e7ae63325fb1382c731d55b0342205656de5e04bb0 Jun 04 23:55:08.574601 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:55:08.574579 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5375af6f_0110_4b3c_b44a_614488ddf2db.slice/crio-d2c573cd8ddf445d0597e9dbcc255c157fcfa5a50e6ef7830e4a57c1b1dfe5b2 WatchSource:0}: Error finding container d2c573cd8ddf445d0597e9dbcc255c157fcfa5a50e6ef7830e4a57c1b1dfe5b2: Status 404 returned error can't find the container with id d2c573cd8ddf445d0597e9dbcc255c157fcfa5a50e6ef7830e4a57c1b1dfe5b2 Jun 04 23:55:08.996470 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.996271 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" event={"ID":"ae0e15ca-d4da-40dd-8b8c-df249b410fc3","Type":"ContainerStarted","Data":"eca1c16f7749e2ca0105c1e7ae63325fb1382c731d55b0342205656de5e04bb0"} Jun 04 23:55:08.997805 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.997777 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kfcbd" event={"ID":"dffd8526-aeb4-497c-8db8-baeb9210b45e","Type":"ContainerStarted","Data":"4df69a0ef6cb7e2f2eb2f2d4bbc449d35249adcfe154eee5b0639707075d88c2"} Jun 04 23:55:08.998941 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:08.998909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" event={"ID":"5375af6f-0110-4b3c-b44a-614488ddf2db","Type":"ContainerStarted","Data":"d2c573cd8ddf445d0597e9dbcc255c157fcfa5a50e6ef7830e4a57c1b1dfe5b2"} Jun 04 23:55:09.012566 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:09.012384 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kfcbd" podStartSLOduration=1.116435131 podStartE2EDuration="3.012366246s" totalImagesPullingTime="1.895931115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:55:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:55:09.011836174 +0000 UTC m=+37.678035999" watchObservedRunningTime="2026-06-04 23:55:09.012366246 +0000 UTC m=+37.678566062" Jun 04 23:55:09.955966 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:09.955928 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:09.956167 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:09.956092 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:55:09.956167 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:09.956154 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls podName:657f2cdc-9bb9-473b-8995-d0d7dda848c6 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:13.956135993 +0000 UTC m=+42.622335790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls") pod "dns-default-vb5c9" (UID: "657f2cdc-9bb9-473b-8995-d0d7dda848c6") : secret "dns-default-metrics-tls" not found Jun 04 23:55:13.987470 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:13.987435 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:13.987868 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:13.987602 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:55:13.987868 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:13.987693 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls podName:657f2cdc-9bb9-473b-8995-d0d7dda848c6 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:21.987674256 +0000 UTC m=+50.653874067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls") pod "dns-default-vb5c9" (UID: "657f2cdc-9bb9-473b-8995-d0d7dda848c6") : secret "dns-default-metrics-tls" not found Jun 04 23:55:14.014014 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:14.013970 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" event={"ID":"ae0e15ca-d4da-40dd-8b8c-df249b410fc3","Type":"ContainerStarted","Data":"fd55e63c647ed2324193354442f0af3751d9f68bf9b4277c8e21c4a1964aa571"} Jun 04 23:55:14.032177 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:14.032123 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" podStartSLOduration=1.7356238959999999 podStartE2EDuration="7.032105701s" totalImagesPullingTime="5.296481805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:55:14.030500071 +0000 UTC m=+42.696699891" watchObservedRunningTime="2026-06-04 23:55:14.032105701 +0000 UTC m=+42.698305518" Jun 04 23:55:15.018391 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:15.018351 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" event={"ID":"5375af6f-0110-4b3c-b44a-614488ddf2db","Type":"ContainerStarted","Data":"f33416733265239b4e822a8a1ae6088633abf51ec30bc9b7885da677adc3cbab"} Jun 04 23:55:15.018820 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:15.018415 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:15.020147 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:15.020124 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:55:15.037265 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:15.037214 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" podStartSLOduration=2.318809452 podStartE2EDuration="8.037197855s" totalImagesPullingTime="5.718388403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:55:15.036247059 +0000 UTC m=+43.702446876" watchObservedRunningTime="2026-06-04 23:55:15.037197855 +0000 UTC m=+43.703397673" Jun 04 23:55:22.040040 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:22.040006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:22.040417 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:22.040159 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:55:22.040417 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:22.040225 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls podName:657f2cdc-9bb9-473b-8995-d0d7dda848c6 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:38.040209547 +0000 UTC m=+66.706409344 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls") pod "dns-default-vb5c9" (UID: "657f2cdc-9bb9-473b-8995-d0d7dda848c6") : secret "dns-default-metrics-tls" not found Jun 04 23:55:31.976978 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:31.976951 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx6tr" Jun 04 23:55:37.550424 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.550390 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:55:37.552981 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.552960 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 04 23:55:37.560887 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:37.560862 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 04 23:55:37.560978 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:37.560937 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs podName:94ed26b6-3c80-446a-9d43-8fa9d78a5e13 nodeName:}" failed. No retries permitted until 2026-06-04 23:56:41.560920057 +0000 UTC m=+130.227119856 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs") pod "network-metrics-daemon-mfdvb" (UID: "94ed26b6-3c80-446a-9d43-8fa9d78a5e13") : secret "metrics-daemon-secret" not found Jun 04 23:55:37.651321 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.651279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmkq\" (UniqueName: \"kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq\") pod \"network-check-target-hmn77\" (UID: \"70f39a44-5d89-41a9-8231-a54b49e3c8a3\") " pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:55:37.651487 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.651331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:55:37.654083 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.654060 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 04 23:55:37.654083 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.654078 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 04 23:55:37.663964 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.663939 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 04 23:55:37.665081 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.665061 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bdea4aec-b853-4f61-a9d2-8f49e919ff54-original-pull-secret\") pod \"global-pull-secret-syncer-75l44\" (UID: \"bdea4aec-b853-4f61-a9d2-8f49e919ff54\") " pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:55:37.674925 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.674900 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlmkq\" (UniqueName: \"kubernetes.io/projected/70f39a44-5d89-41a9-8231-a54b49e3c8a3-kube-api-access-xlmkq\") pod \"network-check-target-hmn77\" (UID: \"70f39a44-5d89-41a9-8231-a54b49e3c8a3\") " pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:55:37.834850 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.834769 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7szf\"" Jun 04 23:55:37.836878 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.836862 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75l44" Jun 04 23:55:37.842169 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:37.842151 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:55:38.021749 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:38.021718 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-75l44"] Jun 04 23:55:38.025219 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:55:38.025191 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdea4aec_b853_4f61_a9d2_8f49e919ff54.slice/crio-788b361518b93855f180b117cd390adc9f9abcac0b30469131b06ab1f47bfb2b WatchSource:0}: Error finding container 788b361518b93855f180b117cd390adc9f9abcac0b30469131b06ab1f47bfb2b: Status 404 returned error can't find the container with id 788b361518b93855f180b117cd390adc9f9abcac0b30469131b06ab1f47bfb2b Jun 04 23:55:38.038839 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:38.038813 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hmn77"] Jun 04 23:55:38.041652 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:55:38.041611 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f39a44_5d89_41a9_8231_a54b49e3c8a3.slice/crio-3fbeda69b4e97f84e398862b7ea89b0c4ac4b94575c2969d6a5b9cd8673aa0dc WatchSource:0}: Error finding container 3fbeda69b4e97f84e398862b7ea89b0c4ac4b94575c2969d6a5b9cd8673aa0dc: Status 404 returned error can't find the container with id 3fbeda69b4e97f84e398862b7ea89b0c4ac4b94575c2969d6a5b9cd8673aa0dc Jun 04 23:55:38.054837 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:38.054811 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:55:38.054986 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:38.054969 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:55:38.055044 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:55:38.055034 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls podName:657f2cdc-9bb9-473b-8995-d0d7dda848c6 nodeName:}" failed. No retries permitted until 2026-06-04 23:56:10.055014399 +0000 UTC m=+98.721214213 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls") pod "dns-default-vb5c9" (UID: "657f2cdc-9bb9-473b-8995-d0d7dda848c6") : secret "dns-default-metrics-tls" not found Jun 04 23:55:38.073525 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:38.073486 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hmn77" event={"ID":"70f39a44-5d89-41a9-8231-a54b49e3c8a3","Type":"ContainerStarted","Data":"3fbeda69b4e97f84e398862b7ea89b0c4ac4b94575c2969d6a5b9cd8673aa0dc"} Jun 04 23:55:38.074533 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:38.074511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-75l44" event={"ID":"bdea4aec-b853-4f61-a9d2-8f49e919ff54","Type":"ContainerStarted","Data":"788b361518b93855f180b117cd390adc9f9abcac0b30469131b06ab1f47bfb2b"} Jun 04 23:55:43.091936 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:43.091891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hmn77" event={"ID":"70f39a44-5d89-41a9-8231-a54b49e3c8a3","Type":"ContainerStarted","Data":"5b03042e2c1837f4c970a3f959a40b8edbf84111be67c6859febbff0139dab14"} Jun 04 23:55:43.092416 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:43.092004 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:55:43.093451 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:43.093432 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-75l44" event={"ID":"bdea4aec-b853-4f61-a9d2-8f49e919ff54","Type":"ContainerStarted","Data":"68ce8fd753e49f4ee1b44047a40c8e2bc4c3d6b3338635819df52a5302e040c6"} Jun 04 23:55:43.106689 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:43.106645 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hmn77" podStartSLOduration=67.843574649 podStartE2EDuration="1m12.106610942s" totalImagesPullingTime="4.263036293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:55:43.10570506 +0000 UTC m=+71.771904899" watchObservedRunningTime="2026-06-04 23:55:43.106610942 +0000 UTC m=+71.772810805" Jun 04 23:55:43.120075 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:55:43.120027 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-75l44" podStartSLOduration=66.835913904 podStartE2EDuration="1m11.120009896s" totalImagesPullingTime="4.284095992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:55:43.119365561 +0000 UTC m=+71.785565402" watchObservedRunningTime="2026-06-04 23:55:43.120009896 +0000 UTC m=+71.786209713" Jun 04 23:56:10.075662 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:56:10.075538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:56:10.076081 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:56:10.075711 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:56:10.076081 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:56:10.075776 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls podName:657f2cdc-9bb9-473b-8995-d0d7dda848c6 nodeName:}" failed. No retries permitted until 2026-06-04 23:57:14.07576108 +0000 UTC m=+162.741960879 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls") pod "dns-default-vb5c9" (UID: "657f2cdc-9bb9-473b-8995-d0d7dda848c6") : secret "dns-default-metrics-tls" not found Jun 04 23:56:14.099564 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:56:14.099535 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hmn77" Jun 04 23:56:41.591289 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:56:41.591249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:56:41.591801 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:56:41.591407 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 04 23:56:41.591801 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:56:41.591477 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs podName:94ed26b6-3c80-446a-9d43-8fa9d78a5e13 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:43.591460491 +0000 UTC m=+252.257660287 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs") pod "network-metrics-daemon-mfdvb" (UID: "94ed26b6-3c80-446a-9d43-8fa9d78a5e13") : secret "metrics-daemon-secret" not found Jun 04 23:57:09.211441 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:57:09.211394 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vb5c9" podUID="657f2cdc-9bb9-473b-8995-d0d7dda848c6" Jun 04 23:57:09.335871 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:09.335843 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vb5c9" Jun 04 23:57:10.826120 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:57:10.826068 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:57:14.118739 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:14.118701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:57:14.119135 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:57:14.118841 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:57:14.119135 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:57:14.118916 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls podName:657f2cdc-9bb9-473b-8995-d0d7dda848c6 nodeName:}" failed. No retries permitted until 2026-06-04 23:59:16.118895472 +0000 UTC m=+284.785095277 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls") pod "dns-default-vb5c9" (UID: "657f2cdc-9bb9-473b-8995-d0d7dda848c6") : secret "dns-default-metrics-tls" not found Jun 04 23:57:14.351860 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:14.351771 2580 generic.go:356] "Generic (PLEG): container finished" podID="ae0e15ca-d4da-40dd-8b8c-df249b410fc3" containerID="fd55e63c647ed2324193354442f0af3751d9f68bf9b4277c8e21c4a1964aa571" exitCode=255 Jun 04 23:57:14.351860 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:14.351842 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" event={"ID":"ae0e15ca-d4da-40dd-8b8c-df249b410fc3","Type":"ContainerDied","Data":"fd55e63c647ed2324193354442f0af3751d9f68bf9b4277c8e21c4a1964aa571"} Jun 04 23:57:14.357569 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:14.357549 2580 scope.go:117] "RemoveContainer" containerID="fd55e63c647ed2324193354442f0af3751d9f68bf9b4277c8e21c4a1964aa571" Jun 04 23:57:15.019020 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:15.018966 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" podUID="5375af6f-0110-4b3c-b44a-614488ddf2db" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.9:8000/readyz\": dial tcp 10.134.0.9:8000: connect: connection refused" Jun 04 23:57:15.356345 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:15.356256 2580 generic.go:356] "Generic (PLEG): container finished" podID="5375af6f-0110-4b3c-b44a-614488ddf2db" containerID="f33416733265239b4e822a8a1ae6088633abf51ec30bc9b7885da677adc3cbab" exitCode=1 Jun 04 23:57:15.356345 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:15.356325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" event={"ID":"5375af6f-0110-4b3c-b44a-614488ddf2db","Type":"ContainerDied","Data":"f33416733265239b4e822a8a1ae6088633abf51ec30bc9b7885da677adc3cbab"} Jun 04 23:57:15.356865 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:15.356706 2580 scope.go:117] "RemoveContainer" containerID="f33416733265239b4e822a8a1ae6088633abf51ec30bc9b7885da677adc3cbab" Jun 04 23:57:15.358027 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:15.358007 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" event={"ID":"ae0e15ca-d4da-40dd-8b8c-df249b410fc3","Type":"ContainerStarted","Data":"cfcfa190fce9361adbe3548d769db5d7a89dbe62db8e33767a5dce6b34fb61b4"} Jun 04 23:57:16.362869 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:16.362834 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" event={"ID":"5375af6f-0110-4b3c-b44a-614488ddf2db","Type":"ContainerStarted","Data":"6fb6001ed4a273651b1e9489e8e54a7ad80330b64f72c700c9971a8b4686cda4"} Jun 04 23:57:16.363352 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:16.363119 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:57:16.363707 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:16.363689 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:57:25.814549 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:57:25.814513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:58:27.977786 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:27.977751 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56fcb5d7dc-jql6d"] Jun 04 23:58:27.980876 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:27.980855 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:27.983930 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:27.983908 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r5892\"" Jun 04 23:58:27.984117 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:27.983911 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 04 23:58:27.984117 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:27.983911 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 04 23:58:27.984117 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:27.983913 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 04 23:58:27.989039 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:27.989017 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 04 23:58:28.017209 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.017179 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56fcb5d7dc-jql6d"] Jun 04 23:58:28.076979 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.076944 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-s4xxl"] Jun 04 23:58:28.079973 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.079955 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-s4xxl" Jun 04 23:58:28.083763 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.083745 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wj5qj\"" Jun 04 23:58:28.096434 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.096402 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-s4xxl"] Jun 04 23:58:28.144431 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.144392 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-trusted-ca\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.144431 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.144432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-image-registry-private-configuration\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.144688 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.144474 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-installation-pull-secrets\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.144688 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.144533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-registry-certificates\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.144688 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.144570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-bound-sa-token\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.144688 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.144597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbf2a486-6415-406c-95b4-0706467dc14d-ca-trust-extracted\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.144834 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.144687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.144834 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.144705 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzrqt\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-kube-api-access-rzrqt\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.245311 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.245227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.245311 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.245259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzrqt\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-kube-api-access-rzrqt\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.245311 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.245277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-trusted-ca\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.245311 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.245295 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-image-registry-private-configuration\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.245667 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.245324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-installation-pull-secrets\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.245667 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.245350 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-registry-certificates\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.245667 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.245393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-bound-sa-token\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.245667 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:28.245393 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:58:28.245667 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:28.245415 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56fcb5d7dc-jql6d: secret "image-registry-tls" not found Jun 04 23:58:28.245667 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.245419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbf2a486-6415-406c-95b4-0706467dc14d-ca-trust-extracted\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.245667 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.245447 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppx5b\" (UniqueName: \"kubernetes.io/projected/2bc1016f-ddb7-4d65-87dc-d3f532e9dab3-kube-api-access-ppx5b\") pod \"network-check-source-dbd9cf844-s4xxl\" (UID: \"2bc1016f-ddb7-4d65-87dc-d3f532e9dab3\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-s4xxl" Jun 04 23:58:28.245667 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:28.245476 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls podName:cbf2a486-6415-406c-95b4-0706467dc14d nodeName:}" failed. No retries permitted until 2026-06-04 23:58:28.745455477 +0000 UTC m=+237.411655278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls") pod "image-registry-56fcb5d7dc-jql6d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d") : secret "image-registry-tls" not found Jun 04 23:58:28.246031 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.245913 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbf2a486-6415-406c-95b4-0706467dc14d-ca-trust-extracted\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.246148 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.246123 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-registry-certificates\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.246356 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.246338 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-trusted-ca\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.247730 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.247711 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-image-registry-private-configuration\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.247842 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.247827 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-installation-pull-secrets\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.253559 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.253533 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzrqt\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-kube-api-access-rzrqt\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.254589 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.254567 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-bound-sa-token\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.346549 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.346516 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppx5b\" (UniqueName: \"kubernetes.io/projected/2bc1016f-ddb7-4d65-87dc-d3f532e9dab3-kube-api-access-ppx5b\") pod \"network-check-source-dbd9cf844-s4xxl\" (UID: \"2bc1016f-ddb7-4d65-87dc-d3f532e9dab3\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-s4xxl" Jun 04 23:58:28.355195 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.355168 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppx5b\" (UniqueName: \"kubernetes.io/projected/2bc1016f-ddb7-4d65-87dc-d3f532e9dab3-kube-api-access-ppx5b\") pod \"network-check-source-dbd9cf844-s4xxl\" (UID: \"2bc1016f-ddb7-4d65-87dc-d3f532e9dab3\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-s4xxl" Jun 04 23:58:28.388098 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.388030 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-s4xxl" Jun 04 23:58:28.511872 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.511790 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-s4xxl"] Jun 04 23:58:28.514989 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:58:28.514961 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc1016f_ddb7_4d65_87dc_d3f532e9dab3.slice/crio-c68a3b420a61dc735a7a665ed90f861fb1c0f798ba5151fc7daa0613af5c70d7 WatchSource:0}: Error finding container c68a3b420a61dc735a7a665ed90f861fb1c0f798ba5151fc7daa0613af5c70d7: Status 404 returned error can't find the container with id c68a3b420a61dc735a7a665ed90f861fb1c0f798ba5151fc7daa0613af5c70d7 Jun 04 23:58:28.578718 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.578685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-s4xxl" event={"ID":"2bc1016f-ddb7-4d65-87dc-d3f532e9dab3","Type":"ContainerStarted","Data":"81afd69f7665b3c3adaa55ad2225df90b0ba37a64e001d56d1386973964353aa"} Jun 04 23:58:28.578843 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.578738 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-s4xxl" event={"ID":"2bc1016f-ddb7-4d65-87dc-d3f532e9dab3","Type":"ContainerStarted","Data":"c68a3b420a61dc735a7a665ed90f861fb1c0f798ba5151fc7daa0613af5c70d7"} Jun 04 23:58:28.593342 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.593290 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-s4xxl" podStartSLOduration=0.593274646 podStartE2EDuration="593.274646ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:28.592576903 +0000 UTC m=+237.258776739" watchObservedRunningTime="2026-06-04 23:58:28.593274646 +0000 UTC m=+237.259474464" Jun 04 23:58:28.750140 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:28.750091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:28.750311 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:28.750237 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:58:28.750311 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:28.750257 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56fcb5d7dc-jql6d: secret "image-registry-tls" not found Jun 04 23:58:28.750381 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:28.750316 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls podName:cbf2a486-6415-406c-95b4-0706467dc14d nodeName:}" failed. No retries permitted until 2026-06-04 23:58:29.750300537 +0000 UTC m=+238.416500333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls") pod "image-registry-56fcb5d7dc-jql6d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d") : secret "image-registry-tls" not found Jun 04 23:58:29.758280 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:29.758234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:29.758693 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:29.758361 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:58:29.758693 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:29.758373 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56fcb5d7dc-jql6d: secret "image-registry-tls" not found Jun 04 23:58:29.758693 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:29.758422 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls podName:cbf2a486-6415-406c-95b4-0706467dc14d nodeName:}" failed. No retries permitted until 2026-06-04 23:58:31.75840942 +0000 UTC m=+240.424609216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls") pod "image-registry-56fcb5d7dc-jql6d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d") : secret "image-registry-tls" not found Jun 04 23:58:31.772968 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:31.772940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:31.773351 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:31.773079 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:58:31.773351 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:31.773094 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56fcb5d7dc-jql6d: secret "image-registry-tls" not found Jun 04 23:58:31.773351 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:31.773150 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls podName:cbf2a486-6415-406c-95b4-0706467dc14d nodeName:}" failed. No retries permitted until 2026-06-04 23:58:35.773135713 +0000 UTC m=+244.439335513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls") pod "image-registry-56fcb5d7dc-jql6d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d") : secret "image-registry-tls" not found Jun 04 23:58:34.180765 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:34.180738 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jslst_12da72fc-3b84-4c07-b99c-ffe403e16866/dns-node-resolver/0.log" Jun 04 23:58:35.181242 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.181212 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5snc_09fa269c-7602-4596-9168-16eeee6b7f58/node-ca/0.log" Jun 04 23:58:35.438418 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.438337 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2v7gz"] Jun 04 23:58:35.442483 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.442462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" Jun 04 23:58:35.444704 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.444684 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 04 23:58:35.445591 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.445570 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 04 23:58:35.445701 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.445633 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 04 23:58:35.445701 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.445673 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vpqmf\"" Jun 04 23:58:35.445701 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.445676 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 04 23:58:35.450997 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.450979 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2v7gz"] Jun 04 23:58:35.600908 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.600877 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d-signing-cabundle\") pod \"service-ca-7d74d578b8-2v7gz\" (UID: \"fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d\") " pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" Jun 04 23:58:35.600908 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.600912 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kmlc\" (UniqueName: \"kubernetes.io/projected/fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d-kube-api-access-4kmlc\") pod \"service-ca-7d74d578b8-2v7gz\" (UID: \"fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d\") " pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" Jun 04 23:58:35.601089 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.600940 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d-signing-key\") pod \"service-ca-7d74d578b8-2v7gz\" (UID: \"fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d\") " pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" Jun 04 23:58:35.701315 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.701292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d-signing-cabundle\") pod \"service-ca-7d74d578b8-2v7gz\" (UID: \"fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d\") " pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" Jun 04 23:58:35.701406 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.701324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kmlc\" (UniqueName: \"kubernetes.io/projected/fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d-kube-api-access-4kmlc\") pod \"service-ca-7d74d578b8-2v7gz\" (UID: \"fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d\") " pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" Jun 04 23:58:35.701406 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.701342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d-signing-key\") pod \"service-ca-7d74d578b8-2v7gz\" (UID: \"fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d\") " pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" Jun 04 23:58:35.701941 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.701923 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d-signing-cabundle\") pod \"service-ca-7d74d578b8-2v7gz\" (UID: \"fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d\") " pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" Jun 04 23:58:35.703610 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.703594 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d-signing-key\") pod \"service-ca-7d74d578b8-2v7gz\" (UID: \"fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d\") " pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" Jun 04 23:58:35.710075 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.710049 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kmlc\" (UniqueName: \"kubernetes.io/projected/fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d-kube-api-access-4kmlc\") pod \"service-ca-7d74d578b8-2v7gz\" (UID: \"fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d\") " pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" Jun 04 23:58:35.752729 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.752702 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" Jun 04 23:58:35.801976 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.801944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:35.802130 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:35.802108 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:58:35.802187 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:35.802135 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56fcb5d7dc-jql6d: secret "image-registry-tls" not found Jun 04 23:58:35.802224 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:35.802214 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls podName:cbf2a486-6415-406c-95b4-0706467dc14d nodeName:}" failed. No retries permitted until 2026-06-04 23:58:43.802192496 +0000 UTC m=+252.468392318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls") pod "image-registry-56fcb5d7dc-jql6d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d") : secret "image-registry-tls" not found Jun 04 23:58:35.870266 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:35.870232 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2v7gz"] Jun 04 23:58:35.872713 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:58:35.872685 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb4b4a0_0bca_4014_ab67_9ad3ed7e698d.slice/crio-2be7c3ce1766451693c05103d5bceae0a010a80d0ba28d0d0fd72a171bd60db7 WatchSource:0}: Error finding container 2be7c3ce1766451693c05103d5bceae0a010a80d0ba28d0d0fd72a171bd60db7: Status 404 returned error can't find the container with id 2be7c3ce1766451693c05103d5bceae0a010a80d0ba28d0d0fd72a171bd60db7 Jun 04 23:58:36.181081 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:36.180999 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kfcbd_dffd8526-aeb4-497c-8db8-baeb9210b45e/serve-healthcheck-canary/0.log" Jun 04 23:58:36.601198 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:36.601164 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" event={"ID":"fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d","Type":"ContainerStarted","Data":"2be7c3ce1766451693c05103d5bceae0a010a80d0ba28d0d0fd72a171bd60db7"} Jun 04 23:58:38.608551 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:38.608514 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" event={"ID":"fbb4b4a0-0bca-4014-ab67-9ad3ed7e698d","Type":"ContainerStarted","Data":"c0d287f37b1fa82e3a65f00cbb28e204a77d4335ed6a0a035c1f1c4fd3d1b92c"} Jun 04 23:58:43.656763 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:43.656671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 04 23:58:43.657222 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:43.656803 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 04 23:58:43.657222 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:58:43.656878 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs podName:94ed26b6-3c80-446a-9d43-8fa9d78a5e13 nodeName:}" failed. No retries permitted until 2026-06-05 00:00:45.656856661 +0000 UTC m=+374.323056474 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs") pod "network-metrics-daemon-mfdvb" (UID: "94ed26b6-3c80-446a-9d43-8fa9d78a5e13") : secret "metrics-daemon-secret" not found Jun 04 23:58:43.858875 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:43.858842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:43.861174 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:43.861151 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls\") pod \"image-registry-56fcb5d7dc-jql6d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:43.892183 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:43.892150 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r5892\"" Jun 04 23:58:43.901082 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:43.901044 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:44.030114 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:44.029927 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-2v7gz" podStartSLOduration=6.897632394 podStartE2EDuration="9.029907591s" totalImagesPullingTime="2.132275197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:38.62229573 +0000 UTC m=+247.288495569" watchObservedRunningTime="2026-06-04 23:58:44.029907591 +0000 UTC m=+252.696107409" Jun 04 23:58:44.030985 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:44.030960 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56fcb5d7dc-jql6d"] Jun 04 23:58:44.034170 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:58:44.034140 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf2a486_6415_406c_95b4_0706467dc14d.slice/crio-6a47f8e26051382455c204515c32451df2224d4281cf861152788f066d0c0bda WatchSource:0}: Error finding container 6a47f8e26051382455c204515c32451df2224d4281cf861152788f066d0c0bda: Status 404 returned error can't find the container with id 6a47f8e26051382455c204515c32451df2224d4281cf861152788f066d0c0bda Jun 04 23:58:44.628231 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:44.628197 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" event={"ID":"cbf2a486-6415-406c-95b4-0706467dc14d","Type":"ContainerStarted","Data":"6b350d1cab689b4fbd181495aefee571722bd375f22b12146ec450f52876561e"} Jun 04 23:58:44.628442 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:44.628257 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" event={"ID":"cbf2a486-6415-406c-95b4-0706467dc14d","Type":"ContainerStarted","Data":"6a47f8e26051382455c204515c32451df2224d4281cf861152788f066d0c0bda"} Jun 04 23:58:44.628442 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:44.628311 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:58:44.647046 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:44.646999 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" podStartSLOduration=17.646983046 podStartE2EDuration="17.646983046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:44.645839742 +0000 UTC m=+253.312039560" watchObservedRunningTime="2026-06-04 23:58:44.646983046 +0000 UTC m=+253.313182863" Jun 04 23:58:56.936958 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:56.936910 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q6jnp"] Jun 04 23:58:56.943624 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:56.943578 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:56.947045 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:56.947018 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 04 23:58:56.947045 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:56.947032 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 04 23:58:56.947045 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:56.947018 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6lqsc\"" Jun 04 23:58:56.947300 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:56.947058 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 04 23:58:56.947300 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:56.947060 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 04 23:58:56.950607 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:56.950584 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q6jnp"] Jun 04 23:58:57.051717 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.051679 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56fcb5d7dc-jql6d"] Jun 04 23:58:57.055597 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.055568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37935c87-d716-4a42-b5dc-b53fdb3dee29-data-volume\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.055765 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.055645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37935c87-d716-4a42-b5dc-b53fdb3dee29-crio-socket\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.055765 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.055711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37935c87-d716-4a42-b5dc-b53fdb3dee29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.055765 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.055740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vnzm\" (UniqueName: \"kubernetes.io/projected/37935c87-d716-4a42-b5dc-b53fdb3dee29-kube-api-access-2vnzm\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.055765 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.055765 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37935c87-d716-4a42-b5dc-b53fdb3dee29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.085984 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.085951 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-697cc9c9dd-dd9sf"] Jun 04 23:58:57.088969 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.088952 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.101265 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.101239 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-697cc9c9dd-dd9sf"] Jun 04 23:58:57.157064 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157030 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37935c87-d716-4a42-b5dc-b53fdb3dee29-data-volume\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.157064 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157071 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d141eed4-8d62-4a3e-90e9-bb00959d151d-registry-certificates\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.157295 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157089 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d141eed4-8d62-4a3e-90e9-bb00959d151d-installation-pull-secrets\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.157295 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157106 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141eed4-8d62-4a3e-90e9-bb00959d151d-registry-tls\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.157295 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlhdw\" (UniqueName: \"kubernetes.io/projected/d141eed4-8d62-4a3e-90e9-bb00959d151d-kube-api-access-jlhdw\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.157295 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d141eed4-8d62-4a3e-90e9-bb00959d151d-bound-sa-token\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.157295 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157206 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d141eed4-8d62-4a3e-90e9-bb00959d151d-image-registry-private-configuration\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.157295 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157237 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d141eed4-8d62-4a3e-90e9-bb00959d151d-trusted-ca\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.157295 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37935c87-d716-4a42-b5dc-b53fdb3dee29-crio-socket\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.157295 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37935c87-d716-4a42-b5dc-b53fdb3dee29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.157660 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vnzm\" (UniqueName: \"kubernetes.io/projected/37935c87-d716-4a42-b5dc-b53fdb3dee29-kube-api-access-2vnzm\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.157660 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157371 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37935c87-d716-4a42-b5dc-b53fdb3dee29-crio-socket\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.157660 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157382 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37935c87-d716-4a42-b5dc-b53fdb3dee29-data-volume\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.157660 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37935c87-d716-4a42-b5dc-b53fdb3dee29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.157660 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d141eed4-8d62-4a3e-90e9-bb00959d151d-ca-trust-extracted\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.157862 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.157845 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37935c87-d716-4a42-b5dc-b53fdb3dee29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.159595 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.159572 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37935c87-d716-4a42-b5dc-b53fdb3dee29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.166332 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.166309 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vnzm\" (UniqueName: \"kubernetes.io/projected/37935c87-d716-4a42-b5dc-b53fdb3dee29-kube-api-access-2vnzm\") pod \"insights-runtime-extractor-q6jnp\" (UID: \"37935c87-d716-4a42-b5dc-b53fdb3dee29\") " pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.253757 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.253722 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q6jnp" Jun 04 23:58:57.258167 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.258140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d141eed4-8d62-4a3e-90e9-bb00959d151d-trusted-ca\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.258291 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.258205 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d141eed4-8d62-4a3e-90e9-bb00959d151d-ca-trust-extracted\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.258291 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.258272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d141eed4-8d62-4a3e-90e9-bb00959d151d-registry-certificates\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.258402 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.258299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d141eed4-8d62-4a3e-90e9-bb00959d151d-installation-pull-secrets\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.258402 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.258327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141eed4-8d62-4a3e-90e9-bb00959d151d-registry-tls\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.258402 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.258350 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlhdw\" (UniqueName: \"kubernetes.io/projected/d141eed4-8d62-4a3e-90e9-bb00959d151d-kube-api-access-jlhdw\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.258402 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.258389 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d141eed4-8d62-4a3e-90e9-bb00959d151d-bound-sa-token\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.258588 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.258420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d141eed4-8d62-4a3e-90e9-bb00959d151d-image-registry-private-configuration\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.258785 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.258751 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d141eed4-8d62-4a3e-90e9-bb00959d151d-ca-trust-extracted\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.259099 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.259078 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d141eed4-8d62-4a3e-90e9-bb00959d151d-registry-certificates\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.259340 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.259314 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d141eed4-8d62-4a3e-90e9-bb00959d151d-trusted-ca\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.261182 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.261161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d141eed4-8d62-4a3e-90e9-bb00959d151d-image-registry-private-configuration\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.261297 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.261275 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d141eed4-8d62-4a3e-90e9-bb00959d151d-installation-pull-secrets\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.261338 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.261300 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141eed4-8d62-4a3e-90e9-bb00959d151d-registry-tls\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.267036 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.267008 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d141eed4-8d62-4a3e-90e9-bb00959d151d-bound-sa-token\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.267145 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.267098 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlhdw\" (UniqueName: \"kubernetes.io/projected/d141eed4-8d62-4a3e-90e9-bb00959d151d-kube-api-access-jlhdw\") pod \"image-registry-697cc9c9dd-dd9sf\" (UID: \"d141eed4-8d62-4a3e-90e9-bb00959d151d\") " pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.381409 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.381377 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q6jnp"] Jun 04 23:58:57.384649 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:58:57.384599 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37935c87_d716_4a42_b5dc_b53fdb3dee29.slice/crio-1850c8a7ee774916b5bd34d0d8194873664433aedd50ad16098d5c486ee89c57 WatchSource:0}: Error finding container 1850c8a7ee774916b5bd34d0d8194873664433aedd50ad16098d5c486ee89c57: Status 404 returned error can't find the container with id 1850c8a7ee774916b5bd34d0d8194873664433aedd50ad16098d5c486ee89c57 Jun 04 23:58:57.397934 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.397913 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.530234 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.530149 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-697cc9c9dd-dd9sf"] Jun 04 23:58:57.532966 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:58:57.532941 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd141eed4_8d62_4a3e_90e9_bb00959d151d.slice/crio-baf8984936425d128eaf34cddb3a491df530bd5423b186bb54e0e07bdd975583 WatchSource:0}: Error finding container baf8984936425d128eaf34cddb3a491df530bd5423b186bb54e0e07bdd975583: Status 404 returned error can't find the container with id baf8984936425d128eaf34cddb3a491df530bd5423b186bb54e0e07bdd975583 Jun 04 23:58:57.668952 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.668920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" event={"ID":"d141eed4-8d62-4a3e-90e9-bb00959d151d","Type":"ContainerStarted","Data":"9f37b532b8688359b044614bc50b3e147d1abec8e86705364e422c671566c14d"} Jun 04 23:58:57.669150 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.668972 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" event={"ID":"d141eed4-8d62-4a3e-90e9-bb00959d151d","Type":"ContainerStarted","Data":"baf8984936425d128eaf34cddb3a491df530bd5423b186bb54e0e07bdd975583"} Jun 04 23:58:57.669150 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.669076 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:58:57.670382 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.670361 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q6jnp" event={"ID":"37935c87-d716-4a42-b5dc-b53fdb3dee29","Type":"ContainerStarted","Data":"e04adc26e2f3f840dc108cc236aec5dac28cafea5415aee295f1c59229f864fd"} Jun 04 23:58:57.670478 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:57.670407 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q6jnp" event={"ID":"37935c87-d716-4a42-b5dc-b53fdb3dee29","Type":"ContainerStarted","Data":"1850c8a7ee774916b5bd34d0d8194873664433aedd50ad16098d5c486ee89c57"} Jun 04 23:58:58.675872 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:58.675835 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q6jnp" event={"ID":"37935c87-d716-4a42-b5dc-b53fdb3dee29","Type":"ContainerStarted","Data":"32832a752fd96c8bc3fd147f51688d1620e5e2c83a2c4c477950c4f2a9110cea"} Jun 04 23:58:59.681093 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:59.681057 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q6jnp" event={"ID":"37935c87-d716-4a42-b5dc-b53fdb3dee29","Type":"ContainerStarted","Data":"3d21c35777ade2cd9232843ac94a9019b5d2060515ed3596e6da102cb28c8f2d"} Jun 04 23:58:59.698091 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:59.698047 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q6jnp" podStartSLOduration=1.712598075 podStartE2EDuration="3.69802944s" totalImagesPullingTime="1.985431365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:58:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:59.697746933 +0000 UTC m=+268.363946768" watchObservedRunningTime="2026-06-04 23:58:59.69802944 +0000 UTC m=+268.364229235" Jun 04 23:58:59.698266 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:58:59.698171 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" podStartSLOduration=2.698164342 podStartE2EDuration="2.698164342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:57.686641802 +0000 UTC m=+266.352841634" watchObservedRunningTime="2026-06-04 23:58:59.698164342 +0000 UTC m=+268.364364161" Jun 04 23:59:07.058583 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:07.058546 2580 patch_prober.go:28] interesting pod/image-registry-56fcb5d7dc-jql6d container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 04 23:59:07.059052 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:07.058635 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" podUID="cbf2a486-6415-406c-95b4-0706467dc14d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 04 23:59:10.532584 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.532542 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jkgwl"] Jun 04 23:59:10.536155 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.536131 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.539055 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.539035 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 04 23:59:10.539304 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.539277 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 04 23:59:10.539419 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.539279 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 04 23:59:10.539520 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.539312 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 04 23:59:10.540141 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.539998 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z57dz\"" Jun 04 23:59:10.540141 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.540009 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 04 23:59:10.540141 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.540051 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 04 23:59:10.661417 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.661384 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-metrics-client-ca\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.661417 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.661427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-accelerators-collector-config\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.661666 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.661468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbl6q\" (UniqueName: \"kubernetes.io/projected/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-kube-api-access-cbl6q\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.661666 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.661503 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-sys\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.661666 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.661541 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-textfile\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.661666 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.661586 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-wtmp\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.661666 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.661646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.661845 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.661681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-root\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.661845 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.661706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-tls\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.762646 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.762596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-metrics-client-ca\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.762848 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.762667 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-accelerators-collector-config\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.762848 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.762709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbl6q\" (UniqueName: \"kubernetes.io/projected/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-kube-api-access-cbl6q\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.762848 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.762757 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-sys\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.762848 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.762803 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-textfile\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.762848 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.762827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-wtmp\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.763097 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.762861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.763097 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.762891 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-root\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.763097 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.762915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-tls\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.763097 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:59:10.763049 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 04 23:59:10.763288 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:59:10.763109 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-tls podName:d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53 nodeName:}" failed. No retries permitted until 2026-06-04 23:59:11.263090493 +0000 UTC m=+279.929290296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-tls") pod "node-exporter-jkgwl" (UID: "d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53") : secret "node-exporter-tls" not found Jun 04 23:59:10.764117 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.764075 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-metrics-client-ca\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.764253 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.764236 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-wtmp\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.764549 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.764528 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-sys\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.764773 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.764755 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-accelerators-collector-config\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.764882 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.764801 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-textfile\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.765030 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.764838 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-root\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.767168 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.767134 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:10.772753 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:10.772728 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbl6q\" (UniqueName: \"kubernetes.io/projected/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-kube-api-access-cbl6q\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:11.267843 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:11.267802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-tls\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:11.270164 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:11.270131 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53-node-exporter-tls\") pod \"node-exporter-jkgwl\" (UID: \"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53\") " pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:11.448314 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:11.448280 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jkgwl" Jun 04 23:59:11.458871 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:59:11.458839 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ee0c18_fc4e_4c02_bf1c_62fabfd0cf53.slice/crio-6e65df62597df18bfbff8d399de4a97d135fe597d87138c0e9019ca6b2ff32ce WatchSource:0}: Error finding container 6e65df62597df18bfbff8d399de4a97d135fe597d87138c0e9019ca6b2ff32ce: Status 404 returned error can't find the container with id 6e65df62597df18bfbff8d399de4a97d135fe597d87138c0e9019ca6b2ff32ce Jun 04 23:59:11.719845 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:11.719807 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jkgwl" event={"ID":"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53","Type":"ContainerStarted","Data":"6e65df62597df18bfbff8d399de4a97d135fe597d87138c0e9019ca6b2ff32ce"} Jun 04 23:59:12.336817 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:59:12.336785 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vb5c9" podUID="657f2cdc-9bb9-473b-8995-d0d7dda848c6" Jun 04 23:59:12.724427 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:12.724388 2580 generic.go:356] "Generic (PLEG): container finished" podID="d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53" containerID="6028a25c9cd908aaf84ddf087eb358e04c23dd24f1ec3c10d8f3b64f54ba968b" exitCode=0 Jun 04 23:59:12.724900 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:12.724482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jkgwl" event={"ID":"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53","Type":"ContainerDied","Data":"6028a25c9cd908aaf84ddf087eb358e04c23dd24f1ec3c10d8f3b64f54ba968b"} Jun 04 23:59:12.724900 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:12.724602 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vb5c9" Jun 04 23:59:13.731231 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:13.731192 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jkgwl" event={"ID":"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53","Type":"ContainerStarted","Data":"ce52ff7d5dbff44586ffc57d4f5af56aea61f4680713838f9cf717abcd16e140"} Jun 04 23:59:13.731662 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:13.731257 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jkgwl" event={"ID":"d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53","Type":"ContainerStarted","Data":"a8300794bd2d848437f2156063208e6bb77ad0f5a4828d603d02a92812c3aa1e"} Jun 04 23:59:13.749730 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:13.749680 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jkgwl" podStartSLOduration=2.875510782 podStartE2EDuration="3.749664425s" totalImagesPullingTime="808.200522ms" totalInitContainerRuntime="65.953121ms" isStatefulPod=true podCreationTimestamp="2026-06-04 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:13.749107198 +0000 UTC m=+282.415307040" watchObservedRunningTime="2026-06-04 23:59:13.749664425 +0000 UTC m=+282.415864242" Jun 04 23:59:14.736234 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:14.736142 2580 generic.go:356] "Generic (PLEG): container finished" podID="ae0e15ca-d4da-40dd-8b8c-df249b410fc3" containerID="cfcfa190fce9361adbe3548d769db5d7a89dbe62db8e33767a5dce6b34fb61b4" exitCode=255 Jun 04 23:59:14.736234 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:14.736205 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" event={"ID":"ae0e15ca-d4da-40dd-8b8c-df249b410fc3","Type":"ContainerDied","Data":"cfcfa190fce9361adbe3548d769db5d7a89dbe62db8e33767a5dce6b34fb61b4"} Jun 04 23:59:14.736771 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:14.736255 2580 scope.go:117] "RemoveContainer" containerID="fd55e63c647ed2324193354442f0af3751d9f68bf9b4277c8e21c4a1964aa571" Jun 04 23:59:14.742686 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:14.742664 2580 scope.go:117] "RemoveContainer" containerID="cfcfa190fce9361adbe3548d769db5d7a89dbe62db8e33767a5dce6b34fb61b4" Jun 04 23:59:14.742842 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:59:14.742825 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-59b6cbddbd-zg77j_open-cluster-management-agent-addon(ae0e15ca-d4da-40dd-8b8c-df249b410fc3)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" podUID="ae0e15ca-d4da-40dd-8b8c-df249b410fc3" Jun 04 23:59:15.719222 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.719189 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8699ccf564-w89p6"] Jun 04 23:59:15.722333 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.722316 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.724740 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.724716 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 04 23:59:15.724868 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.724825 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 04 23:59:15.724964 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.724950 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 04 23:59:15.725039 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.725027 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 04 23:59:15.725099 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.725062 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-s4wl2\"" Jun 04 23:59:15.725099 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.725075 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 04 23:59:15.729078 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.729060 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 04 23:59:15.733966 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.733941 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8699ccf564-w89p6"] Jun 04 23:59:15.741156 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.741130 2580 generic.go:356] "Generic (PLEG): container finished" podID="5375af6f-0110-4b3c-b44a-614488ddf2db" containerID="6fb6001ed4a273651b1e9489e8e54a7ad80330b64f72c700c9971a8b4686cda4" exitCode=1 Jun 04 23:59:15.741551 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.741212 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" event={"ID":"5375af6f-0110-4b3c-b44a-614488ddf2db","Type":"ContainerDied","Data":"6fb6001ed4a273651b1e9489e8e54a7ad80330b64f72c700c9971a8b4686cda4"} Jun 04 23:59:15.741551 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.741281 2580 scope.go:117] "RemoveContainer" containerID="f33416733265239b4e822a8a1ae6088633abf51ec30bc9b7885da677adc3cbab" Jun 04 23:59:15.741673 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.741647 2580 scope.go:117] "RemoveContainer" containerID="6fb6001ed4a273651b1e9489e8e54a7ad80330b64f72c700c9971a8b4686cda4" Jun 04 23:59:15.741867 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:59:15.741840 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7c4d496f98-kgfbz_open-cluster-management-agent-addon(5375af6f-0110-4b3c-b44a-614488ddf2db)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" podUID="5375af6f-0110-4b3c-b44a-614488ddf2db" Jun 04 23:59:15.803975 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.803864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.803975 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.803930 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1ce701c-f74c-4097-ac15-be05a541d3a6-metrics-client-ca\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.804216 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.804052 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-telemeter-client-tls\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.804216 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.804081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-federate-client-tls\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.804216 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.804105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ce701c-f74c-4097-ac15-be05a541d3a6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.804216 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.804196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-secret-telemeter-client\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.804443 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.804248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ce701c-f74c-4097-ac15-be05a541d3a6-serving-certs-ca-bundle\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.804443 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.804285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfgfc\" (UniqueName: \"kubernetes.io/projected/c1ce701c-f74c-4097-ac15-be05a541d3a6-kube-api-access-xfgfc\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.905231 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.905193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-telemeter-client-tls\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.905231 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.905231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-federate-client-tls\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.905429 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.905252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ce701c-f74c-4097-ac15-be05a541d3a6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.905429 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.905279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-secret-telemeter-client\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.905429 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.905301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ce701c-f74c-4097-ac15-be05a541d3a6-serving-certs-ca-bundle\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.905429 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.905334 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfgfc\" (UniqueName: \"kubernetes.io/projected/c1ce701c-f74c-4097-ac15-be05a541d3a6-kube-api-access-xfgfc\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.905429 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.905363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.905429 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.905401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1ce701c-f74c-4097-ac15-be05a541d3a6-metrics-client-ca\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.906270 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.906243 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ce701c-f74c-4097-ac15-be05a541d3a6-serving-certs-ca-bundle\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.906407 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.906278 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1ce701c-f74c-4097-ac15-be05a541d3a6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.906407 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.906387 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1ce701c-f74c-4097-ac15-be05a541d3a6-metrics-client-ca\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.907992 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.907969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-secret-telemeter-client\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.908084 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.907968 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-federate-client-tls\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.908132 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.908091 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.908132 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.908095 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c1ce701c-f74c-4097-ac15-be05a541d3a6-telemeter-client-tls\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:15.914599 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:15.914579 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfgfc\" (UniqueName: \"kubernetes.io/projected/c1ce701c-f74c-4097-ac15-be05a541d3a6-kube-api-access-xfgfc\") pod \"telemeter-client-8699ccf564-w89p6\" (UID: \"c1ce701c-f74c-4097-ac15-be05a541d3a6\") " pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:16.048304 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.048248 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" Jun 04 23:59:16.181544 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.181370 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8699ccf564-w89p6"] Jun 04 23:59:16.207267 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.207234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:59:16.209545 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.209526 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/657f2cdc-9bb9-473b-8995-d0d7dda848c6-metrics-tls\") pod \"dns-default-vb5c9\" (UID: \"657f2cdc-9bb9-473b-8995-d0d7dda848c6\") " pod="openshift-dns/dns-default-vb5c9" Jun 04 23:59:16.327486 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.327397 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zgf9w\"" Jun 04 23:59:16.335417 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.335392 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vb5c9" Jun 04 23:59:16.364083 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.364057 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:59:16.459432 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.459407 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vb5c9"] Jun 04 23:59:16.461588 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:59:16.461561 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657f2cdc_9bb9_473b_8995_d0d7dda848c6.slice/crio-e5dd5e16452bfda2d655ce44f9f43723ce6025cd093c2dc30c4ac497e51fd6ea WatchSource:0}: Error finding container e5dd5e16452bfda2d655ce44f9f43723ce6025cd093c2dc30c4ac497e51fd6ea: Status 404 returned error can't find the container with id e5dd5e16452bfda2d655ce44f9f43723ce6025cd093c2dc30c4ac497e51fd6ea Jun 04 23:59:16.746460 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.746423 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vb5c9" event={"ID":"657f2cdc-9bb9-473b-8995-d0d7dda848c6","Type":"ContainerStarted","Data":"e5dd5e16452bfda2d655ce44f9f43723ce6025cd093c2dc30c4ac497e51fd6ea"} Jun 04 23:59:16.747520 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.747500 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" event={"ID":"c1ce701c-f74c-4097-ac15-be05a541d3a6","Type":"ContainerStarted","Data":"5aee9790064d3760f17819a2761e640cac72d346b6f3a43d04fcfb7796bfccbc"} Jun 04 23:59:16.749128 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.749112 2580 scope.go:117] "RemoveContainer" containerID="6fb6001ed4a273651b1e9489e8e54a7ad80330b64f72c700c9971a8b4686cda4" Jun 04 23:59:16.749309 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:59:16.749293 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7c4d496f98-kgfbz_open-cluster-management-agent-addon(5375af6f-0110-4b3c-b44a-614488ddf2db)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" podUID="5375af6f-0110-4b3c-b44a-614488ddf2db" Jun 04 23:59:16.801055 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.801018 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 04 23:59:16.805139 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.805114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.807956 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.807742 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 04 23:59:16.808105 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.807974 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 04 23:59:16.808261 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.808239 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 04 23:59:16.808742 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.808636 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 04 23:59:16.808829 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.808816 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 04 23:59:16.808964 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.808944 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 04 23:59:16.809032 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.809018 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6sd8j\"" Jun 04 23:59:16.809474 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.809290 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 04 23:59:16.809474 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.809313 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 04 23:59:16.809784 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.809714 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 04 23:59:16.809872 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.809789 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 04 23:59:16.810300 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.809996 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 04 23:59:16.810300 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.810068 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-98lh7keaa1k4t\"" Jun 04 23:59:16.810300 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.810185 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 04 23:59:16.810870 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.810818 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 04 23:59:16.811544 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.811523 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 04 23:59:16.815716 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.815696 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 04 23:59:16.821579 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.821519 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 04 23:59:16.912894 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.912852 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913084 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.912902 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913084 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.912926 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-config\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913084 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.912959 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913084 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.912981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-web-config\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913084 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913084 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913387 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913387 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913387 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913157 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913387 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnq4w\" (UniqueName: \"kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-kube-api-access-tnq4w\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913387 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-config-out\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913387 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913387 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913344 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913387 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913381 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913702 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913702 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913702 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913476 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913702 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:16.913702 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:16.913545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014555 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014555 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014555 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014517 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014555 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014545 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014889 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014570 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014889 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014601 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnq4w\" (UniqueName: \"kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-kube-api-access-tnq4w\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014889 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-config-out\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014889 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014702 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014889 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014889 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014889 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014889 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.014889 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014876 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.015289 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.015289 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.015289 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.014979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.015703 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.015671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.015843 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.015740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-config\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.015910 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.015768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.015910 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.015904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-web-config\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.016641 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.016396 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.018268 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.016988 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.018268 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.017519 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.018268 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.017575 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.018268 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.018217 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.019359 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.019332 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.019466 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.019384 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.019601 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.019579 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.021647 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.021567 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.021753 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.021731 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.021930 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.021881 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-web-config\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.022105 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.022055 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-config-out\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.022866 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.022809 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.022866 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.022815 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.023048 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.023024 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.023171 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.023151 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.023680 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.023634 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.024190 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.024151 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-config\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.025215 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.025172 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.025683 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.025662 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnq4w\" (UniqueName: \"kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-kube-api-access-tnq4w\") pod \"prometheus-k8s-0\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.057229 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.057193 2580 patch_prober.go:28] interesting pod/image-registry-56fcb5d7dc-jql6d container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 04 23:59:17.057409 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.057251 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" podUID="cbf2a486-6415-406c-95b4-0706467dc14d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 04 23:59:17.119057 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.119017 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:17.288149 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.288105 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 04 23:59:17.290777 ip-10-0-128-106 kubenswrapper[2580]: W0604 23:59:17.290743 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38729c84_b5e4_4619_98e9_094f6abb370e.slice/crio-54a94a4f248a4394bb402fd8e5f130fb12e58ce30901d6b2561207c020598150 WatchSource:0}: Error finding container 54a94a4f248a4394bb402fd8e5f130fb12e58ce30901d6b2561207c020598150: Status 404 returned error can't find the container with id 54a94a4f248a4394bb402fd8e5f130fb12e58ce30901d6b2561207c020598150 Jun 04 23:59:17.404371 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.404336 2580 patch_prober.go:28] interesting pod/image-registry-697cc9c9dd-dd9sf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 04 23:59:17.404555 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.404399 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" podUID="d141eed4-8d62-4a3e-90e9-bb00959d151d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 04 23:59:17.758904 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:17.758864 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerStarted","Data":"54a94a4f248a4394bb402fd8e5f130fb12e58ce30901d6b2561207c020598150"} Jun 04 23:59:18.230119 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:18.230085 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" Jun 04 23:59:18.238797 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:18.238769 2580 scope.go:117] "RemoveContainer" containerID="cfcfa190fce9361adbe3548d769db5d7a89dbe62db8e33767a5dce6b34fb61b4" Jun 04 23:59:18.239091 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:59:18.238986 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-59b6cbddbd-zg77j_open-cluster-management-agent-addon(ae0e15ca-d4da-40dd-8b8c-df249b410fc3)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" podUID="ae0e15ca-d4da-40dd-8b8c-df249b410fc3" Jun 04 23:59:18.252627 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:18.252578 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:59:18.253075 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:18.253056 2580 scope.go:117] "RemoveContainer" containerID="6fb6001ed4a273651b1e9489e8e54a7ad80330b64f72c700c9971a8b4686cda4" Jun 04 23:59:18.253323 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:59:18.253267 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7c4d496f98-kgfbz_open-cluster-management-agent-addon(5375af6f-0110-4b3c-b44a-614488ddf2db)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" podUID="5375af6f-0110-4b3c-b44a-614488ddf2db" Jun 04 23:59:18.681227 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:18.681133 2580 patch_prober.go:28] interesting pod/image-registry-697cc9c9dd-dd9sf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 04 23:59:18.681227 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:18.681210 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" podUID="d141eed4-8d62-4a3e-90e9-bb00959d151d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 04 23:59:19.769961 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:19.769925 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vb5c9" event={"ID":"657f2cdc-9bb9-473b-8995-d0d7dda848c6","Type":"ContainerStarted","Data":"9f778a67e6ca64a597b0107f34c9af6e3e5ca6ceb36458a8224abd84e7cfd832"} Jun 04 23:59:19.770418 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:19.769982 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vb5c9" event={"ID":"657f2cdc-9bb9-473b-8995-d0d7dda848c6","Type":"ContainerStarted","Data":"435401b52fcc1463aa80f916be9ce25882c286c8e8ed281a13490088c8ec8b4a"} Jun 04 23:59:19.770418 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:19.770015 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vb5c9" Jun 04 23:59:19.772007 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:19.771985 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" event={"ID":"c1ce701c-f74c-4097-ac15-be05a541d3a6","Type":"ContainerStarted","Data":"23f499d835ed012a0b2a5e9a0dff226d9444b6464dd0d5bf82e6a1c9cb88a9a5"} Jun 04 23:59:19.772127 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:19.772025 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" event={"ID":"c1ce701c-f74c-4097-ac15-be05a541d3a6","Type":"ContainerStarted","Data":"6ddbba60fb36814d8714800ca6235533195c1cad213cc82c2b52fc35cdeccada"} Jun 04 23:59:19.772127 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:19.772058 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" event={"ID":"c1ce701c-f74c-4097-ac15-be05a541d3a6","Type":"ContainerStarted","Data":"048950e5bc471d44895146c484360ccf8c8e6b3299ee3e5b1e702a341df281b3"} Jun 04 23:59:19.773503 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:19.773481 2580 generic.go:356] "Generic (PLEG): container finished" podID="38729c84-b5e4-4619-98e9-094f6abb370e" containerID="e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e" exitCode=0 Jun 04 23:59:19.773598 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:19.773554 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerDied","Data":"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e"} Jun 04 23:59:19.786004 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:19.785954 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vb5c9" podStartSLOduration=251.554033884 podStartE2EDuration="4m13.785933177s" totalImagesPullingTime="2.231899293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:55:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:19.784525286 +0000 UTC m=+288.450725154" watchObservedRunningTime="2026-06-04 23:59:19.785933177 +0000 UTC m=+288.452132996" Jun 04 23:59:19.803937 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:19.803889 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8699ccf564-w89p6" podStartSLOduration=2.291543173 podStartE2EDuration="4.803875206s" totalImagesPullingTime="2.512332033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:19.802793529 +0000 UTC m=+288.468993368" watchObservedRunningTime="2026-06-04 23:59:19.803875206 +0000 UTC m=+288.470075023" Jun 04 23:59:22.071428 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.071353 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" podUID="cbf2a486-6415-406c-95b4-0706467dc14d" containerName="registry" containerID="cri-o://6b350d1cab689b4fbd181495aefee571722bd375f22b12146ec450f52876561e" gracePeriod=30 Jun 04 23:59:22.788977 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.788941 2580 generic.go:356] "Generic (PLEG): container finished" podID="cbf2a486-6415-406c-95b4-0706467dc14d" containerID="6b350d1cab689b4fbd181495aefee571722bd375f22b12146ec450f52876561e" exitCode=0 Jun 04 23:59:22.789158 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.788988 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" event={"ID":"cbf2a486-6415-406c-95b4-0706467dc14d","Type":"ContainerDied","Data":"6b350d1cab689b4fbd181495aefee571722bd375f22b12146ec450f52876561e"} Jun 04 23:59:22.896996 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.896975 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:59:22.978830 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.978797 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-image-registry-private-configuration\") pod \"cbf2a486-6415-406c-95b4-0706467dc14d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " Jun 04 23:59:22.978964 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.978847 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-bound-sa-token\") pod \"cbf2a486-6415-406c-95b4-0706467dc14d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " Jun 04 23:59:22.978964 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.978884 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzrqt\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-kube-api-access-rzrqt\") pod \"cbf2a486-6415-406c-95b4-0706467dc14d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " Jun 04 23:59:22.978964 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.978910 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls\") pod \"cbf2a486-6415-406c-95b4-0706467dc14d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " Jun 04 23:59:22.978964 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.978952 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-registry-certificates\") pod \"cbf2a486-6415-406c-95b4-0706467dc14d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " Jun 04 23:59:22.979162 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.978990 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbf2a486-6415-406c-95b4-0706467dc14d-ca-trust-extracted\") pod \"cbf2a486-6415-406c-95b4-0706467dc14d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " Jun 04 23:59:22.979162 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.979022 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-installation-pull-secrets\") pod \"cbf2a486-6415-406c-95b4-0706467dc14d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " Jun 04 23:59:22.979162 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.979052 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-trusted-ca\") pod \"cbf2a486-6415-406c-95b4-0706467dc14d\" (UID: \"cbf2a486-6415-406c-95b4-0706467dc14d\") " Jun 04 23:59:22.981218 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.979779 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cbf2a486-6415-406c-95b4-0706467dc14d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 04 23:59:22.981218 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.979841 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cbf2a486-6415-406c-95b4-0706467dc14d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 04 23:59:22.982337 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.982285 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cbf2a486-6415-406c-95b4-0706467dc14d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 04 23:59:22.982337 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.982303 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cbf2a486-6415-406c-95b4-0706467dc14d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 04 23:59:22.982337 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.982324 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cbf2a486-6415-406c-95b4-0706467dc14d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 04 23:59:22.982649 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.982469 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cbf2a486-6415-406c-95b4-0706467dc14d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 04 23:59:22.982912 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.982891 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-kube-api-access-rzrqt" (OuterVolumeSpecName: "kube-api-access-rzrqt") pod "cbf2a486-6415-406c-95b4-0706467dc14d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d"). InnerVolumeSpecName "kube-api-access-rzrqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 04 23:59:22.991651 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:22.990806 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbf2a486-6415-406c-95b4-0706467dc14d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cbf2a486-6415-406c-95b4-0706467dc14d" (UID: "cbf2a486-6415-406c-95b4-0706467dc14d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 04 23:59:23.080178 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.080085 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzrqt\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-kube-api-access-rzrqt\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 04 23:59:23.080178 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.080126 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-registry-tls\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 04 23:59:23.080178 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.080143 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-registry-certificates\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 04 23:59:23.080178 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.080158 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbf2a486-6415-406c-95b4-0706467dc14d-ca-trust-extracted\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 04 23:59:23.080650 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.080190 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-installation-pull-secrets\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 04 23:59:23.080650 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.080204 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbf2a486-6415-406c-95b4-0706467dc14d-trusted-ca\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 04 23:59:23.080650 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.080217 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbf2a486-6415-406c-95b4-0706467dc14d-image-registry-private-configuration\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 04 23:59:23.080650 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.080232 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbf2a486-6415-406c-95b4-0706467dc14d-bound-sa-token\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 04 23:59:23.794634 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.794590 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" Jun 04 23:59:23.794819 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.794609 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56fcb5d7dc-jql6d" event={"ID":"cbf2a486-6415-406c-95b4-0706467dc14d","Type":"ContainerDied","Data":"6a47f8e26051382455c204515c32451df2224d4281cf861152788f066d0c0bda"} Jun 04 23:59:23.794819 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.794702 2580 scope.go:117] "RemoveContainer" containerID="6b350d1cab689b4fbd181495aefee571722bd375f22b12146ec450f52876561e" Jun 04 23:59:23.803543 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.803507 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerStarted","Data":"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a"} Jun 04 23:59:23.803723 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.803639 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerStarted","Data":"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0"} Jun 04 23:59:23.820701 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.820666 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56fcb5d7dc-jql6d"] Jun 04 23:59:23.822130 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:23.822105 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56fcb5d7dc-jql6d"] Jun 04 23:59:24.812882 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:24.812849 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerStarted","Data":"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208"} Jun 04 23:59:24.813304 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:24.812909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerStarted","Data":"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653"} Jun 04 23:59:25.819768 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:25.819742 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbf2a486-6415-406c-95b4-0706467dc14d" path="/var/lib/kubelet/pods/cbf2a486-6415-406c-95b4-0706467dc14d/volumes" Jun 04 23:59:25.820248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:25.820034 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerStarted","Data":"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1"} Jun 04 23:59:25.820248 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:25.820098 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerStarted","Data":"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c"} Jun 04 23:59:25.849420 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:25.849365 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.651101599 podStartE2EDuration="9.849348903s" totalImagesPullingTime="6.163266293s" totalInitContainerRuntime="34.981011ms" isStatefulPod=false podCreationTimestamp="2026-06-04 23:59:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:25.848132576 +0000 UTC m=+294.514332419" watchObservedRunningTime="2026-06-04 23:59:25.849348903 +0000 UTC m=+294.515548720" Jun 04 23:59:27.120119 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:27.120068 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 04 23:59:27.402551 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:27.402468 2580 patch_prober.go:28] interesting pod/image-registry-697cc9c9dd-dd9sf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 04 23:59:27.402551 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:27.402523 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" podUID="d141eed4-8d62-4a3e-90e9-bb00959d151d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 04 23:59:28.680439 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:28.680411 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-697cc9c9dd-dd9sf" Jun 04 23:59:28.815890 ip-10-0-128-106 kubenswrapper[2580]: E0604 23:59:28.815841 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mfdvb" podUID="94ed26b6-3c80-446a-9d43-8fa9d78a5e13" Jun 04 23:59:29.780030 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:29.780001 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vb5c9" Jun 04 23:59:31.769528 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:31.769504 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 04 23:59:31.769908 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:31.769665 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 04 23:59:31.774518 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:31.774499 2580 kubelet.go:1648] "Image garbage collection succeeded" Jun 04 23:59:31.823126 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:31.823018 2580 scope.go:117] "RemoveContainer" containerID="cfcfa190fce9361adbe3548d769db5d7a89dbe62db8e33767a5dce6b34fb61b4" Jun 04 23:59:32.815039 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:32.815007 2580 scope.go:117] "RemoveContainer" containerID="6fb6001ed4a273651b1e9489e8e54a7ad80330b64f72c700c9971a8b4686cda4" Jun 04 23:59:32.847684 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:32.847647 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6cbddbd-zg77j" event={"ID":"ae0e15ca-d4da-40dd-8b8c-df249b410fc3","Type":"ContainerStarted","Data":"138bb77d112e2b1ef38515fcd83188e62d5610279eb86c86ade587b03948330d"} Jun 04 23:59:33.852440 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:33.852400 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" event={"ID":"5375af6f-0110-4b3c-b44a-614488ddf2db","Type":"ContainerStarted","Data":"4707baeee3009859864cacf75d724dda4b7ba32487c8fbc334a6c0ff3fe5f407"} Jun 04 23:59:33.852888 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:33.852772 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:59:33.854366 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:33.854345 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4d496f98-kgfbz" Jun 04 23:59:41.819537 ip-10-0-128-106 kubenswrapper[2580]: I0604 23:59:41.819509 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 05 00:00:17.119525 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:17.119427 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:17.152550 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:17.152526 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:18.056985 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:18.056958 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:35.107277 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.107245 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 00:00:35.107925 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.107551 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="prometheus" containerID="cri-o://1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0" gracePeriod=600 Jun 05 00:00:35.107925 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.107701 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy" containerID="cri-o://c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c" gracePeriod=600 Jun 05 00:00:35.107925 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.107772 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy-web" containerID="cri-o://7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208" gracePeriod=600 Jun 05 00:00:35.107925 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.107796 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1" gracePeriod=600 Jun 05 00:00:35.107925 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.107843 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="config-reloader" containerID="cri-o://c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a" gracePeriod=600 Jun 05 00:00:35.107925 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.107884 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="thanos-sidecar" containerID="cri-o://ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653" gracePeriod=600 Jun 05 00:00:35.351002 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.350976 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:35.391494 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391407 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-db\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391494 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391440 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-config-out\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391494 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391461 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-0\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391494 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391488 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-web-config\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391510 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnq4w\" (UniqueName: \"kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-kube-api-access-tnq4w\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391532 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-serving-certs-ca-bundle\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391556 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-tls-assets\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391572 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-2\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391590 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-config\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391604 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-thanos-prometheus-http-client-file\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391659 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-kube-rbac-proxy\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391702 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-trusted-ca-bundle\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391725 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391744 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-kubelet-serving-ca-bundle\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391759 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-1\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391784 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-tls\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.391829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391811 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-metrics-client-ca\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.392421 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391839 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.392421 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391859 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-metrics-client-certs\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.392421 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.391882 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-grpc-tls\") pod \"38729c84-b5e4-4619-98e9-094f6abb370e\" (UID: \"38729c84-b5e4-4619-98e9-094f6abb370e\") " Jun 05 00:00:35.392653 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.392561 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 00:00:35.393526 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.393495 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 00:00:35.393526 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.393513 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 00:00:35.393907 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.393881 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 00:00:35.394302 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.394277 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 00:00:35.395130 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.395101 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 00:00:35.396096 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.396068 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 00:00:35.396386 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.396354 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 00:00:35.398429 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.398406 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-config" (OuterVolumeSpecName: "config") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 00:00:35.398429 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.398403 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-config-out" (OuterVolumeSpecName: "config-out") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 00:00:35.398602 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.398439 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 00:00:35.398602 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.398462 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 00:00:35.398602 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.398493 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 00:00:35.398602 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.398528 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 00:00:35.398602 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.398542 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 00:00:35.398602 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.398557 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 00:00:35.398602 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.398577 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 00:00:35.399149 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.398676 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 00:00:35.399777 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.399745 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-kube-api-access-tnq4w" (OuterVolumeSpecName: "kube-api-access-tnq4w") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "kube-api-access-tnq4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 00:00:35.409943 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.409916 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-web-config" (OuterVolumeSpecName: "web-config") pod "38729c84-b5e4-4619-98e9-094f6abb370e" (UID: "38729c84-b5e4-4619-98e9-094f6abb370e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 00:00:35.493176 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493139 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-kube-rbac-proxy\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493176 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493166 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493176 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493177 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493176 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493186 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493196 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493205 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493213 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-metrics-client-ca\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493222 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493254 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-metrics-client-certs\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493264 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-secret-grpc-tls\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493272 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-db\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493282 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38729c84-b5e4-4619-98e9-094f6abb370e-config-out\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493290 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493298 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-web-config\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493306 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnq4w\" (UniqueName: \"kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-kube-api-access-tnq4w\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493314 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493322 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38729c84-b5e4-4619-98e9-094f6abb370e-tls-assets\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493330 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38729c84-b5e4-4619-98e9-094f6abb370e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493337 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-config\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:35.493452 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:35.493346 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38729c84-b5e4-4619-98e9-094f6abb370e-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:00:36.107441 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107342 2580 generic.go:356] "Generic (PLEG): container finished" podID="38729c84-b5e4-4619-98e9-094f6abb370e" containerID="fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1" exitCode=0 Jun 05 00:00:36.107441 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107379 2580 generic.go:356] "Generic (PLEG): container finished" podID="38729c84-b5e4-4619-98e9-094f6abb370e" containerID="c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c" exitCode=0 Jun 05 00:00:36.107441 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107390 2580 generic.go:356] "Generic (PLEG): container finished" podID="38729c84-b5e4-4619-98e9-094f6abb370e" containerID="7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208" exitCode=0 Jun 05 00:00:36.107441 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107401 2580 generic.go:356] "Generic (PLEG): container finished" podID="38729c84-b5e4-4619-98e9-094f6abb370e" containerID="ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653" exitCode=0 Jun 05 00:00:36.107441 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107412 2580 generic.go:356] "Generic (PLEG): container finished" podID="38729c84-b5e4-4619-98e9-094f6abb370e" containerID="c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a" exitCode=0 Jun 05 00:00:36.107441 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107420 2580 generic.go:356] "Generic (PLEG): container finished" podID="38729c84-b5e4-4619-98e9-094f6abb370e" containerID="1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0" exitCode=0 Jun 05 00:00:36.108145 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107429 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerDied","Data":"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1"} Jun 05 00:00:36.108145 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107449 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.108145 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107566 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerDied","Data":"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c"} Jun 05 00:00:36.108145 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107628 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerDied","Data":"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208"} Jun 05 00:00:36.108145 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107643 2580 scope.go:117] "RemoveContainer" containerID="fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1" Jun 05 00:00:36.108145 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107671 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerDied","Data":"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653"} Jun 05 00:00:36.108145 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107714 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerDied","Data":"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a"} Jun 05 00:00:36.108145 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107758 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerDied","Data":"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0"} Jun 05 00:00:36.108145 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.107796 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38729c84-b5e4-4619-98e9-094f6abb370e","Type":"ContainerDied","Data":"54a94a4f248a4394bb402fd8e5f130fb12e58ce30901d6b2561207c020598150"} Jun 05 00:00:36.115087 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.115069 2580 scope.go:117] "RemoveContainer" containerID="c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c" Jun 05 00:00:36.128347 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.128322 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 00:00:36.132786 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.132761 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 00:00:36.134589 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.134567 2580 scope.go:117] "RemoveContainer" containerID="7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208" Jun 05 00:00:36.141691 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.141673 2580 scope.go:117] "RemoveContainer" containerID="ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653" Jun 05 00:00:36.148338 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.148319 2580 scope.go:117] "RemoveContainer" containerID="c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a" Jun 05 00:00:36.155238 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.155219 2580 scope.go:117] "RemoveContainer" containerID="1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0" Jun 05 00:00:36.160682 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.160657 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 00:00:36.161020 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161002 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy-thanos" Jun 05 00:00:36.161066 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161025 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy-thanos" Jun 05 00:00:36.161066 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161040 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="prometheus" Jun 05 00:00:36.161066 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161049 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="prometheus" Jun 05 00:00:36.161066 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161060 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy-web" Jun 05 00:00:36.161182 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161069 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy-web" Jun 05 00:00:36.161182 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161086 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="thanos-sidecar" Jun 05 00:00:36.161182 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161095 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="thanos-sidecar" Jun 05 00:00:36.161182 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161107 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbf2a486-6415-406c-95b4-0706467dc14d" containerName="registry" Jun 05 00:00:36.161182 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161115 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbf2a486-6415-406c-95b4-0706467dc14d" containerName="registry" Jun 05 00:00:36.161182 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161128 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="init-config-reloader" Jun 05 00:00:36.161182 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161136 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="init-config-reloader" Jun 05 00:00:36.161182 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161155 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="config-reloader" Jun 05 00:00:36.161182 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161164 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="config-reloader" Jun 05 00:00:36.161182 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161177 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy" Jun 05 00:00:36.161182 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161186 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy" Jun 05 00:00:36.161489 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161251 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="config-reloader" Jun 05 00:00:36.161489 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161263 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy" Jun 05 00:00:36.161489 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161272 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy-thanos" Jun 05 00:00:36.161489 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161282 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="prometheus" Jun 05 00:00:36.161489 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161292 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="thanos-sidecar" Jun 05 00:00:36.161489 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161300 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" containerName="kube-rbac-proxy-web" Jun 05 00:00:36.161489 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.161309 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbf2a486-6415-406c-95b4-0706467dc14d" containerName="registry" Jun 05 00:00:36.163687 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.163666 2580 scope.go:117] "RemoveContainer" containerID="e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e" Jun 05 00:00:36.166641 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.166609 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.169704 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.169679 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 00:00:36.169807 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.169701 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 00:00:36.169869 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.169810 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 00:00:36.169921 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.169883 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6sd8j\"" Jun 05 00:00:36.169976 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.169955 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-98lh7keaa1k4t\"" Jun 05 00:00:36.170030 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.170002 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 00:00:36.170087 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.170036 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 00:00:36.170087 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.170078 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 00:00:36.170199 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.170097 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 00:00:36.170199 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.170193 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 00:00:36.170298 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.170261 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 00:00:36.170298 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.170271 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 00:00:36.170298 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.170284 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 00:00:36.170713 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.170694 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 00:00:36.170816 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.170796 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 00:00:36.171116 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.171098 2580 scope.go:117] "RemoveContainer" containerID="fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1" Jun 05 00:00:36.171448 ip-10-0-128-106 kubenswrapper[2580]: E0605 00:00:36.171420 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": container with ID starting with fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1 not found: ID does not exist" containerID="fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1" Jun 05 00:00:36.171557 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.171456 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1"} err="failed to get container status \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": rpc error: code = NotFound desc = could not find container \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": container with ID starting with fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1 not found: ID does not exist" Jun 05 00:00:36.171557 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.171529 2580 scope.go:117] "RemoveContainer" containerID="c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c" Jun 05 00:00:36.171827 ip-10-0-128-106 kubenswrapper[2580]: E0605 00:00:36.171809 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": container with ID starting with c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c not found: ID does not exist" containerID="c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c" Jun 05 00:00:36.171904 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.171836 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c"} err="failed to get container status \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": rpc error: code = NotFound desc = could not find container \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": container with ID starting with c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c not found: ID does not exist" Jun 05 00:00:36.171904 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.171859 2580 scope.go:117] "RemoveContainer" containerID="7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208" Jun 05 00:00:36.172207 ip-10-0-128-106 kubenswrapper[2580]: E0605 00:00:36.172182 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": container with ID starting with 7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208 not found: ID does not exist" containerID="7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208" Jun 05 00:00:36.172298 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.172216 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208"} err="failed to get container status \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": rpc error: code = NotFound desc = could not find container \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": container with ID starting with 7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208 not found: ID does not exist" Jun 05 00:00:36.172298 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.172238 2580 scope.go:117] "RemoveContainer" containerID="ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653" Jun 05 00:00:36.172649 ip-10-0-128-106 kubenswrapper[2580]: E0605 00:00:36.172607 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": container with ID starting with ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653 not found: ID does not exist" containerID="ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653" Jun 05 00:00:36.172733 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.172656 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653"} err="failed to get container status \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": rpc error: code = NotFound desc = could not find container \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": container with ID starting with ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653 not found: ID does not exist" Jun 05 00:00:36.172733 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.172679 2580 scope.go:117] "RemoveContainer" containerID="c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a" Jun 05 00:00:36.172900 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.172881 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 00:00:36.172966 ip-10-0-128-106 kubenswrapper[2580]: E0605 00:00:36.172933 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": container with ID starting with c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a not found: ID does not exist" containerID="c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a" Jun 05 00:00:36.173028 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.172962 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a"} err="failed to get container status \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": rpc error: code = NotFound desc = could not find container \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": container with ID starting with c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a not found: ID does not exist" Jun 05 00:00:36.173028 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.172985 2580 scope.go:117] "RemoveContainer" containerID="1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0" Jun 05 00:00:36.173244 ip-10-0-128-106 kubenswrapper[2580]: E0605 00:00:36.173223 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": container with ID starting with 1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0 not found: ID does not exist" containerID="1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0" Jun 05 00:00:36.173317 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.173254 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0"} err="failed to get container status \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": rpc error: code = NotFound desc = could not find container \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": container with ID starting with 1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0 not found: ID does not exist" Jun 05 00:00:36.173317 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.173279 2580 scope.go:117] "RemoveContainer" containerID="e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e" Jun 05 00:00:36.173596 ip-10-0-128-106 kubenswrapper[2580]: E0605 00:00:36.173561 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": container with ID starting with e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e not found: ID does not exist" containerID="e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e" Jun 05 00:00:36.173700 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.173592 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e"} err="failed to get container status \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": rpc error: code = NotFound desc = could not find container \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": container with ID starting with e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e not found: ID does not exist" Jun 05 00:00:36.173700 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.173611 2580 scope.go:117] "RemoveContainer" containerID="fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1" Jun 05 00:00:36.173938 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.173916 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1"} err="failed to get container status \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": rpc error: code = NotFound desc = could not find container \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": container with ID starting with fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1 not found: ID does not exist" Jun 05 00:00:36.174015 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.173940 2580 scope.go:117] "RemoveContainer" containerID="c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c" Jun 05 00:00:36.174277 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.174253 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c"} err="failed to get container status \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": rpc error: code = NotFound desc = could not find container \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": container with ID starting with c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c not found: ID does not exist" Jun 05 00:00:36.174358 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.174278 2580 scope.go:117] "RemoveContainer" containerID="7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208" Jun 05 00:00:36.174552 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.174531 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208"} err="failed to get container status \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": rpc error: code = NotFound desc = could not find container \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": container with ID starting with 7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208 not found: ID does not exist" Jun 05 00:00:36.174552 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.174550 2580 scope.go:117] "RemoveContainer" containerID="ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653" Jun 05 00:00:36.174855 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.174801 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653"} err="failed to get container status \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": rpc error: code = NotFound desc = could not find container \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": container with ID starting with ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653 not found: ID does not exist" Jun 05 00:00:36.174855 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.174832 2580 scope.go:117] "RemoveContainer" containerID="c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a" Jun 05 00:00:36.175154 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.175092 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a"} err="failed to get container status \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": rpc error: code = NotFound desc = could not find container \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": container with ID starting with c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a not found: ID does not exist" Jun 05 00:00:36.175154 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.175117 2580 scope.go:117] "RemoveContainer" containerID="1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0" Jun 05 00:00:36.175488 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.175462 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0"} err="failed to get container status \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": rpc error: code = NotFound desc = could not find container \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": container with ID starting with 1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0 not found: ID does not exist" Jun 05 00:00:36.175641 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.175490 2580 scope.go:117] "RemoveContainer" containerID="e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e" Jun 05 00:00:36.175869 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.175841 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e"} err="failed to get container status \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": rpc error: code = NotFound desc = could not find container \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": container with ID starting with e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e not found: ID does not exist" Jun 05 00:00:36.175869 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.175866 2580 scope.go:117] "RemoveContainer" containerID="fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1" Jun 05 00:00:36.176062 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.176010 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 00:00:36.176122 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.176106 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1"} err="failed to get container status \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": rpc error: code = NotFound desc = could not find container \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": container with ID starting with fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1 not found: ID does not exist" Jun 05 00:00:36.176202 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.176123 2580 scope.go:117] "RemoveContainer" containerID="c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c" Jun 05 00:00:36.176329 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.176314 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c"} err="failed to get container status \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": rpc error: code = NotFound desc = could not find container \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": container with ID starting with c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c not found: ID does not exist" Jun 05 00:00:36.176329 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.176329 2580 scope.go:117] "RemoveContainer" containerID="7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208" Jun 05 00:00:36.176550 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.176527 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208"} err="failed to get container status \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": rpc error: code = NotFound desc = could not find container \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": container with ID starting with 7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208 not found: ID does not exist" Jun 05 00:00:36.176593 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.176554 2580 scope.go:117] "RemoveContainer" containerID="ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653" Jun 05 00:00:36.176823 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.176803 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653"} err="failed to get container status \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": rpc error: code = NotFound desc = could not find container \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": container with ID starting with ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653 not found: ID does not exist" Jun 05 00:00:36.176875 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.176825 2580 scope.go:117] "RemoveContainer" containerID="c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a" Jun 05 00:00:36.177050 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.177034 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a"} err="failed to get container status \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": rpc error: code = NotFound desc = could not find container \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": container with ID starting with c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a not found: ID does not exist" Jun 05 00:00:36.177114 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.177052 2580 scope.go:117] "RemoveContainer" containerID="1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0" Jun 05 00:00:36.177240 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.177216 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0"} err="failed to get container status \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": rpc error: code = NotFound desc = could not find container \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": container with ID starting with 1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0 not found: ID does not exist" Jun 05 00:00:36.177284 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.177244 2580 scope.go:117] "RemoveContainer" containerID="e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e" Jun 05 00:00:36.177486 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.177467 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e"} err="failed to get container status \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": rpc error: code = NotFound desc = could not find container \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": container with ID starting with e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e not found: ID does not exist" Jun 05 00:00:36.177549 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.177488 2580 scope.go:117] "RemoveContainer" containerID="fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1" Jun 05 00:00:36.177722 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.177698 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1"} err="failed to get container status \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": rpc error: code = NotFound desc = could not find container \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": container with ID starting with fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1 not found: ID does not exist" Jun 05 00:00:36.177722 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.177721 2580 scope.go:117] "RemoveContainer" containerID="c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c" Jun 05 00:00:36.177929 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.177911 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c"} err="failed to get container status \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": rpc error: code = NotFound desc = could not find container \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": container with ID starting with c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c not found: ID does not exist" Jun 05 00:00:36.177974 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.177929 2580 scope.go:117] "RemoveContainer" containerID="7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208" Jun 05 00:00:36.178126 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.178107 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208"} err="failed to get container status \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": rpc error: code = NotFound desc = could not find container \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": container with ID starting with 7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208 not found: ID does not exist" Jun 05 00:00:36.178167 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.178127 2580 scope.go:117] "RemoveContainer" containerID="ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653" Jun 05 00:00:36.178351 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.178330 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653"} err="failed to get container status \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": rpc error: code = NotFound desc = could not find container \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": container with ID starting with ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653 not found: ID does not exist" Jun 05 00:00:36.178392 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.178352 2580 scope.go:117] "RemoveContainer" containerID="c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a" Jun 05 00:00:36.178543 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.178528 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a"} err="failed to get container status \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": rpc error: code = NotFound desc = could not find container \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": container with ID starting with c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a not found: ID does not exist" Jun 05 00:00:36.178582 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.178543 2580 scope.go:117] "RemoveContainer" containerID="1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0" Jun 05 00:00:36.178752 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.178734 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0"} err="failed to get container status \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": rpc error: code = NotFound desc = could not find container \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": container with ID starting with 1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0 not found: ID does not exist" Jun 05 00:00:36.178835 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.178752 2580 scope.go:117] "RemoveContainer" containerID="e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e" Jun 05 00:00:36.179041 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.179019 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e"} err="failed to get container status \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": rpc error: code = NotFound desc = could not find container \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": container with ID starting with e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e not found: ID does not exist" Jun 05 00:00:36.179041 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.179040 2580 scope.go:117] "RemoveContainer" containerID="fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1" Jun 05 00:00:36.179316 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.179268 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1"} err="failed to get container status \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": rpc error: code = NotFound desc = could not find container \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": container with ID starting with fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1 not found: ID does not exist" Jun 05 00:00:36.179316 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.179295 2580 scope.go:117] "RemoveContainer" containerID="c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c" Jun 05 00:00:36.179567 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.179544 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c"} err="failed to get container status \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": rpc error: code = NotFound desc = could not find container \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": container with ID starting with c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c not found: ID does not exist" Jun 05 00:00:36.179567 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.179568 2580 scope.go:117] "RemoveContainer" containerID="7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208" Jun 05 00:00:36.180032 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.179856 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208"} err="failed to get container status \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": rpc error: code = NotFound desc = could not find container \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": container with ID starting with 7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208 not found: ID does not exist" Jun 05 00:00:36.180032 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.179894 2580 scope.go:117] "RemoveContainer" containerID="ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653" Jun 05 00:00:36.180144 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.180115 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653"} err="failed to get container status \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": rpc error: code = NotFound desc = could not find container \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": container with ID starting with ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653 not found: ID does not exist" Jun 05 00:00:36.180144 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.180131 2580 scope.go:117] "RemoveContainer" containerID="c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a" Jun 05 00:00:36.180362 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.180346 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a"} err="failed to get container status \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": rpc error: code = NotFound desc = could not find container \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": container with ID starting with c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a not found: ID does not exist" Jun 05 00:00:36.180362 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.180362 2580 scope.go:117] "RemoveContainer" containerID="1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0" Jun 05 00:00:36.180631 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.180589 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0"} err="failed to get container status \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": rpc error: code = NotFound desc = could not find container \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": container with ID starting with 1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0 not found: ID does not exist" Jun 05 00:00:36.180631 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.180608 2580 scope.go:117] "RemoveContainer" containerID="e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e" Jun 05 00:00:36.180866 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.180845 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e"} err="failed to get container status \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": rpc error: code = NotFound desc = could not find container \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": container with ID starting with e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e not found: ID does not exist" Jun 05 00:00:36.180932 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.180867 2580 scope.go:117] "RemoveContainer" containerID="fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1" Jun 05 00:00:36.181144 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.181124 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1"} err="failed to get container status \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": rpc error: code = NotFound desc = could not find container \"fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1\": container with ID starting with fae498c136858716cac81d895416ed8f1f5c0581cfd0ddfea90606f24e0c24c1 not found: ID does not exist" Jun 05 00:00:36.181144 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.181142 2580 scope.go:117] "RemoveContainer" containerID="c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c" Jun 05 00:00:36.181286 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.181215 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 00:00:36.181401 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.181380 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c"} err="failed to get container status \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": rpc error: code = NotFound desc = could not find container \"c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c\": container with ID starting with c62c82d3b51d09139ac23d90fd5203c6195ed1552c7f9e9327681c65f614669c not found: ID does not exist" Jun 05 00:00:36.181446 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.181402 2580 scope.go:117] "RemoveContainer" containerID="7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208" Jun 05 00:00:36.181608 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.181592 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208"} err="failed to get container status \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": rpc error: code = NotFound desc = could not find container \"7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208\": container with ID starting with 7a1ac03be5bd6ff05863da0c9a66acfb059741801a6a3f9aa52f2c4435250208 not found: ID does not exist" Jun 05 00:00:36.181693 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.181609 2580 scope.go:117] "RemoveContainer" containerID="ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653" Jun 05 00:00:36.181832 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.181816 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653"} err="failed to get container status \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": rpc error: code = NotFound desc = could not find container \"ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653\": container with ID starting with ca2a1c3e823ef11b50720d97ac787ee94d39675610d719c65659a503bf767653 not found: ID does not exist" Jun 05 00:00:36.181876 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.181833 2580 scope.go:117] "RemoveContainer" containerID="c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a" Jun 05 00:00:36.182068 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.182047 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a"} err="failed to get container status \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": rpc error: code = NotFound desc = could not find container \"c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a\": container with ID starting with c7c43fa6accf7a6d8bba6ae79645314debd656e405d535381dcadb1f80ed5e1a not found: ID does not exist" Jun 05 00:00:36.182145 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.182069 2580 scope.go:117] "RemoveContainer" containerID="1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0" Jun 05 00:00:36.182291 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.182276 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0"} err="failed to get container status \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": rpc error: code = NotFound desc = could not find container \"1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0\": container with ID starting with 1db5295b02e55b023daf5777765f0e980a62b6ca99fb3b00c0db4d179f7e3fa0 not found: ID does not exist" Jun 05 00:00:36.182345 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.182291 2580 scope.go:117] "RemoveContainer" containerID="e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e" Jun 05 00:00:36.182515 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.182496 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e"} err="failed to get container status \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": rpc error: code = NotFound desc = could not find container \"e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e\": container with ID starting with e37d8faafb223028d0790e43f7aea6035b1953d4bf2b5a047339daf517f5535e not found: ID does not exist" Jun 05 00:00:36.202193 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202157 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202193 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202194 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202380 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202217 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d462986f-5cb7-423b-8bff-ae46670c7f79-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202380 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202380 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202298 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202380 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202331 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202380 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202349 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202380 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202365 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-config\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202554 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202380 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202554 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202431 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202554 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202494 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-web-config\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202554 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d462986f-5cb7-423b-8bff-ae46670c7f79-config-out\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202554 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202554 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202745 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202576 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202745 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202745 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202745 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202745 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5th8p\" (UniqueName: \"kubernetes.io/projected/d462986f-5cb7-423b-8bff-ae46670c7f79-kube-api-access-5th8p\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.202745 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.202737 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303604 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303558 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-config\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303604 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303861 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303861 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303674 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-web-config\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303861 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d462986f-5cb7-423b-8bff-ae46670c7f79-config-out\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303861 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303861 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303861 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303861 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303861 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303861 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.303861 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5th8p\" (UniqueName: \"kubernetes.io/projected/d462986f-5cb7-423b-8bff-ae46670c7f79-kube-api-access-5th8p\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.304344 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.304344 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.304344 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.304344 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.303985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d462986f-5cb7-423b-8bff-ae46670c7f79-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.304344 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.304011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.304344 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.304058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.304344 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.304098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.304344 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.304135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.304927 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.304842 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.307239 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.305464 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.307239 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.305896 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.307239 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.306114 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.307239 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.304095 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.307239 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.306525 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.307239 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.306807 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.307593 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.307358 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.308415 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.307818 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-web-config\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.308415 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.308187 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.308415 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.308210 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-config\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.308415 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.308228 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d462986f-5cb7-423b-8bff-ae46670c7f79-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.308714 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.308420 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d462986f-5cb7-423b-8bff-ae46670c7f79-config-out\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.308714 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.308432 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d462986f-5cb7-423b-8bff-ae46670c7f79-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.308882 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.308861 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.309018 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.308991 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.309760 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.309745 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.309866 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.309846 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.310264 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.310247 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d462986f-5cb7-423b-8bff-ae46670c7f79-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.319504 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.319482 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5th8p\" (UniqueName: \"kubernetes.io/projected/d462986f-5cb7-423b-8bff-ae46670c7f79-kube-api-access-5th8p\") pod \"prometheus-k8s-0\" (UID: \"d462986f-5cb7-423b-8bff-ae46670c7f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.478363 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.478328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:36.613376 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:36.613345 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 00:00:36.617733 ip-10-0-128-106 kubenswrapper[2580]: W0605 00:00:36.617702 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd462986f_5cb7_423b_8bff_ae46670c7f79.slice/crio-992724ebe495ed6cb83a586ae3b68e661bedaf030f9ff29f01782b466d921d06 WatchSource:0}: Error finding container 992724ebe495ed6cb83a586ae3b68e661bedaf030f9ff29f01782b466d921d06: Status 404 returned error can't find the container with id 992724ebe495ed6cb83a586ae3b68e661bedaf030f9ff29f01782b466d921d06 Jun 05 00:00:37.112951 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:37.112917 2580 generic.go:356] "Generic (PLEG): container finished" podID="d462986f-5cb7-423b-8bff-ae46670c7f79" containerID="4b81de03fca706d47525d0dcbbca321facbb7e5deb7ce6ecdd6561fa2642d126" exitCode=0 Jun 05 00:00:37.112951 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:37.112959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d462986f-5cb7-423b-8bff-ae46670c7f79","Type":"ContainerDied","Data":"4b81de03fca706d47525d0dcbbca321facbb7e5deb7ce6ecdd6561fa2642d126"} Jun 05 00:00:37.113366 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:37.113007 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d462986f-5cb7-423b-8bff-ae46670c7f79","Type":"ContainerStarted","Data":"992724ebe495ed6cb83a586ae3b68e661bedaf030f9ff29f01782b466d921d06"} Jun 05 00:00:37.819374 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:37.819344 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38729c84-b5e4-4619-98e9-094f6abb370e" path="/var/lib/kubelet/pods/38729c84-b5e4-4619-98e9-094f6abb370e/volumes" Jun 05 00:00:38.120469 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:38.120376 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d462986f-5cb7-423b-8bff-ae46670c7f79","Type":"ContainerStarted","Data":"5d10d0fb909f0d5cc47edb970170b8035a514b689fb1205c0d69cb5baabb2b75"} Jun 05 00:00:38.120931 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:38.120498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d462986f-5cb7-423b-8bff-ae46670c7f79","Type":"ContainerStarted","Data":"1bd9e883fb4717c2276d2e449ffc55224572bd7e57b412216ef1bab8a7022430"} Jun 05 00:00:38.120931 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:38.120545 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d462986f-5cb7-423b-8bff-ae46670c7f79","Type":"ContainerStarted","Data":"90f024755d8a9a28403ec728525720e8790183378b3323a59f64a6c1dc811036"} Jun 05 00:00:38.120931 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:38.120593 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d462986f-5cb7-423b-8bff-ae46670c7f79","Type":"ContainerStarted","Data":"a374b4954eb874129c3e36aac9a18e189ac0540ce2a6878f79fd0ec38a832d1f"} Jun 05 00:00:38.120931 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:38.120656 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d462986f-5cb7-423b-8bff-ae46670c7f79","Type":"ContainerStarted","Data":"e382350a526f483b6e9836524ce18d4d92d80ce3cef948af1ca666c7304ae523"} Jun 05 00:00:38.120931 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:38.120697 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d462986f-5cb7-423b-8bff-ae46670c7f79","Type":"ContainerStarted","Data":"5b3f3b0f93b7095666ff9558beab0affbe5d6e94d7f15d30f2c4fcebc511bd38"} Jun 05 00:00:38.148076 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:38.148017 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.126131682 podStartE2EDuration="2.148000066s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.868384ms" isStatefulPod=false podCreationTimestamp="2026-06-05 00:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:00:38.146526128 +0000 UTC m=+366.812725966" watchObservedRunningTime="2026-06-05 00:00:38.148000066 +0000 UTC m=+366.814199883" Jun 05 00:00:41.479485 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:41.479441 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:00:45.686720 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:45.686673 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 05 00:00:45.689062 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:45.689042 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94ed26b6-3c80-446a-9d43-8fa9d78a5e13-metrics-certs\") pod \"network-metrics-daemon-mfdvb\" (UID: \"94ed26b6-3c80-446a-9d43-8fa9d78a5e13\") " pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 05 00:00:45.723046 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:45.723010 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l52sk\"" Jun 05 00:00:45.730961 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:45.730937 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfdvb" Jun 05 00:00:45.856882 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:45.856772 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mfdvb"] Jun 05 00:00:45.859610 ip-10-0-128-106 kubenswrapper[2580]: W0605 00:00:45.859581 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ed26b6_3c80_446a_9d43_8fa9d78a5e13.slice/crio-dd2780e9e3cbb78178570462096894cdf9b7fc293e87c81b56036da4b8b1c4ae WatchSource:0}: Error finding container dd2780e9e3cbb78178570462096894cdf9b7fc293e87c81b56036da4b8b1c4ae: Status 404 returned error can't find the container with id dd2780e9e3cbb78178570462096894cdf9b7fc293e87c81b56036da4b8b1c4ae Jun 05 00:00:45.861395 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:45.861375 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 00:00:46.153559 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:46.153522 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mfdvb" event={"ID":"94ed26b6-3c80-446a-9d43-8fa9d78a5e13","Type":"ContainerStarted","Data":"dd2780e9e3cbb78178570462096894cdf9b7fc293e87c81b56036da4b8b1c4ae"} Jun 05 00:00:47.159241 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:47.159206 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mfdvb" event={"ID":"94ed26b6-3c80-446a-9d43-8fa9d78a5e13","Type":"ContainerStarted","Data":"3e9486ee2072bdbec34f90d89c57b9828d5d75d01541abcf84e2d15343685310"} Jun 05 00:00:47.159760 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:47.159263 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mfdvb" event={"ID":"94ed26b6-3c80-446a-9d43-8fa9d78a5e13","Type":"ContainerStarted","Data":"48badeff22456812591136d88b23d2d93fa4dbc8222e0d9d9518ca8fdd6d55f6"} Jun 05 00:00:47.176378 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:00:47.176322 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mfdvb" podStartSLOduration=375.373491019 podStartE2EDuration="6m16.176305286s" totalImagesPullingTime="802.814267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:00:47.175798946 +0000 UTC m=+375.841998775" watchObservedRunningTime="2026-06-05 00:00:47.176305286 +0000 UTC m=+375.842505103" Jun 05 00:01:36.479159 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:01:36.479113 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:01:36.494839 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:01:36.494808 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:01:37.352447 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:01:37.352418 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 00:03:26.279006 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.278923 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f"] Jun 05 00:03:26.282258 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.282239 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:26.284796 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.284772 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 05 00:03:26.284920 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.284835 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-nxtcc\"" Jun 05 00:03:26.284920 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.284772 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 05 00:03:26.285975 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.285958 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 00:03:26.286059 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.285958 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 00:03:26.293237 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.293217 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f"] Jun 05 00:03:26.369109 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.369069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e537d4cd-7cdc-4308-804d-9a153a898cf6-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-t647f\" (UID: \"e537d4cd-7cdc-4308-804d-9a153a898cf6\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:26.369293 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.369125 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e537d4cd-7cdc-4308-804d-9a153a898cf6-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-t647f\" (UID: \"e537d4cd-7cdc-4308-804d-9a153a898cf6\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:26.369293 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.369180 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqhbc\" (UniqueName: \"kubernetes.io/projected/e537d4cd-7cdc-4308-804d-9a153a898cf6-kube-api-access-mqhbc\") pod \"kubeflow-trainer-controller-manager-857f77d56c-t647f\" (UID: \"e537d4cd-7cdc-4308-804d-9a153a898cf6\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:26.470292 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.470248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e537d4cd-7cdc-4308-804d-9a153a898cf6-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-t647f\" (UID: \"e537d4cd-7cdc-4308-804d-9a153a898cf6\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:26.470495 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.470300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e537d4cd-7cdc-4308-804d-9a153a898cf6-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-t647f\" (UID: \"e537d4cd-7cdc-4308-804d-9a153a898cf6\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:26.470495 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.470327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqhbc\" (UniqueName: \"kubernetes.io/projected/e537d4cd-7cdc-4308-804d-9a153a898cf6-kube-api-access-mqhbc\") pod \"kubeflow-trainer-controller-manager-857f77d56c-t647f\" (UID: \"e537d4cd-7cdc-4308-804d-9a153a898cf6\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:26.470920 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.470896 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e537d4cd-7cdc-4308-804d-9a153a898cf6-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-t647f\" (UID: \"e537d4cd-7cdc-4308-804d-9a153a898cf6\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:26.472767 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.472746 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e537d4cd-7cdc-4308-804d-9a153a898cf6-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-t647f\" (UID: \"e537d4cd-7cdc-4308-804d-9a153a898cf6\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:26.478963 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.478940 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqhbc\" (UniqueName: \"kubernetes.io/projected/e537d4cd-7cdc-4308-804d-9a153a898cf6-kube-api-access-mqhbc\") pod \"kubeflow-trainer-controller-manager-857f77d56c-t647f\" (UID: \"e537d4cd-7cdc-4308-804d-9a153a898cf6\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:26.592169 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.592072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:26.720419 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:26.720382 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f"] Jun 05 00:03:26.723561 ip-10-0-128-106 kubenswrapper[2580]: W0605 00:03:26.723531 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode537d4cd_7cdc_4308_804d_9a153a898cf6.slice/crio-a73117c0bda9f1b60604a645a848fad6654951e0c01c8c9da8e502f9a2d83160 WatchSource:0}: Error finding container a73117c0bda9f1b60604a645a848fad6654951e0c01c8c9da8e502f9a2d83160: Status 404 returned error can't find the container with id a73117c0bda9f1b60604a645a848fad6654951e0c01c8c9da8e502f9a2d83160 Jun 05 00:03:27.728807 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:27.728774 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" event={"ID":"e537d4cd-7cdc-4308-804d-9a153a898cf6","Type":"ContainerStarted","Data":"a73117c0bda9f1b60604a645a848fad6654951e0c01c8c9da8e502f9a2d83160"} Jun 05 00:03:29.738743 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:29.738701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" event={"ID":"e537d4cd-7cdc-4308-804d-9a153a898cf6","Type":"ContainerStarted","Data":"cfef7a80e33437686357ad3fb944198395f4ee2a128db0b0f0f8b5de64992586"} Jun 05 00:03:29.739144 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:29.738768 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:03:29.755136 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:29.755078 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" podStartSLOduration=1.097351767 podStartE2EDuration="3.755060851s" totalImagesPullingTime="2.657709084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 00:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:03:29.753478408 +0000 UTC m=+538.419678227" watchObservedRunningTime="2026-06-05 00:03:29.755060851 +0000 UTC m=+538.421260668" Jun 05 00:03:45.747757 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:03:45.747727 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-t647f" Jun 05 00:04:31.791479 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:04:31.791448 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 05 00:04:31.792079 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:04:31.792059 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 05 00:05:23.054310 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:23.054273 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6"] Jun 05 00:05:23.056369 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:23.056349 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" Jun 05 00:05:23.058768 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:23.058749 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-skdts\"/\"openshift-service-ca.crt\"" Jun 05 00:05:23.059710 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:23.059690 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-skdts\"/\"default-dockercfg-p54b4\"" Jun 05 00:05:23.059768 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:23.059691 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-skdts\"/\"kube-root-ca.crt\"" Jun 05 00:05:23.067244 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:23.067224 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6"] Jun 05 00:05:23.140676 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:23.140606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tfdv\" (UniqueName: \"kubernetes.io/projected/112c91b1-6c10-4c4b-a55b-669684a7e1bf-kube-api-access-5tfdv\") pod \"test-trainjob-n6slc-node-0-0-bvqm6\" (UID: \"112c91b1-6c10-4c4b-a55b-669684a7e1bf\") " pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" Jun 05 00:05:23.242005 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:23.241965 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tfdv\" (UniqueName: \"kubernetes.io/projected/112c91b1-6c10-4c4b-a55b-669684a7e1bf-kube-api-access-5tfdv\") pod \"test-trainjob-n6slc-node-0-0-bvqm6\" (UID: \"112c91b1-6c10-4c4b-a55b-669684a7e1bf\") " pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" Jun 05 00:05:23.249756 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:23.249732 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tfdv\" (UniqueName: \"kubernetes.io/projected/112c91b1-6c10-4c4b-a55b-669684a7e1bf-kube-api-access-5tfdv\") pod \"test-trainjob-n6slc-node-0-0-bvqm6\" (UID: \"112c91b1-6c10-4c4b-a55b-669684a7e1bf\") " pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" Jun 05 00:05:23.365216 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:23.365128 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" Jun 05 00:05:23.491654 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:23.491598 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6"] Jun 05 00:05:23.494575 ip-10-0-128-106 kubenswrapper[2580]: W0605 00:05:23.494548 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod112c91b1_6c10_4c4b_a55b_669684a7e1bf.slice/crio-13bc438c90d16d3b20e83a55f924617fdac46aa010e3198ef382b828f938e1b5 WatchSource:0}: Error finding container 13bc438c90d16d3b20e83a55f924617fdac46aa010e3198ef382b828f938e1b5: Status 404 returned error can't find the container with id 13bc438c90d16d3b20e83a55f924617fdac46aa010e3198ef382b828f938e1b5 Jun 05 00:05:24.150958 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:05:24.150924 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" event={"ID":"112c91b1-6c10-4c4b-a55b-669684a7e1bf","Type":"ContainerStarted","Data":"13bc438c90d16d3b20e83a55f924617fdac46aa010e3198ef382b828f938e1b5"} Jun 05 00:09:41.897809 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:41.897775 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 05 00:09:41.898356 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:41.897775 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 05 00:09:43.239453 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:43.239419 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" event={"ID":"112c91b1-6c10-4c4b-a55b-669684a7e1bf","Type":"ContainerStarted","Data":"f23c455e90b8da85c32ef5b2d5d41e98af814376371fc7225cd59199bb2eaa90"} Jun 05 00:09:43.268778 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:43.268729 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" podStartSLOduration=1.222323338 podStartE2EDuration="4m20.268711578s" totalImagesPullingTime="4m19.04638824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 00:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:09:43.266839322 +0000 UTC m=+911.933039139" watchObservedRunningTime="2026-06-05 00:09:43.268711578 +0000 UTC m=+911.934911396" Jun 05 00:09:43.922442 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:43.922413 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-skdts_test-trainjob-n6slc-node-0-0-bvqm6_112c91b1-6c10-4c4b-a55b-669684a7e1bf/node/0.log" Jun 05 00:09:46.923498 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:46.923457 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-skdts_test-trainjob-n6slc-node-0-0-bvqm6_112c91b1-6c10-4c4b-a55b-669684a7e1bf/node/0.log" Jun 05 00:09:49.923367 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:49.923339 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-skdts_test-trainjob-n6slc-node-0-0-bvqm6_112c91b1-6c10-4c4b-a55b-669684a7e1bf/node/0.log" Jun 05 00:09:50.268697 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:50.268665 2580 generic.go:356] "Generic (PLEG): container finished" podID="112c91b1-6c10-4c4b-a55b-669684a7e1bf" containerID="f23c455e90b8da85c32ef5b2d5d41e98af814376371fc7225cd59199bb2eaa90" exitCode=0 Jun 05 00:09:50.268982 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:50.268744 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" event={"ID":"112c91b1-6c10-4c4b-a55b-669684a7e1bf","Type":"ContainerDied","Data":"f23c455e90b8da85c32ef5b2d5d41e98af814376371fc7225cd59199bb2eaa90"} Jun 05 00:09:51.528483 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:51.528402 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" Jun 05 00:09:51.546999 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:51.546971 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tfdv\" (UniqueName: \"kubernetes.io/projected/112c91b1-6c10-4c4b-a55b-669684a7e1bf-kube-api-access-5tfdv\") pod \"112c91b1-6c10-4c4b-a55b-669684a7e1bf\" (UID: \"112c91b1-6c10-4c4b-a55b-669684a7e1bf\") " Jun 05 00:09:51.549254 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:51.549192 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112c91b1-6c10-4c4b-a55b-669684a7e1bf-kube-api-access-5tfdv" (OuterVolumeSpecName: "kube-api-access-5tfdv") pod "112c91b1-6c10-4c4b-a55b-669684a7e1bf" (UID: "112c91b1-6c10-4c4b-a55b-669684a7e1bf"). InnerVolumeSpecName "kube-api-access-5tfdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 00:09:51.648412 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:51.648375 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tfdv\" (UniqueName: \"kubernetes.io/projected/112c91b1-6c10-4c4b-a55b-669684a7e1bf-kube-api-access-5tfdv\") on node \"ip-10-0-128-106.ec2.internal\" DevicePath \"\"" Jun 05 00:09:52.276884 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:52.276847 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" event={"ID":"112c91b1-6c10-4c4b-a55b-669684a7e1bf","Type":"ContainerDied","Data":"13bc438c90d16d3b20e83a55f924617fdac46aa010e3198ef382b828f938e1b5"} Jun 05 00:09:52.276884 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:52.276891 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13bc438c90d16d3b20e83a55f924617fdac46aa010e3198ef382b828f938e1b5" Jun 05 00:09:52.277134 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:52.276862 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6" Jun 05 00:09:52.922038 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:52.922011 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-skdts_test-trainjob-n6slc-node-0-0-bvqm6_112c91b1-6c10-4c4b-a55b-669684a7e1bf/node/0.log" Jun 05 00:09:53.329692 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:53.329662 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-skdts_test-trainjob-n6slc-node-0-0-bvqm6_112c91b1-6c10-4c4b-a55b-669684a7e1bf/node/0.log" Jun 05 00:09:58.366325 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:58.366285 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6"] Jun 05 00:09:58.370345 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:58.370320 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-skdts/test-trainjob-n6slc-node-0-0-bvqm6"] Jun 05 00:09:59.819932 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:09:59.819898 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="112c91b1-6c10-4c4b-a55b-669684a7e1bf" path="/var/lib/kubelet/pods/112c91b1-6c10-4c4b-a55b-669684a7e1bf/volumes" Jun 05 00:10:10.172873 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:10.172830 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-t647f_e537d4cd-7cdc-4308-804d-9a153a898cf6/manager/0.log" Jun 05 00:10:10.619156 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:10.619115 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-t647f_e537d4cd-7cdc-4308-804d-9a153a898cf6/manager/0.log" Jun 05 00:10:11.056441 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:11.056411 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-t647f_e537d4cd-7cdc-4308-804d-9a153a898cf6/manager/0.log" Jun 05 00:10:47.138288 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.138208 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mzntn/must-gather-grskp"] Jun 05 00:10:47.138769 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.138486 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112c91b1-6c10-4c4b-a55b-669684a7e1bf" containerName="node" Jun 05 00:10:47.138769 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.138502 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="112c91b1-6c10-4c4b-a55b-669684a7e1bf" containerName="node" Jun 05 00:10:47.138769 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.138551 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="112c91b1-6c10-4c4b-a55b-669684a7e1bf" containerName="node" Jun 05 00:10:47.140330 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.140296 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzntn/must-gather-grskp" Jun 05 00:10:47.144544 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.144521 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzntn\"/\"openshift-service-ca.crt\"" Jun 05 00:10:47.144544 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.144542 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzntn\"/\"kube-root-ca.crt\"" Jun 05 00:10:47.145449 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.145427 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mzntn\"/\"default-dockercfg-xzfbw\"" Jun 05 00:10:47.150304 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.150283 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzntn/must-gather-grskp"] Jun 05 00:10:47.203636 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.203574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6b3d36c9-8cec-47cc-a326-a3c7c0d05f66-must-gather-output\") pod \"must-gather-grskp\" (UID: \"6b3d36c9-8cec-47cc-a326-a3c7c0d05f66\") " pod="openshift-must-gather-mzntn/must-gather-grskp" Jun 05 00:10:47.203636 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.203637 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlxwl\" (UniqueName: \"kubernetes.io/projected/6b3d36c9-8cec-47cc-a326-a3c7c0d05f66-kube-api-access-wlxwl\") pod \"must-gather-grskp\" (UID: \"6b3d36c9-8cec-47cc-a326-a3c7c0d05f66\") " pod="openshift-must-gather-mzntn/must-gather-grskp" Jun 05 00:10:47.304461 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.304429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6b3d36c9-8cec-47cc-a326-a3c7c0d05f66-must-gather-output\") pod \"must-gather-grskp\" (UID: \"6b3d36c9-8cec-47cc-a326-a3c7c0d05f66\") " pod="openshift-must-gather-mzntn/must-gather-grskp" Jun 05 00:10:47.304461 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.304463 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlxwl\" (UniqueName: \"kubernetes.io/projected/6b3d36c9-8cec-47cc-a326-a3c7c0d05f66-kube-api-access-wlxwl\") pod \"must-gather-grskp\" (UID: \"6b3d36c9-8cec-47cc-a326-a3c7c0d05f66\") " pod="openshift-must-gather-mzntn/must-gather-grskp" Jun 05 00:10:47.304890 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.304865 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6b3d36c9-8cec-47cc-a326-a3c7c0d05f66-must-gather-output\") pod \"must-gather-grskp\" (UID: \"6b3d36c9-8cec-47cc-a326-a3c7c0d05f66\") " pod="openshift-must-gather-mzntn/must-gather-grskp" Jun 05 00:10:47.315829 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.315799 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlxwl\" (UniqueName: \"kubernetes.io/projected/6b3d36c9-8cec-47cc-a326-a3c7c0d05f66-kube-api-access-wlxwl\") pod \"must-gather-grskp\" (UID: \"6b3d36c9-8cec-47cc-a326-a3c7c0d05f66\") " pod="openshift-must-gather-mzntn/must-gather-grskp" Jun 05 00:10:47.450918 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.450880 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzntn/must-gather-grskp" Jun 05 00:10:47.585963 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.585890 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzntn/must-gather-grskp"] Jun 05 00:10:47.588250 ip-10-0-128-106 kubenswrapper[2580]: W0605 00:10:47.588222 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b3d36c9_8cec_47cc_a326_a3c7c0d05f66.slice/crio-663a0a0e6008816489cf54eb8af2cefb15f587bc66f306d518017e1eceb5f876 WatchSource:0}: Error finding container 663a0a0e6008816489cf54eb8af2cefb15f587bc66f306d518017e1eceb5f876: Status 404 returned error can't find the container with id 663a0a0e6008816489cf54eb8af2cefb15f587bc66f306d518017e1eceb5f876 Jun 05 00:10:47.590165 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:47.590146 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 00:10:48.484609 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:48.484577 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzntn/must-gather-grskp" event={"ID":"6b3d36c9-8cec-47cc-a326-a3c7c0d05f66","Type":"ContainerStarted","Data":"cd1f815333c5241873e16477e93235b4b9c655646551c732f56a67f2ddb79245"} Jun 05 00:10:48.484943 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:48.484638 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzntn/must-gather-grskp" event={"ID":"6b3d36c9-8cec-47cc-a326-a3c7c0d05f66","Type":"ContainerStarted","Data":"663a0a0e6008816489cf54eb8af2cefb15f587bc66f306d518017e1eceb5f876"} Jun 05 00:10:49.491958 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:49.491233 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzntn/must-gather-grskp" event={"ID":"6b3d36c9-8cec-47cc-a326-a3c7c0d05f66","Type":"ContainerStarted","Data":"d06a6e80cdb31bb4f61b34a79b910d1705dbe0da21ef019f70da847d68e53a8e"} Jun 05 00:10:49.508239 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:49.508181 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mzntn/must-gather-grskp" podStartSLOduration=1.804744687 podStartE2EDuration="2.508164195s" totalImagesPullingTime="703.419508ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 00:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:10:49.507743187 +0000 UTC m=+978.173943004" watchObservedRunningTime="2026-06-05 00:10:49.508164195 +0000 UTC m=+978.174364053" Jun 05 00:10:50.039240 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:50.039211 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-75l44_bdea4aec-b853-4f61-a9d2-8f49e919ff54/global-pull-secret-syncer/0.log" Jun 05 00:10:50.132593 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:50.132565 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sf7nj_20a20195-7660-4bd9-b226-935cb0e052cd/konnectivity-agent/0.log" Jun 05 00:10:50.156416 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:50.156383 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-106.ec2.internal_465f1a8207a3957dd83ec2f235253e60/haproxy/0.log" Jun 05 00:10:54.434945 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:54.434849 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jkgwl_d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53/node-exporter/0.log" Jun 05 00:10:54.486888 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:54.486857 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jkgwl_d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53/kube-rbac-proxy/0.log" Jun 05 00:10:54.509086 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:54.509057 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jkgwl_d7ee0c18-fc4e-4c02-bf1c-62fabfd0cf53/init-textfile/0.log" Jun 05 00:10:54.711695 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:54.711668 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d462986f-5cb7-423b-8bff-ae46670c7f79/prometheus/0.log" Jun 05 00:10:54.733318 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:54.733248 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d462986f-5cb7-423b-8bff-ae46670c7f79/config-reloader/0.log" Jun 05 00:10:54.758185 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:54.758151 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d462986f-5cb7-423b-8bff-ae46670c7f79/thanos-sidecar/0.log" Jun 05 00:10:54.780789 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:54.780715 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d462986f-5cb7-423b-8bff-ae46670c7f79/kube-rbac-proxy-web/0.log" Jun 05 00:10:54.811941 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:54.811911 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d462986f-5cb7-423b-8bff-ae46670c7f79/kube-rbac-proxy/0.log" Jun 05 00:10:54.838151 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:54.838120 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d462986f-5cb7-423b-8bff-ae46670c7f79/kube-rbac-proxy-thanos/0.log" Jun 05 00:10:54.863547 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:54.863512 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d462986f-5cb7-423b-8bff-ae46670c7f79/init-config-reloader/0.log" Jun 05 00:10:54.984434 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:54.984355 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8699ccf564-w89p6_c1ce701c-f74c-4097-ac15-be05a541d3a6/telemeter-client/0.log" Jun 05 00:10:55.007338 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:55.007308 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8699ccf564-w89p6_c1ce701c-f74c-4097-ac15-be05a541d3a6/reload/0.log" Jun 05 00:10:55.035192 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:55.035124 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8699ccf564-w89p6_c1ce701c-f74c-4097-ac15-be05a541d3a6/kube-rbac-proxy/0.log" Jun 05 00:10:57.715185 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.715130 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f"] Jun 05 00:10:57.719246 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.719209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.729190 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.729154 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f"] Jun 05 00:10:57.806917 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.806648 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-lib-modules\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.806917 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.806723 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htlt2\" (UniqueName: \"kubernetes.io/projected/c59809cb-7550-44f1-9ce5-b222e87ffdb1-kube-api-access-htlt2\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.806917 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.806773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-podres\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.806917 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.806834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-sys\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.806917 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.806859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-proc\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.907802 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.907768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-sys\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.907802 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.907805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-proc\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.908013 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.907890 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-proc\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.908013 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.907898 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-sys\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.908013 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.907945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-lib-modules\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.908111 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.908012 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htlt2\" (UniqueName: \"kubernetes.io/projected/c59809cb-7550-44f1-9ce5-b222e87ffdb1-kube-api-access-htlt2\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.908111 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.908046 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-lib-modules\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.908111 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.908055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-podres\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.908224 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.908207 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c59809cb-7550-44f1-9ce5-b222e87ffdb1-podres\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:57.915433 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:57.915409 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htlt2\" (UniqueName: \"kubernetes.io/projected/c59809cb-7550-44f1-9ce5-b222e87ffdb1-kube-api-access-htlt2\") pod \"perf-node-gather-daemonset-47g7f\" (UID: \"c59809cb-7550-44f1-9ce5-b222e87ffdb1\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:58.033674 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:58.033557 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:58.194878 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:58.194790 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f"] Jun 05 00:10:58.198324 ip-10-0-128-106 kubenswrapper[2580]: W0605 00:10:58.198295 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc59809cb_7550_44f1_9ce5_b222e87ffdb1.slice/crio-b08055ab0ec9c76f77760acc7e4543c89e588b5bc03b15029003d7f32e1ef6a6 WatchSource:0}: Error finding container b08055ab0ec9c76f77760acc7e4543c89e588b5bc03b15029003d7f32e1ef6a6: Status 404 returned error can't find the container with id b08055ab0ec9c76f77760acc7e4543c89e588b5bc03b15029003d7f32e1ef6a6 Jun 05 00:10:58.539604 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:58.539568 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" event={"ID":"c59809cb-7550-44f1-9ce5-b222e87ffdb1","Type":"ContainerStarted","Data":"2261c913dad49b0bfa3b288fbd0f1e04abb4f1ff37c9a93ce18b8c93f7962e22"} Jun 05 00:10:58.539811 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:58.539641 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" event={"ID":"c59809cb-7550-44f1-9ce5-b222e87ffdb1","Type":"ContainerStarted","Data":"b08055ab0ec9c76f77760acc7e4543c89e588b5bc03b15029003d7f32e1ef6a6"} Jun 05 00:10:58.539811 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:58.539766 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:10:58.556069 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:58.556012 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" podStartSLOduration=1.555992948 podStartE2EDuration="1.555992948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 00:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:10:58.555845588 +0000 UTC m=+987.222045441" watchObservedRunningTime="2026-06-05 00:10:58.555992948 +0000 UTC m=+987.222192766" Jun 05 00:10:58.886389 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:58.886357 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vb5c9_657f2cdc-9bb9-473b-8995-d0d7dda848c6/dns/0.log" Jun 05 00:10:58.914594 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:58.914561 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vb5c9_657f2cdc-9bb9-473b-8995-d0d7dda848c6/kube-rbac-proxy/0.log" Jun 05 00:10:58.937872 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:58.937844 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jslst_12da72fc-3b84-4c07-b99c-ffe403e16866/dns-node-resolver/0.log" Jun 05 00:10:59.404652 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:59.404609 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-697cc9c9dd-dd9sf_d141eed4-8d62-4a3e-90e9-bb00959d151d/registry/0.log" Jun 05 00:10:59.444184 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:10:59.444144 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5snc_09fa269c-7602-4596-9168-16eeee6b7f58/node-ca/0.log" Jun 05 00:11:00.572603 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:00.572569 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kfcbd_dffd8526-aeb4-497c-8db8-baeb9210b45e/serve-healthcheck-canary/0.log" Jun 05 00:11:01.115180 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:01.115147 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q6jnp_37935c87-d716-4a42-b5dc-b53fdb3dee29/kube-rbac-proxy/0.log" Jun 05 00:11:01.137634 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:01.137589 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q6jnp_37935c87-d716-4a42-b5dc-b53fdb3dee29/exporter/0.log" Jun 05 00:11:01.166506 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:01.166479 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q6jnp_37935c87-d716-4a42-b5dc-b53fdb3dee29/extractor/0.log" Jun 05 00:11:04.558007 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:04.557978 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-47g7f" Jun 05 00:11:07.356763 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:07.356732 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd4jh_b8b814b6-a60f-48c6-b54c-747d9e98255d/kube-multus-additional-cni-plugins/0.log" Jun 05 00:11:07.380436 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:07.380333 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd4jh_b8b814b6-a60f-48c6-b54c-747d9e98255d/egress-router-binary-copy/0.log" Jun 05 00:11:07.458941 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:07.458903 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd4jh_b8b814b6-a60f-48c6-b54c-747d9e98255d/cni-plugins/0.log" Jun 05 00:11:07.511602 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:07.511574 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd4jh_b8b814b6-a60f-48c6-b54c-747d9e98255d/bond-cni-plugin/0.log" Jun 05 00:11:07.529776 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:07.529750 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd4jh_b8b814b6-a60f-48c6-b54c-747d9e98255d/routeoverride-cni/0.log" Jun 05 00:11:07.582515 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:07.582426 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd4jh_b8b814b6-a60f-48c6-b54c-747d9e98255d/whereabouts-cni-bincopy/0.log" Jun 05 00:11:07.600695 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:07.600661 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd4jh_b8b814b6-a60f-48c6-b54c-747d9e98255d/whereabouts-cni/0.log" Jun 05 00:11:07.982917 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:07.982887 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h9626_b4f5b81a-02f9-461e-ab5a-cdb7c9c5bb23/kube-multus/0.log" Jun 05 00:11:08.128475 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:08.128440 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mfdvb_94ed26b6-3c80-446a-9d43-8fa9d78a5e13/network-metrics-daemon/0.log" Jun 05 00:11:08.150467 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:08.150435 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mfdvb_94ed26b6-3c80-446a-9d43-8fa9d78a5e13/kube-rbac-proxy/0.log" Jun 05 00:11:09.165679 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:09.165630 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-controller/0.log" Jun 05 00:11:09.183655 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:09.183612 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/1.log" Jun 05 00:11:09.183833 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:09.183699 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovn-acl-logging/0.log" Jun 05 00:11:09.214262 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:09.214198 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/kube-rbac-proxy-node/0.log" Jun 05 00:11:09.244218 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:09.244138 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 00:11:09.263369 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:09.263333 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/northd/0.log" Jun 05 00:11:09.286821 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:09.286789 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/nbdb/0.log" Jun 05 00:11:09.310306 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:09.310261 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/sbdb/0.log" Jun 05 00:11:09.370578 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:09.370548 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx6tr_e70866f5-2cae-4748-826e-b5442dfd9bfd/ovnkube-controller/0.log" Jun 05 00:11:10.552734 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:10.552704 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-s4xxl_2bc1016f-ddb7-4d65-87dc-d3f532e9dab3/check-endpoints/0.log" Jun 05 00:11:10.590689 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:10.590635 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hmn77_70f39a44-5d89-41a9-8231-a54b49e3c8a3/network-check-target-container/0.log" Jun 05 00:11:11.523408 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:11.523378 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-4h5mh_da06910d-4f1c-4d28-a21a-bb59e3f32252/iptables-alerter/0.log" Jun 05 00:11:12.182274 ip-10-0-128-106 kubenswrapper[2580]: I0605 00:11:12.182237 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-2hgwg_a0d775f2-7e3c-45ef-a4ea-c6576050636e/tuned/0.log"