Jun 02 09:32:26.496422 ip-10-0-130-85 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 09:32:26.496433 ip-10-0-130-85 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 09:32:26.496440 ip-10-0-130-85 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 09:32:26.496669 ip-10-0-130-85 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 09:32:36.675787 ip-10-0-130-85 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 09:32:36.675809 ip-10-0-130-85 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1ad7c36baa4c452795d7eab0379b41b9 -- Jun 02 09:35:00.144150 ip-10-0-130-85 systemd[1]: Starting Kubernetes Kubelet... Jun 02 09:35:00.567490 ip-10-0-130-85 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 09:35:00.567490 ip-10-0-130-85 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 09:35:00.567490 ip-10-0-130-85 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 09:35:00.567490 ip-10-0-130-85 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 09:35:00.567490 ip-10-0-130-85 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 09:35:00.568869 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.568745 2567 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 09:35:00.572217 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572197 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 09:35:00.572217 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572214 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 09:35:00.572217 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572219 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 09:35:00.572217 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572224 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572229 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572233 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572238 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572242 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572246 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572250 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572254 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572257 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572263 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572267 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572270 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572274 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572278 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572282 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572286 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572290 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572294 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572298 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 09:35:00.572461 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572302 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572307 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572311 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572315 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572318 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572322 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572326 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572330 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572337 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572343 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572348 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572353 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572358 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572363 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572367 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572371 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572376 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572380 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572385 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572390 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 09:35:00.573258 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572394 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572398 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572402 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572406 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572410 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572414 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572419 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572423 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572427 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572431 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572435 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572439 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572444 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572448 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572452 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572456 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572460 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572464 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572470 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572476 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 09:35:00.573960 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572481 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572485 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572490 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572493 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572498 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572503 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572507 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572513 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572518 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572523 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572527 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572533 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572538 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572543 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572549 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572553 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572557 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572561 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572566 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572570 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 09:35:00.574507 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572573 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572578 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572582 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.572586 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573209 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573218 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573222 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573226 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573231 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573235 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573239 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573245 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573249 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573253 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573257 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573261 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573265 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573269 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573272 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 09:35:00.575148 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573278 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573282 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573287 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573291 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573302 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573307 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573311 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573315 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573319 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573323 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573327 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573331 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573335 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573339 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573344 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573348 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573352 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573356 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573360 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573364 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 09:35:00.575958 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573368 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573372 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573376 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573380 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573385 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573390 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573394 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573398 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573402 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573406 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573410 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573414 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573419 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573423 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573427 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573434 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573440 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573451 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573456 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 09:35:00.576643 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573461 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573465 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573469 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573473 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573477 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573482 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573485 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573491 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573496 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573500 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573504 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573507 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573513 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573517 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573521 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573526 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573531 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573538 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573543 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573547 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 09:35:00.577302 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573552 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573556 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573560 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573564 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573568 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573573 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573577 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573583 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573588 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573592 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573596 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.573602 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574851 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574869 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574881 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574888 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574895 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574900 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574907 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574915 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574920 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 09:35:00.577961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574926 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574931 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574937 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574942 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574948 2567 flags.go:64] FLAG: --cgroup-root="" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574953 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574957 2567 flags.go:64] FLAG: --client-ca-file="" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574963 2567 flags.go:64] FLAG: --cloud-config="" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574968 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574973 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574979 2567 flags.go:64] FLAG: --cluster-domain="" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574984 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574990 2567 flags.go:64] FLAG: --config-dir="" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.574995 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575001 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575007 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575012 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575017 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575023 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575028 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575033 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575038 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575043 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575058 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575065 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 09:35:00.578576 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575070 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575074 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575079 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575084 2567 flags.go:64] FLAG: --enable-server="true" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575089 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575107 2567 flags.go:64] FLAG: --event-burst="100" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575112 2567 flags.go:64] FLAG: --event-qps="50" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575117 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575122 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575127 2567 flags.go:64] FLAG: --eviction-hard="" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575133 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575138 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575143 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575148 2567 flags.go:64] FLAG: --eviction-soft="" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575152 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575157 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575162 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575167 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575172 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575176 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575181 2567 flags.go:64] FLAG: --feature-gates="" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575187 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575193 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575198 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575203 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575208 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 02 09:35:00.579298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575213 2567 flags.go:64] FLAG: --help="false" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575218 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-130-85.ec2.internal" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575223 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575229 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575233 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575247 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575253 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575257 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575262 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575267 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575272 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575277 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575282 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575286 2567 flags.go:64] FLAG: --kube-reserved="" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575291 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575296 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575301 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575306 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575311 2567 flags.go:64] FLAG: --lock-file="" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575316 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575321 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575326 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575335 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 09:35:00.579958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575340 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575345 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575350 2567 flags.go:64] FLAG: --logging-format="text" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575355 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575361 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575365 2567 flags.go:64] FLAG: --manifest-url="" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575370 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575380 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575386 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575392 2567 flags.go:64] FLAG: --max-pods="110" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575397 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575402 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575406 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575411 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575416 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575429 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575434 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575446 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575451 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575456 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575460 2567 flags.go:64] FLAG: --pod-cidr="" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575465 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575475 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575480 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 09:35:00.580556 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575485 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575489 2567 flags.go:64] FLAG: --port="10250" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575494 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575498 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02d664d4659309cdd" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575504 2567 flags.go:64] FLAG: --qos-reserved="" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575510 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575515 2567 flags.go:64] FLAG: --register-node="true" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575520 2567 flags.go:64] FLAG: --register-schedulable="true" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575525 2567 flags.go:64] FLAG: --register-with-taints="" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575530 2567 flags.go:64] FLAG: --registry-burst="10" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575535 2567 flags.go:64] FLAG: --registry-qps="5" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575539 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575544 2567 flags.go:64] FLAG: --reserved-memory="" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575550 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575555 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575560 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575565 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575569 2567 flags.go:64] FLAG: --runonce="false" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575574 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575579 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575584 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575589 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575594 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575599 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575611 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575616 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 09:35:00.581146 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575621 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575626 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575631 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575636 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575641 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575646 2567 flags.go:64] FLAG: --system-cgroups="" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575651 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575660 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575665 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575670 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575680 2567 flags.go:64] FLAG: --tls-min-version="" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575685 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575690 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575695 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575699 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575705 2567 flags.go:64] FLAG: --v="2" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575711 2567 flags.go:64] FLAG: --version="false" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575717 2567 flags.go:64] FLAG: --vmodule="" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575724 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.575729 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575922 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575930 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575935 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575940 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 09:35:00.581759 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575944 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575949 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575953 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575958 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575962 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575966 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575970 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575975 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575980 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575984 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575988 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575992 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.575996 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576000 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576009 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576013 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576017 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576021 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576025 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576029 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 09:35:00.582415 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576034 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576038 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576042 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576046 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576050 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576055 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576059 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576063 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576068 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576072 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576076 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576081 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576094 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576098 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576102 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576106 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576110 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576114 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576118 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576122 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 09:35:00.582985 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576136 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576140 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576147 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576155 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576159 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576163 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576169 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576173 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576178 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576182 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576186 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576190 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576195 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576199 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576204 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576208 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576212 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576217 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576221 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576226 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 09:35:00.583745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576230 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576234 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576239 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576242 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576246 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576250 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576254 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576258 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576262 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576267 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576271 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576275 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576279 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576290 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576295 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576300 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576304 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576310 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576319 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 09:35:00.584345 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576324 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576329 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.576333 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.577050 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.584209 2567 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.584224 2567 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584270 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584275 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584278 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584281 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584284 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584287 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584289 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584292 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584295 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 09:35:00.584876 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584297 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584300 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584303 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584305 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584308 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584312 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584317 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584320 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584323 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584325 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584328 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584330 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584333 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584336 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584338 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584342 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584344 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584347 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584350 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584353 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 09:35:00.585294 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584356 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584359 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584362 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584365 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584368 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584371 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584374 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584376 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584379 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584382 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584384 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584387 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584390 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584392 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584395 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584397 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584400 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584402 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584405 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 09:35:00.585853 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584407 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584410 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584413 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584415 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584418 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584421 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584423 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584426 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584428 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584431 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584433 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584436 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584438 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584441 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584444 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584447 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584450 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584452 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584455 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584457 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 09:35:00.586321 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584460 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584462 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584465 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584467 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584470 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584473 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584475 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584478 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584481 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584484 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584486 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584489 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584491 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584494 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584498 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584502 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584505 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 09:35:00.586922 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584508 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.584513 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584607 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584612 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584615 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584618 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584621 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584624 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584626 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584629 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584632 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584636 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584641 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584645 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584648 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 09:35:00.587348 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584650 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584653 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584656 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584659 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584662 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584665 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584667 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584670 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584673 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584677 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584679 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584682 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584684 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584687 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584689 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584692 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584695 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584698 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584701 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584703 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 09:35:00.587745 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584706 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584708 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584711 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584713 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584716 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584719 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584722 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584725 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584727 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584730 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584733 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584735 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584738 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584740 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584743 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584745 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584748 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584750 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584753 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584755 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 09:35:00.588256 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584758 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584761 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584764 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584766 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584769 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584772 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584774 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584777 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584779 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584782 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584784 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584787 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584789 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584792 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584794 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584797 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584799 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584822 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584826 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584829 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 09:35:00.588749 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584831 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584834 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584837 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584839 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584842 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584844 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584847 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584849 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584852 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584854 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584857 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584859 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:00.584862 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.584866 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.585523 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 09:35:00.589244 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.587767 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 09:35:00.589625 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.588669 2567 server.go:1019] "Starting client certificate rotation" Jun 02 09:35:00.589625 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.588767 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 09:35:00.589625 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.588822 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 09:35:00.610794 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.610777 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 09:35:00.615774 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.615757 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 09:35:00.627416 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.627398 2567 log.go:25] "Validated CRI v1 runtime API" Jun 02 09:35:00.633524 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.633509 2567 log.go:25] "Validated CRI v1 image API" Jun 02 09:35:00.634822 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.634794 2567 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 09:35:00.637249 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.637231 2567 fs.go:135] Filesystem UUIDs: map[54f2ec88-9ef3-4c43-8230-2a5211ff67a8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7c8d70bc-8d78-44d9-a8f3-115798867b1c:/dev/nvme0n1p3] Jun 02 09:35:00.637299 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.637249 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 09:35:00.644058 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.643942 2567 manager.go:217] Machine: {Timestamp:2026-06-02 09:35:00.643403976 +0000 UTC m=+0.388264634 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097443 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29753972bee69e01287e589a59a0fe SystemUUID:ec297539-72be-e69e-0128-7e589a59a0fe BootID:1ad7c36b-aa4c-4527-95d7-eab0379b41b9 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:1e:69:4b:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:1e:69:4b:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:ff:8e:0e:22:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 09:35:00.644058 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.644048 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 09:35:00.644215 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.644132 2567 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 09:35:00.644324 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.644306 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 09:35:00.645993 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.645963 2567 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 09:35:00.646125 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.645996 2567 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-85.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 09:35:00.646168 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.646134 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 09:35:00.646168 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.646142 2567 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 09:35:00.646168 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.646149 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 09:35:00.646911 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.646900 2567 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 09:35:00.648182 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.648172 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 02 09:35:00.648302 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.648293 2567 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 09:35:00.650588 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.650579 2567 kubelet.go:491] "Attempting to sync node with API server" Jun 02 09:35:00.650621 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.650591 2567 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 09:35:00.650621 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.650603 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 09:35:00.650621 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.650611 2567 kubelet.go:397] "Adding apiserver pod source" Jun 02 09:35:00.650621 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.650620 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 09:35:00.651610 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.651598 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 09:35:00.651666 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.651617 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 09:35:00.654975 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.654953 2567 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 09:35:00.656532 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.656519 2567 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 09:35:00.658527 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658516 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 09:35:00.658564 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658532 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 09:35:00.658564 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658538 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 09:35:00.658564 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658544 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 09:35:00.658564 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658552 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 09:35:00.658564 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658558 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 09:35:00.658564 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658563 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 09:35:00.658719 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658572 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 09:35:00.658719 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658580 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 09:35:00.658719 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658586 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 09:35:00.658719 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658595 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 09:35:00.658719 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.658600 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 09:35:00.659448 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.659438 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 09:35:00.659480 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.659461 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 09:35:00.662527 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.662514 2567 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 09:35:00.662566 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.662548 2567 server.go:1295] "Started kubelet" Jun 02 09:35:00.662709 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.662667 2567 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 09:35:00.662764 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.662732 2567 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 09:35:00.663400 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.663369 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 09:35:00.663429 ip-10-0-130-85 systemd[1]: Started Kubernetes Kubelet. Jun 02 09:35:00.664018 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.663862 2567 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 09:35:00.665311 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.665291 2567 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-85.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 09:35:00.665943 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.665906 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 09:35:00.666027 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.665907 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 09:35:00.666362 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.666344 2567 server.go:317] "Adding debug handlers to kubelet server" Jun 02 09:35:00.668269 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.668254 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 09:35:00.668347 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.668270 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 09:35:00.669420 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.668440 2567 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 09:35:00.669420 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.668454 2567 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 09:35:00.669420 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.668597 2567 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 09:35:00.669420 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.668664 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 02 09:35:00.669420 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.668672 2567 reconciler.go:26] "Reconciler: start to sync state" Jun 02 09:35:00.669420 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.669217 2567 factory.go:55] Registering systemd factory Jun 02 09:35:00.669420 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.669234 2567 factory.go:223] Registration of the systemd container factory successfully Jun 02 09:35:00.669420 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.669279 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 02 09:35:00.669841 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.669435 2567 factory.go:153] Registering CRI-O factory Jun 02 09:35:00.669841 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.669446 2567 factory.go:223] Registration of the crio container factory successfully Jun 02 09:35:00.669841 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.669485 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 09:35:00.670047 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.670032 2567 factory.go:103] Registering Raw factory Jun 02 09:35:00.670110 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.670057 2567 manager.go:1196] Started watching for new ooms in manager Jun 02 09:35:00.670770 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.670747 2567 manager.go:319] Starting recovery of all containers Jun 02 09:35:00.670890 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.670868 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 09:35:00.671478 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.671382 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 09:35:00.672181 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.670984 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-85.ec2.internal.18b539e9049e03f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-85.ec2.internal,UID:ip-10-0-130-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-85.ec2.internal,},FirstTimestamp:2026-06-02 09:35:00.662526969 +0000 UTC m=+0.407387628,LastTimestamp:2026-06-02 09:35:00.662526969 +0000 UTC m=+0.407387628,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-85.ec2.internal,}" Jun 02 09:35:00.674472 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.674313 2567 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 09:35:00.674823 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.674789 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6fn4t" Jun 02 09:35:00.682606 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.682585 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6fn4t" Jun 02 09:35:00.683224 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.683208 2567 manager.go:324] Recovery completed Jun 02 09:35:00.687190 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.687178 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 09:35:00.688878 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.688863 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 02 09:35:00.688950 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.688889 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 09:35:00.688950 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.688899 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 02 09:35:00.689350 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.689335 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 09:35:00.689350 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.689346 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 09:35:00.689454 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.689359 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 02 09:35:00.691212 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.691199 2567 policy_none.go:49] "None policy: Start" Jun 02 09:35:00.691274 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.691216 2567 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 09:35:00.691274 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.691233 2567 state_mem.go:35] "Initializing new in-memory state store" Jun 02 09:35:00.691274 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.691194 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-85.ec2.internal.18b539e90630164d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-85.ec2.internal,UID:ip-10-0-130-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-85.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-85.ec2.internal,},FirstTimestamp:2026-06-02 09:35:00.688877133 +0000 UTC m=+0.433737791,LastTimestamp:2026-06-02 09:35:00.688877133 +0000 UTC m=+0.433737791,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-85.ec2.internal,}" Jun 02 09:35:00.734382 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.734367 2567 manager.go:341] "Starting Device Plugin manager" Jun 02 09:35:00.736950 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.734397 2567 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 09:35:00.736950 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.734407 2567 server.go:85] "Starting device plugin registration server" Jun 02 09:35:00.736950 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.734601 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 09:35:00.736950 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.734611 2567 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 09:35:00.736950 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.734691 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 09:35:00.736950 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.734759 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 09:35:00.736950 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.734770 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 09:35:00.736950 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.735292 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 09:35:00.736950 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.735336 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-85.ec2.internal\" not found" Jun 02 09:35:00.794025 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.793997 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 09:35:00.795180 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.795165 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 09:35:00.795256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.795191 2567 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 09:35:00.795256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.795207 2567 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 09:35:00.795256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.795215 2567 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 09:35:00.795384 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.795255 2567 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 09:35:00.798606 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.798585 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 09:35:00.835531 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.835483 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 09:35:00.836429 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.836415 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 02 09:35:00.836508 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.836442 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 09:35:00.836508 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.836452 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 02 09:35:00.836508 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.836474 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-85.ec2.internal" Jun 02 09:35:00.845237 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.845220 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-85.ec2.internal" Jun 02 09:35:00.845279 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.845239 2567 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-85.ec2.internal\": node \"ip-10-0-130-85.ec2.internal\" not found" Jun 02 09:35:00.855880 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.855863 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 02 09:35:00.896025 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.896007 2567 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal"] Jun 02 09:35:00.896075 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.896057 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 09:35:00.897324 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.897312 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 02 09:35:00.897393 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.897336 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 09:35:00.897393 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.897345 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 02 09:35:00.898429 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.898416 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 09:35:00.898598 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.898585 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 02 09:35:00.898646 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.898609 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 09:35:00.899476 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.899450 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 02 09:35:00.899566 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.899479 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 09:35:00.899566 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.899451 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 02 09:35:00.899566 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.899517 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 09:35:00.899566 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.899529 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 02 09:35:00.899566 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.899495 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 02 09:35:00.900606 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.900590 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 02 09:35:00.900687 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.900621 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 09:35:00.901288 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.901275 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientMemory" Jun 02 09:35:00.901358 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.901299 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 09:35:00.901358 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.901310 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeHasSufficientPID" Jun 02 09:35:00.926367 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.926350 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-85.ec2.internal\" not found" node="ip-10-0-130-85.ec2.internal" Jun 02 09:35:00.930642 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.930623 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-85.ec2.internal\" not found" node="ip-10-0-130-85.ec2.internal" Jun 02 09:35:00.956220 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:00.956200 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 02 09:35:00.970094 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.970069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04663179e1eba50a8978c5ee623c34af-config\") pod \"kube-apiserver-proxy-ip-10-0-130-85.ec2.internal\" (UID: \"04663179e1eba50a8978c5ee623c34af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 02 09:35:00.970173 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.970098 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d9b405a1f2c345c58facdeefc16d450-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"7d9b405a1f2c345c58facdeefc16d450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 02 09:35:00.970173 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:00.970115 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d9b405a1f2c345c58facdeefc16d450-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"7d9b405a1f2c345c58facdeefc16d450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 02 09:35:01.057036 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.057009 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 02 09:35:01.070401 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.070374 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04663179e1eba50a8978c5ee623c34af-config\") pod \"kube-apiserver-proxy-ip-10-0-130-85.ec2.internal\" (UID: \"04663179e1eba50a8978c5ee623c34af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 02 09:35:01.070401 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.070405 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d9b405a1f2c345c58facdeefc16d450-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"7d9b405a1f2c345c58facdeefc16d450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 02 09:35:01.070552 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.070421 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d9b405a1f2c345c58facdeefc16d450-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"7d9b405a1f2c345c58facdeefc16d450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 02 09:35:01.070552 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.070458 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04663179e1eba50a8978c5ee623c34af-config\") pod \"kube-apiserver-proxy-ip-10-0-130-85.ec2.internal\" (UID: \"04663179e1eba50a8978c5ee623c34af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 02 09:35:01.070552 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.070479 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d9b405a1f2c345c58facdeefc16d450-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"7d9b405a1f2c345c58facdeefc16d450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 02 09:35:01.070552 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.070463 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d9b405a1f2c345c58facdeefc16d450-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal\" (UID: \"7d9b405a1f2c345c58facdeefc16d450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 02 09:35:01.157794 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.157741 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 02 09:35:01.228242 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.228222 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 02 09:35:01.233648 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.233634 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 02 09:35:01.258363 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.258317 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 02 09:35:01.358839 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.358818 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 02 09:35:01.459368 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.459306 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 02 09:35:01.559873 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.559849 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-85.ec2.internal\" not found" Jun 02 09:35:01.589341 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.589313 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 09:35:01.589898 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.589503 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 09:35:01.642066 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.641964 2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 09:35:01.651514 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.651495 2567 apiserver.go:52] "Watching apiserver" Jun 02 09:35:01.663275 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.663252 2567 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 09:35:01.663567 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.663545 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-bnrb7","openshift-multus/multus-47cqt","openshift-multus/network-metrics-daemon-qcqzq","openshift-network-operator/iptables-alerter-bqlsv","kube-system/konnectivity-agent-lnqkc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj","openshift-multus/multus-additional-cni-plugins-8p8wt","openshift-network-diagnostics/network-check-target-hzrnz","openshift-ovn-kubernetes/ovnkube-node-kzhrr","openshift-cluster-node-tuning-operator/tuned-8lq28"] Jun 02 09:35:01.666227 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.666205 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bnrb7" Jun 02 09:35:01.667194 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.667163 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.668272 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.668251 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:01.668380 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.668358 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:01.668436 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.668369 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bqlsv" Jun 02 09:35:01.668596 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.668575 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 09:35:01.668693 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.668643 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" Jun 02 09:35:01.669323 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.669304 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 09:35:01.669418 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.669381 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 09:35:01.669418 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.669413 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 09:35:01.669854 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.669837 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2frd5\"" Jun 02 09:35:01.669948 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.669889 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:01.670263 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.670247 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 09:35:01.670483 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:01.670451 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9b405a1f2c345c58facdeefc16d450.slice/crio-962719e8ba6ade3ea29a61e7d073c6b3e5fc78593b62b7619a17271963e93562 WatchSource:0}: Error finding container 962719e8ba6ade3ea29a61e7d073c6b3e5fc78593b62b7619a17271963e93562: Status 404 returned error can't find the container with id 962719e8ba6ade3ea29a61e7d073c6b3e5fc78593b62b7619a17271963e93562 Jun 02 09:35:01.670644 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.670607 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 09:35:01.670717 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.670690 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 09:35:01.670773 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:01.670760 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04663179e1eba50a8978c5ee623c34af.slice/crio-ace0c6f667125c6c3d3b9d07e12bc757237c84abe90fa201ed6bb38a58a20d3c WatchSource:0}: Error finding container ace0c6f667125c6c3d3b9d07e12bc757237c84abe90fa201ed6bb38a58a20d3c: Status 404 returned error can't find the container with id ace0c6f667125c6c3d3b9d07e12bc757237c84abe90fa201ed6bb38a58a20d3c Jun 02 09:35:01.670959 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.670941 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zzwgf\"" Jun 02 09:35:01.671055 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.671029 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 09:35:01.671110 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.671055 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 09:35:01.671110 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.671060 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 09:35:01.671474 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.671317 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 09:35:01.671474 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.671422 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.671661 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.671476 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fqpbc\"" Jun 02 09:35:01.673108 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673088 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.673245 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673228 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-run-multus-certs\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673313 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673264 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe668441-597d-403b-b87f-2a247ff1743f-cni-binary-copy\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673369 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-var-lib-cni-bin\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673369 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-hostroot\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673369 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsfcj\" (UniqueName: \"kubernetes.io/projected/c107eb09-ff9f-443d-b736-00e14196e10a-kube-api-access-zsfcj\") pod \"iptables-alerter-bqlsv\" (UID: \"c107eb09-ff9f-443d-b736-00e14196e10a\") " pod="openshift-network-operator/iptables-alerter-bqlsv" Jun 02 09:35:01.673508 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b18a0c7-3fde-496c-b705-add77782201a-host\") pod \"node-ca-bnrb7\" (UID: \"9b18a0c7-3fde-496c-b705-add77782201a\") " pod="openshift-image-registry/node-ca-bnrb7" Jun 02 09:35:01.673508 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-os-release\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673508 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673446 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-run-k8s-cni-cncf-io\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673508 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673479 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c107eb09-ff9f-443d-b736-00e14196e10a-iptables-alerter-script\") pod \"iptables-alerter-bqlsv\" (UID: \"c107eb09-ff9f-443d-b736-00e14196e10a\") " pod="openshift-network-operator/iptables-alerter-bqlsv" Jun 02 09:35:01.673508 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d05c79d-aea4-4e8d-8cc7-2777d005b485-agent-certs\") pod \"konnectivity-agent-lnqkc\" (UID: \"9d05c79d-aea4-4e8d-8cc7-2777d005b485\") " pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:01.673697 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-system-cni-dir\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673697 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673634 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl8rm\" (UniqueName: \"kubernetes.io/projected/9b18a0c7-3fde-496c-b705-add77782201a-kube-api-access-bl8rm\") pod \"node-ca-bnrb7\" (UID: \"9b18a0c7-3fde-496c-b705-add77782201a\") " pod="openshift-image-registry/node-ca-bnrb7" Jun 02 09:35:01.673697 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-var-lib-cni-multus\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673785 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-etc-kubernetes\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673785 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673724 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-cnibin\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673785 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673745 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-var-lib-kubelet\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673785 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqcr7\" (UniqueName: \"kubernetes.io/projected/fe668441-597d-403b-b87f-2a247ff1743f-kube-api-access-vqcr7\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:01.673958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673836 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c107eb09-ff9f-443d-b736-00e14196e10a-host-slash\") pod \"iptables-alerter-bqlsv\" (UID: \"c107eb09-ff9f-443d-b736-00e14196e10a\") " pod="openshift-network-operator/iptables-alerter-bqlsv" Jun 02 09:35:01.673958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-run-netns\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-multus-conf-dir\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.673958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673904 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d05c79d-aea4-4e8d-8cc7-2777d005b485-konnectivity-ca\") pod \"konnectivity-agent-lnqkc\" (UID: \"9d05c79d-aea4-4e8d-8cc7-2777d005b485\") " pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:01.673958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673927 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb8t8\" (UniqueName: \"kubernetes.io/projected/17dcae50-58fd-49b1-8afa-88e5b3eca13b-kube-api-access-kb8t8\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:01.673958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673945 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b18a0c7-3fde-496c-b705-add77782201a-serviceca\") pod \"node-ca-bnrb7\" (UID: \"9b18a0c7-3fde-496c-b705-add77782201a\") " pod="openshift-image-registry/node-ca-bnrb7" Jun 02 09:35:01.674304 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673958 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-multus-cni-dir\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.674304 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.673988 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-multus-socket-dir-parent\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.674304 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.674020 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe668441-597d-403b-b87f-2a247ff1743f-multus-daemon-config\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.674304 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.674212 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:01.674304 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.674281 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:01.675012 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.674999 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 09:35:01.675680 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.675564 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.676827 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.676792 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.677567 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.677554 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 09:35:01.677782 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.677766 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 09:35:01.677782 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.677788 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 09:35:01.677944 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.677893 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 09:35:01.677944 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.677924 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 09:35:01.677944 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.677931 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 09:35:01.678090 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.677950 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qp4wb\"" Jun 02 09:35:01.678436 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.678417 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cw7kt\"" Jun 02 09:35:01.678510 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.678473 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7sgw6\"" Jun 02 09:35:01.678510 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.678496 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 09:35:01.678735 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.678715 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 09:35:01.678735 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.678731 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 09:35:01.678915 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.678829 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 09:35:01.679049 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.679034 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 09:35:01.679138 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.679122 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6clmd\"" Jun 02 09:35:01.679177 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.679164 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 09:35:01.682673 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.682649 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 09:35:01.683066 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.683046 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal"] Jun 02 09:35:01.683158 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.683098 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 09:35:01.683215 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.683189 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" Jun 02 09:35:01.684956 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.684741 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 09:30:00 +0000 UTC" deadline="2027-11-10 04:15:22.844892398 +0000 UTC" Jun 02 09:35:01.684956 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.684769 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12618h40m21.160126996s" Jun 02 09:35:01.686624 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.686608 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 09:35:01.686880 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.686865 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 09:35:01.689577 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.689559 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-czx4c\"" Jun 02 09:35:01.691410 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.691395 2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 09:35:01.692076 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.692058 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 09:35:01.703642 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.703622 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal"] Jun 02 09:35:01.703742 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.703730 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 09:35:01.714341 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.714323 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-znddw" Jun 02 09:35:01.723277 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.723260 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-znddw" Jun 02 09:35:01.769700 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.769682 2567 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 09:35:01.774334 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-run\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.774396 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-lib-modules\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.774396 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774362 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe668441-597d-403b-b87f-2a247ff1743f-multus-daemon-config\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.774396 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774387 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-modprobe-d\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.774569 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774409 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-var-lib-openvswitch\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.774569 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774435 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72fg4\" (UniqueName: \"kubernetes.io/projected/a7166909-a47b-48ac-b6d2-edf79e57794f-kube-api-access-72fg4\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.774569 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774462 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-var-lib-cni-bin\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.774569 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774486 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-hostroot\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.774569 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774510 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-systemd\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.774569 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774513 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-var-lib-cni-bin\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.774569 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774539 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-hostroot\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.774569 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774569 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-etc-selinux\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774588 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b18a0c7-3fde-496c-b705-add77782201a-host\") pod \"node-ca-bnrb7\" (UID: \"9b18a0c7-3fde-496c-b705-add77782201a\") " pod="openshift-image-registry/node-ca-bnrb7" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774604 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-os-release\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774635 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c107eb09-ff9f-443d-b736-00e14196e10a-iptables-alerter-script\") pod \"iptables-alerter-bqlsv\" (UID: \"c107eb09-ff9f-443d-b736-00e14196e10a\") " pod="openshift-network-operator/iptables-alerter-bqlsv" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774712 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d05c79d-aea4-4e8d-8cc7-2777d005b485-agent-certs\") pod \"konnectivity-agent-lnqkc\" (UID: \"9d05c79d-aea4-4e8d-8cc7-2777d005b485\") " pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774719 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-os-release\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774719 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b18a0c7-3fde-496c-b705-add77782201a-host\") pod \"node-ca-bnrb7\" (UID: \"9b18a0c7-3fde-496c-b705-add77782201a\") " pod="openshift-image-registry/node-ca-bnrb7" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774754 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7166909-a47b-48ac-b6d2-edf79e57794f-ovn-node-metrics-cert\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774787 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-system-cni-dir\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmhf2\" (UniqueName: \"kubernetes.io/projected/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-kube-api-access-mmhf2\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774857 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-node-log\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774869 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-system-cni-dir\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-log-socket\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774910 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-var-lib-cni-multus\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.774919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774914 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe668441-597d-403b-b87f-2a247ff1743f-multus-daemon-config\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774935 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-etc-kubernetes\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774962 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-sys\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.774988 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcrrd\" (UniqueName: \"kubernetes.io/projected/a2a72eb3-f28c-4737-afdc-9ebe86a28502-kube-api-access-vcrrd\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-var-lib-cni-multus\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775006 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-etc-kubernetes\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-socket-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775039 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsn94\" (UniqueName: \"kubernetes.io/projected/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-kube-api-access-qsn94\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775052 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775065 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f66h\" (UniqueName: \"kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h\") pod \"network-check-target-hzrnz\" (UID: \"09aaecf3-0414-4dde-8c6b-1f2bac4e7428\") " pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775074 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c107eb09-ff9f-443d-b736-00e14196e10a-iptables-alerter-script\") pod \"iptables-alerter-bqlsv\" (UID: \"c107eb09-ff9f-443d-b736-00e14196e10a\") " pod="openshift-network-operator/iptables-alerter-bqlsv" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775092 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-cnibin\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775118 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-var-lib-kubelet\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775195 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-kubernetes\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775202 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-var-lib-kubelet\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775222 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-sys-fs\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.775470 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775237 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-run-systemd\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775276 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-cnibin\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7166909-a47b-48ac-b6d2-edf79e57794f-ovnkube-script-lib\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775313 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqcr7\" (UniqueName: \"kubernetes.io/projected/fe668441-597d-403b-b87f-2a247ff1743f-kube-api-access-vqcr7\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775334 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c107eb09-ff9f-443d-b736-00e14196e10a-host-slash\") pod \"iptables-alerter-bqlsv\" (UID: \"c107eb09-ff9f-443d-b736-00e14196e10a\") " pod="openshift-network-operator/iptables-alerter-bqlsv" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-registration-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775372 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c107eb09-ff9f-443d-b736-00e14196e10a-host-slash\") pod \"iptables-alerter-bqlsv\" (UID: \"c107eb09-ff9f-443d-b736-00e14196e10a\") " pod="openshift-network-operator/iptables-alerter-bqlsv" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7166909-a47b-48ac-b6d2-edf79e57794f-ovnkube-config\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775416 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-run-netns\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-kubelet\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-etc-openvswitch\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775483 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-run-netns\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775494 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-sysconfig\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-device-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775550 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kb8t8\" (UniqueName: \"kubernetes.io/projected/17dcae50-58fd-49b1-8afa-88e5b3eca13b-kube-api-access-kb8t8\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775572 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b18a0c7-3fde-496c-b705-add77782201a-serviceca\") pod \"node-ca-bnrb7\" (UID: \"9b18a0c7-3fde-496c-b705-add77782201a\") " pod="openshift-image-registry/node-ca-bnrb7" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775596 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-multus-cni-dir\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775620 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-multus-socket-dir-parent\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775642 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-run-multus-certs\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775670 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-cnibin\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775696 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe668441-597d-403b-b87f-2a247ff1743f-cni-binary-copy\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775717 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-multus-socket-dir-parent\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775719 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsfcj\" (UniqueName: \"kubernetes.io/projected/c107eb09-ff9f-443d-b736-00e14196e10a-kube-api-access-zsfcj\") pod \"iptables-alerter-bqlsv\" (UID: \"c107eb09-ff9f-443d-b736-00e14196e10a\") " pod="openshift-network-operator/iptables-alerter-bqlsv" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775743 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-multus-cni-dir\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775749 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-run-multus-certs\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775763 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-run-netns\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-run-openvswitch\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775886 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775910 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-run-k8s-cni-cncf-io\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-os-release\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775953 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-sysctl-conf\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775964 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-host-run-k8s-cni-cncf-io\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7166909-a47b-48ac-b6d2-edf79e57794f-env-overrides\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.776783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.775996 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b18a0c7-3fde-496c-b705-add77782201a-serviceca\") pod \"node-ca-bnrb7\" (UID: \"9b18a0c7-3fde-496c-b705-add77782201a\") " pod="openshift-image-registry/node-ca-bnrb7" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776012 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-systemd-units\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776037 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-cni-netd\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776055 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bl8rm\" (UniqueName: \"kubernetes.io/projected/9b18a0c7-3fde-496c-b705-add77782201a-kube-api-access-bl8rm\") pod \"node-ca-bnrb7\" (UID: \"9b18a0c7-3fde-496c-b705-add77782201a\") " pod="openshift-image-registry/node-ca-bnrb7" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-system-cni-dir\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-sysctl-d\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776133 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-host\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776156 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a72eb3-f28c-4737-afdc-9ebe86a28502-tmp\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776207 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe668441-597d-403b-b87f-2a247ff1743f-cni-binary-copy\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776220 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776241 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-var-lib-kubelet\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776271 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-tuned\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776303 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-slash\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776330 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-cni-bin\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776351 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:01.777256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.777689 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.777689 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776397 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-run-ovn\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.777689 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776414 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-multus-conf-dir\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.777689 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776430 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d05c79d-aea4-4e8d-8cc7-2777d005b485-konnectivity-ca\") pod \"konnectivity-agent-lnqkc\" (UID: \"9d05c79d-aea4-4e8d-8cc7-2777d005b485\") " pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:01.777689 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.776430 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:01.777689 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776500 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe668441-597d-403b-b87f-2a247ff1743f-multus-conf-dir\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.777689 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.776547 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs podName:17dcae50-58fd-49b1-8afa-88e5b3eca13b nodeName:}" failed. No retries permitted until 2026-06-02 09:35:02.27652307 +0000 UTC m=+2.021383718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs") pod "network-metrics-daemon-qcqzq" (UID: "17dcae50-58fd-49b1-8afa-88e5b3eca13b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:01.777689 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.776867 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d05c79d-aea4-4e8d-8cc7-2777d005b485-konnectivity-ca\") pod \"konnectivity-agent-lnqkc\" (UID: \"9d05c79d-aea4-4e8d-8cc7-2777d005b485\") " pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:01.778038 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.778024 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d05c79d-aea4-4e8d-8cc7-2777d005b485-agent-certs\") pod \"konnectivity-agent-lnqkc\" (UID: \"9d05c79d-aea4-4e8d-8cc7-2777d005b485\") " pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:01.787655 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.787633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsfcj\" (UniqueName: \"kubernetes.io/projected/c107eb09-ff9f-443d-b736-00e14196e10a-kube-api-access-zsfcj\") pod \"iptables-alerter-bqlsv\" (UID: \"c107eb09-ff9f-443d-b736-00e14196e10a\") " pod="openshift-network-operator/iptables-alerter-bqlsv" Jun 02 09:35:01.787902 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.787885 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqcr7\" (UniqueName: \"kubernetes.io/projected/fe668441-597d-403b-b87f-2a247ff1743f-kube-api-access-vqcr7\") pod \"multus-47cqt\" (UID: \"fe668441-597d-403b-b87f-2a247ff1743f\") " pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.789844 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.789823 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl8rm\" (UniqueName: \"kubernetes.io/projected/9b18a0c7-3fde-496c-b705-add77782201a-kube-api-access-bl8rm\") pod \"node-ca-bnrb7\" (UID: \"9b18a0c7-3fde-496c-b705-add77782201a\") " pod="openshift-image-registry/node-ca-bnrb7" Jun 02 09:35:01.790062 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.790046 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb8t8\" (UniqueName: \"kubernetes.io/projected/17dcae50-58fd-49b1-8afa-88e5b3eca13b-kube-api-access-kb8t8\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:01.797696 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.797662 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" event={"ID":"04663179e1eba50a8978c5ee623c34af","Type":"ContainerStarted","Data":"ace0c6f667125c6c3d3b9d07e12bc757237c84abe90fa201ed6bb38a58a20d3c"} Jun 02 09:35:01.798533 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.798516 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" event={"ID":"7d9b405a1f2c345c58facdeefc16d450","Type":"ContainerStarted","Data":"962719e8ba6ade3ea29a61e7d073c6b3e5fc78593b62b7619a17271963e93562"} Jun 02 09:35:01.877295 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877274 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-tuned\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.877395 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877306 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-slash\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.877395 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877331 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-cni-bin\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.877395 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877366 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.877395 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877390 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877391 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-slash\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877410 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-cni-bin\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877415 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-run-ovn\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877463 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-run-ovn\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877465 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-run\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877503 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-lib-modules\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877515 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877505 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-run\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877537 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-modprobe-d\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877572 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-var-lib-openvswitch\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877594 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72fg4\" (UniqueName: \"kubernetes.io/projected/a7166909-a47b-48ac-b6d2-edf79e57794f-kube-api-access-72fg4\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.877602 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877599 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-lib-modules\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877615 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-systemd\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877628 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-modprobe-d\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877632 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-var-lib-openvswitch\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-systemd\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877661 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-etc-selinux\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877691 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7166909-a47b-48ac-b6d2-edf79e57794f-ovn-node-metrics-cert\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877714 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmhf2\" (UniqueName: \"kubernetes.io/projected/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-kube-api-access-mmhf2\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877736 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-etc-selinux\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877741 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-node-log\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877771 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-log-socket\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877781 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-node-log\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877797 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-sys\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-log-socket\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877843 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vcrrd\" (UniqueName: \"kubernetes.io/projected/a2a72eb3-f28c-4737-afdc-9ebe86a28502-kube-api-access-vcrrd\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877878 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-socket-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877886 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-sys\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.878164 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877922 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsn94\" (UniqueName: \"kubernetes.io/projected/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-kube-api-access-qsn94\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877949 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f66h\" (UniqueName: \"kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h\") pod \"network-check-target-hzrnz\" (UID: \"09aaecf3-0414-4dde-8c6b-1f2bac4e7428\") " pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877977 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878001 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-kubernetes\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878027 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-sys-fs\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878051 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-run-systemd\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878070 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-kubernetes\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878077 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7166909-a47b-48ac-b6d2-edf79e57794f-ovnkube-script-lib\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878119 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-registration-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878148 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7166909-a47b-48ac-b6d2-edf79e57794f-ovnkube-config\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878154 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-sys-fs\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877979 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-socket-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.877975 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878175 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-kubelet\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878203 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-etc-openvswitch\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878215 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-registration-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878223 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-run-systemd\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.878947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878229 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-sysconfig\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878255 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-device-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878268 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-kubelet\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878285 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-cnibin\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878314 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-run-netns\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878318 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-sysconfig\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878340 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-run-openvswitch\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878358 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-etc-openvswitch\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878346 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-device-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878387 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-run-netns\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878400 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-cnibin\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878413 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-run-openvswitch\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878422 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878453 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878481 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-os-release\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878455 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878506 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-sysctl-conf\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.879482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878533 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7166909-a47b-48ac-b6d2-edf79e57794f-env-overrides\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878535 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878556 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-systemd-units\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878500 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878561 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-os-release\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878579 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-cni-netd\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878606 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-system-cni-dir\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878630 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-sysctl-d\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878648 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7166909-a47b-48ac-b6d2-edf79e57794f-ovnkube-script-lib\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878659 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-host\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878682 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a72eb3-f28c-4737-afdc-9ebe86a28502-tmp\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-sysctl-conf\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878706 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878710 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-system-cni-dir\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878733 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-systemd-units\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878735 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878753 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7166909-a47b-48ac-b6d2-edf79e57794f-host-cni-netd\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.879965 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878775 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-var-lib-kubelet\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.880428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878850 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-sysctl-d\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.880428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-var-lib-kubelet\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.880428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878882 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7166909-a47b-48ac-b6d2-edf79e57794f-ovnkube-config\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.880428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878909 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.880428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878937 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2a72eb3-f28c-4737-afdc-9ebe86a28502-host\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.880428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.878994 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7166909-a47b-48ac-b6d2-edf79e57794f-env-overrides\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.880428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.879302 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.880428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.879530 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2a72eb3-f28c-4737-afdc-9ebe86a28502-etc-tuned\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.880428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.879865 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7166909-a47b-48ac-b6d2-edf79e57794f-ovn-node-metrics-cert\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.880738 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.880573 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a72eb3-f28c-4737-afdc-9ebe86a28502-tmp\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.894327 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.894305 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 09:35:01.894327 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.894323 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 09:35:01.894327 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.894333 2567 projected.go:194] Error preparing data for projected volume kube-api-access-9f66h for pod openshift-network-diagnostics/network-check-target-hzrnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:01.894523 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:01.894405 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h podName:09aaecf3-0414-4dde-8c6b-1f2bac4e7428 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:02.394392515 +0000 UTC m=+2.139253163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9f66h" (UniqueName: "kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h") pod "network-check-target-hzrnz" (UID: "09aaecf3-0414-4dde-8c6b-1f2bac4e7428") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:01.895640 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.895622 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72fg4\" (UniqueName: \"kubernetes.io/projected/a7166909-a47b-48ac-b6d2-edf79e57794f-kube-api-access-72fg4\") pod \"ovnkube-node-kzhrr\" (UID: \"a7166909-a47b-48ac-b6d2-edf79e57794f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:01.895975 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.895947 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmhf2\" (UniqueName: \"kubernetes.io/projected/2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c-kube-api-access-mmhf2\") pod \"multus-additional-cni-plugins-8p8wt\" (UID: \"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c\") " pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:01.897685 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.897659 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcrrd\" (UniqueName: \"kubernetes.io/projected/a2a72eb3-f28c-4737-afdc-9ebe86a28502-kube-api-access-vcrrd\") pod \"tuned-8lq28\" (UID: \"a2a72eb3-f28c-4737-afdc-9ebe86a28502\") " pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:01.899307 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.899291 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsn94\" (UniqueName: \"kubernetes.io/projected/d3c1dc60-664f-4bd4-97e6-4441ca9eebf2-kube-api-access-qsn94\") pod \"aws-ebs-csi-driver-node-88xmj\" (UID: \"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:01.979175 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.979116 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bnrb7" Jun 02 09:35:01.985645 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:01.985623 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b18a0c7_3fde_496c_b705_add77782201a.slice/crio-d02b0440be3eadaab8697c1405acc3e3a15ecde4f1b9aaa2805536d5440bc79e WatchSource:0}: Error finding container d02b0440be3eadaab8697c1405acc3e3a15ecde4f1b9aaa2805536d5440bc79e: Status 404 returned error can't find the container with id d02b0440be3eadaab8697c1405acc3e3a15ecde4f1b9aaa2805536d5440bc79e Jun 02 09:35:01.986247 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.986229 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-47cqt" Jun 02 09:35:01.992591 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:01.992570 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe668441_597d_403b_b87f_2a247ff1743f.slice/crio-b4d0fb557d1e6d5b52db6c493a29a7e32cdbdb9580849a0e4d3200bd6c4d1763 WatchSource:0}: Error finding container b4d0fb557d1e6d5b52db6c493a29a7e32cdbdb9580849a0e4d3200bd6c4d1763: Status 404 returned error can't find the container with id b4d0fb557d1e6d5b52db6c493a29a7e32cdbdb9580849a0e4d3200bd6c4d1763 Jun 02 09:35:01.993574 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.993552 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bqlsv" Jun 02 09:35:01.998217 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:01.998202 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:01.999633 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:01.999613 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc107eb09_ff9f_443d_b736_00e14196e10a.slice/crio-53420613ca6d6c7279c4775063aedad2f17bec7769a445c6fcf72523b21932fd WatchSource:0}: Error finding container 53420613ca6d6c7279c4775063aedad2f17bec7769a445c6fcf72523b21932fd: Status 404 returned error can't find the container with id 53420613ca6d6c7279c4775063aedad2f17bec7769a445c6fcf72523b21932fd Jun 02 09:35:02.003418 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.003399 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" Jun 02 09:35:02.004903 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:02.004882 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d05c79d_aea4_4e8d_8cc7_2777d005b485.slice/crio-e1e6f151d72bd27a12e3abf81f5d86cb21a096938a56015e5635d65fa9a6b18e WatchSource:0}: Error finding container e1e6f151d72bd27a12e3abf81f5d86cb21a096938a56015e5635d65fa9a6b18e: Status 404 returned error can't find the container with id e1e6f151d72bd27a12e3abf81f5d86cb21a096938a56015e5635d65fa9a6b18e Jun 02 09:35:02.009430 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.009406 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" Jun 02 09:35:02.010323 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:02.010239 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c1dc60_664f_4bd4_97e6_4441ca9eebf2.slice/crio-d1d15344f03d9edba6e89f45a39a2ace41841217e8b15f33a3f6e2a42706e0f8 WatchSource:0}: Error finding container d1d15344f03d9edba6e89f45a39a2ace41841217e8b15f33a3f6e2a42706e0f8: Status 404 returned error can't find the container with id d1d15344f03d9edba6e89f45a39a2ace41841217e8b15f33a3f6e2a42706e0f8 Jun 02 09:35:02.015075 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.015056 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:02.015424 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:02.015403 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecba2ce_0fae_4a93_a7c9_2fe33e5bc79c.slice/crio-a9bf81f64beff7abcf33a1b5fbce78b163b9885acb0007f5fb4fce0c2723d6b5 WatchSource:0}: Error finding container a9bf81f64beff7abcf33a1b5fbce78b163b9885acb0007f5fb4fce0c2723d6b5: Status 404 returned error can't find the container with id a9bf81f64beff7abcf33a1b5fbce78b163b9885acb0007f5fb4fce0c2723d6b5 Jun 02 09:35:02.016783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.016708 2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 09:35:02.019361 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.019346 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8lq28" Jun 02 09:35:02.021446 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:02.021426 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7166909_a47b_48ac_b6d2_edf79e57794f.slice/crio-5f5b144c7d4bbd7507be2b7da082af75121e9e6b432978300f5c46ae0d27566e WatchSource:0}: Error finding container 5f5b144c7d4bbd7507be2b7da082af75121e9e6b432978300f5c46ae0d27566e: Status 404 returned error can't find the container with id 5f5b144c7d4bbd7507be2b7da082af75121e9e6b432978300f5c46ae0d27566e Jun 02 09:35:02.025726 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:02.025708 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a72eb3_f28c_4737_afdc_9ebe86a28502.slice/crio-c07dfb1c1d815da81c039da0b037948fa095bfa160e10f6a7ef4954392dbb846 WatchSource:0}: Error finding container c07dfb1c1d815da81c039da0b037948fa095bfa160e10f6a7ef4954392dbb846: Status 404 returned error can't find the container with id c07dfb1c1d815da81c039da0b037948fa095bfa160e10f6a7ef4954392dbb846 Jun 02 09:35:02.281865 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.281822 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:02.282054 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:02.281970 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:02.282054 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:02.282031 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs podName:17dcae50-58fd-49b1-8afa-88e5b3eca13b nodeName:}" failed. No retries permitted until 2026-06-02 09:35:03.282016063 +0000 UTC m=+3.026876709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs") pod "network-metrics-daemon-qcqzq" (UID: "17dcae50-58fd-49b1-8afa-88e5b3eca13b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:02.483559 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.483521 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f66h\" (UniqueName: \"kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h\") pod \"network-check-target-hzrnz\" (UID: \"09aaecf3-0414-4dde-8c6b-1f2bac4e7428\") " pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:02.483718 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:02.483685 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 09:35:02.483718 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:02.483703 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 09:35:02.483718 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:02.483715 2567 projected.go:194] Error preparing data for projected volume kube-api-access-9f66h for pod openshift-network-diagnostics/network-check-target-hzrnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:02.483908 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:02.483769 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h podName:09aaecf3-0414-4dde-8c6b-1f2bac4e7428 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:03.483751507 +0000 UTC m=+3.228612160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f66h" (UniqueName: "kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h") pod "network-check-target-hzrnz" (UID: "09aaecf3-0414-4dde-8c6b-1f2bac4e7428") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:02.724348 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.724190 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 09:30:01 +0000 UTC" deadline="2027-11-16 21:04:23.509924254 +0000 UTC" Jun 02 09:35:02.724348 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.724230 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12779h29m20.785698022s" Jun 02 09:35:02.810480 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.810383 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8lq28" event={"ID":"a2a72eb3-f28c-4737-afdc-9ebe86a28502","Type":"ContainerStarted","Data":"c07dfb1c1d815da81c039da0b037948fa095bfa160e10f6a7ef4954392dbb846"} Jun 02 09:35:02.825060 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.825030 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" event={"ID":"a7166909-a47b-48ac-b6d2-edf79e57794f","Type":"ContainerStarted","Data":"5f5b144c7d4bbd7507be2b7da082af75121e9e6b432978300f5c46ae0d27566e"} Jun 02 09:35:02.833381 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.833352 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnqkc" event={"ID":"9d05c79d-aea4-4e8d-8cc7-2777d005b485","Type":"ContainerStarted","Data":"e1e6f151d72bd27a12e3abf81f5d86cb21a096938a56015e5635d65fa9a6b18e"} Jun 02 09:35:02.842033 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.841974 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-47cqt" event={"ID":"fe668441-597d-403b-b87f-2a247ff1743f","Type":"ContainerStarted","Data":"b4d0fb557d1e6d5b52db6c493a29a7e32cdbdb9580849a0e4d3200bd6c4d1763"} Jun 02 09:35:02.851353 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.851284 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bnrb7" event={"ID":"9b18a0c7-3fde-496c-b705-add77782201a","Type":"ContainerStarted","Data":"d02b0440be3eadaab8697c1405acc3e3a15ecde4f1b9aaa2805536d5440bc79e"} Jun 02 09:35:02.856750 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.856687 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" event={"ID":"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c","Type":"ContainerStarted","Data":"a9bf81f64beff7abcf33a1b5fbce78b163b9885acb0007f5fb4fce0c2723d6b5"} Jun 02 09:35:02.858341 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.858293 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" event={"ID":"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2","Type":"ContainerStarted","Data":"d1d15344f03d9edba6e89f45a39a2ace41841217e8b15f33a3f6e2a42706e0f8"} Jun 02 09:35:02.861769 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:02.861719 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bqlsv" event={"ID":"c107eb09-ff9f-443d-b736-00e14196e10a","Type":"ContainerStarted","Data":"53420613ca6d6c7279c4775063aedad2f17bec7769a445c6fcf72523b21932fd"} Jun 02 09:35:03.059762 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.059479 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 09:35:03.289371 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.289338 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:03.289550 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:03.289508 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:03.289609 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:03.289568 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs podName:17dcae50-58fd-49b1-8afa-88e5b3eca13b nodeName:}" failed. No retries permitted until 2026-06-02 09:35:05.289551149 +0000 UTC m=+5.034411807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs") pod "network-metrics-daemon-qcqzq" (UID: "17dcae50-58fd-49b1-8afa-88e5b3eca13b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:03.491162 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.491081 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f66h\" (UniqueName: \"kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h\") pod \"network-check-target-hzrnz\" (UID: \"09aaecf3-0414-4dde-8c6b-1f2bac4e7428\") " pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:03.491333 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:03.491283 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 09:35:03.491333 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:03.491303 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 09:35:03.491333 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:03.491316 2567 projected.go:194] Error preparing data for projected volume kube-api-access-9f66h for pod openshift-network-diagnostics/network-check-target-hzrnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:03.491481 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:03.491372 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h podName:09aaecf3-0414-4dde-8c6b-1f2bac4e7428 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:05.491354323 +0000 UTC m=+5.236214968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f66h" (UniqueName: "kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h") pod "network-check-target-hzrnz" (UID: "09aaecf3-0414-4dde-8c6b-1f2bac4e7428") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:03.724701 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.724624 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 09:30:01 +0000 UTC" deadline="2027-11-20 16:47:21.080904473 +0000 UTC" Jun 02 09:35:03.724701 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.724666 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12871h12m17.356241512s" Jun 02 09:35:03.795720 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.795642 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:03.795977 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:03.795765 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:03.796281 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.796226 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:03.796413 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:03.796392 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:03.952490 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.952457 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rs4mt"] Jun 02 09:35:03.954269 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.954229 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:03.954435 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:03.954306 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:03.998023 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.997991 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:03.998203 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.998058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104b24f8-5b17-44c6-86a0-7ec02f210844-dbus\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:03.998203 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:03.998089 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104b24f8-5b17-44c6-86a0-7ec02f210844-kubelet-config\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:04.098785 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:04.098708 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:04.098785 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:04.098764 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104b24f8-5b17-44c6-86a0-7ec02f210844-dbus\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:04.099009 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:04.098794 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104b24f8-5b17-44c6-86a0-7ec02f210844-kubelet-config\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:04.099009 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:04.098911 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104b24f8-5b17-44c6-86a0-7ec02f210844-kubelet-config\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:04.099109 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:04.099010 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:04.099109 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:04.099092 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret podName:104b24f8-5b17-44c6-86a0-7ec02f210844 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:04.59904541 +0000 UTC m=+4.343906069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret") pod "global-pull-secret-syncer-rs4mt" (UID: "104b24f8-5b17-44c6-86a0-7ec02f210844") : object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:04.099469 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:04.099443 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104b24f8-5b17-44c6-86a0-7ec02f210844-dbus\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:04.604336 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:04.603720 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:04.604336 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:04.603890 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:04.604336 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:04.603949 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret podName:104b24f8-5b17-44c6-86a0-7ec02f210844 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:05.603931097 +0000 UTC m=+5.348791748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret") pod "global-pull-secret-syncer-rs4mt" (UID: "104b24f8-5b17-44c6-86a0-7ec02f210844") : object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:05.309384 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:05.309144 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:05.309944 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:05.309303 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:05.309944 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:05.309472 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs podName:17dcae50-58fd-49b1-8afa-88e5b3eca13b nodeName:}" failed. No retries permitted until 2026-06-02 09:35:09.309452646 +0000 UTC m=+9.054313294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs") pod "network-metrics-daemon-qcqzq" (UID: "17dcae50-58fd-49b1-8afa-88e5b3eca13b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:05.510901 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:05.510768 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f66h\" (UniqueName: \"kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h\") pod \"network-check-target-hzrnz\" (UID: \"09aaecf3-0414-4dde-8c6b-1f2bac4e7428\") " pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:05.511078 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:05.510927 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 09:35:05.511078 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:05.510950 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 09:35:05.511078 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:05.510964 2567 projected.go:194] Error preparing data for projected volume kube-api-access-9f66h for pod openshift-network-diagnostics/network-check-target-hzrnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:05.511078 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:05.511025 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h podName:09aaecf3-0414-4dde-8c6b-1f2bac4e7428 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:09.511005755 +0000 UTC m=+9.255866399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f66h" (UniqueName: "kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h") pod "network-check-target-hzrnz" (UID: "09aaecf3-0414-4dde-8c6b-1f2bac4e7428") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:05.611848 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:05.611493 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:05.611848 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:05.611640 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:05.611848 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:05.611703 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret podName:104b24f8-5b17-44c6-86a0-7ec02f210844 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:07.611683439 +0000 UTC m=+7.356544085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret") pod "global-pull-secret-syncer-rs4mt" (UID: "104b24f8-5b17-44c6-86a0-7ec02f210844") : object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:05.796353 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:05.796320 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:05.796538 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:05.796387 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:05.796538 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:05.796419 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:05.796647 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:05.796539 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:05.796647 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:05.796556 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:05.796647 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:05.796611 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:07.628286 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:07.628248 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:07.628716 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:07.628395 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:07.628716 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:07.628468 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret podName:104b24f8-5b17-44c6-86a0-7ec02f210844 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:11.628448866 +0000 UTC m=+11.373309515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret") pod "global-pull-secret-syncer-rs4mt" (UID: "104b24f8-5b17-44c6-86a0-7ec02f210844") : object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:07.795898 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:07.795852 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:07.796085 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:07.795995 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:07.796407 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:07.796366 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:07.796521 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:07.796480 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:07.796521 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:07.796512 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:07.796657 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:07.796624 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:09.342783 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:09.342740 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:09.343220 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:09.342902 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:09.343220 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:09.342969 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs podName:17dcae50-58fd-49b1-8afa-88e5b3eca13b nodeName:}" failed. No retries permitted until 2026-06-02 09:35:17.342951915 +0000 UTC m=+17.087812562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs") pod "network-metrics-daemon-qcqzq" (UID: "17dcae50-58fd-49b1-8afa-88e5b3eca13b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:09.544703 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:09.544665 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f66h\" (UniqueName: \"kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h\") pod \"network-check-target-hzrnz\" (UID: \"09aaecf3-0414-4dde-8c6b-1f2bac4e7428\") " pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:09.544874 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:09.544828 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 09:35:09.544874 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:09.544844 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 09:35:09.544874 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:09.544853 2567 projected.go:194] Error preparing data for projected volume kube-api-access-9f66h for pod openshift-network-diagnostics/network-check-target-hzrnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:09.544993 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:09.544906 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h podName:09aaecf3-0414-4dde-8c6b-1f2bac4e7428 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:17.5448896 +0000 UTC m=+17.289750248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f66h" (UniqueName: "kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h") pod "network-check-target-hzrnz" (UID: "09aaecf3-0414-4dde-8c6b-1f2bac4e7428") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:09.795443 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:09.795366 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:09.795580 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:09.795492 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:09.795580 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:09.795542 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:09.795648 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:09.795543 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:09.795684 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:09.795655 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:09.795800 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:09.795768 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:11.662173 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:11.662139 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:11.662502 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:11.662257 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:11.662502 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:11.662308 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret podName:104b24f8-5b17-44c6-86a0-7ec02f210844 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:19.662294762 +0000 UTC m=+19.407155407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret") pod "global-pull-secret-syncer-rs4mt" (UID: "104b24f8-5b17-44c6-86a0-7ec02f210844") : object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:11.795400 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:11.795366 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:11.795587 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:11.795491 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:11.795587 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:11.795513 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:11.795695 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:11.795493 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:11.795695 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:11.795616 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:11.795789 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:11.795686 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:13.796342 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:13.796307 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:13.796342 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:13.796337 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:13.796800 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:13.796453 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:13.796800 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:13.796505 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:13.796800 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:13.796576 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:13.796800 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:13.796705 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:15.795907 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:15.795876 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:15.796256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:15.795918 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:15.796256 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:15.796014 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:15.796256 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:15.796050 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:15.796256 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:15.796105 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:15.796256 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:15.796181 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:17.406901 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:17.406870 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:17.407341 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:17.407270 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:17.407409 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:17.407356 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs podName:17dcae50-58fd-49b1-8afa-88e5b3eca13b nodeName:}" failed. No retries permitted until 2026-06-02 09:35:33.407334553 +0000 UTC m=+33.152195200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs") pod "network-metrics-daemon-qcqzq" (UID: "17dcae50-58fd-49b1-8afa-88e5b3eca13b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:17.609388 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:17.609346 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f66h\" (UniqueName: \"kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h\") pod \"network-check-target-hzrnz\" (UID: \"09aaecf3-0414-4dde-8c6b-1f2bac4e7428\") " pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:17.609597 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:17.609500 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 09:35:17.609597 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:17.609526 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 09:35:17.609597 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:17.609539 2567 projected.go:194] Error preparing data for projected volume kube-api-access-9f66h for pod openshift-network-diagnostics/network-check-target-hzrnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:17.609736 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:17.609608 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h podName:09aaecf3-0414-4dde-8c6b-1f2bac4e7428 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:33.609589324 +0000 UTC m=+33.354449972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f66h" (UniqueName: "kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h") pod "network-check-target-hzrnz" (UID: "09aaecf3-0414-4dde-8c6b-1f2bac4e7428") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:17.796400 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:17.796320 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:17.796400 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:17.796364 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:17.796654 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:17.796317 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:17.796654 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:17.796458 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:17.796654 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:17.796552 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:17.796654 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:17.796638 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:19.727201 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:19.727162 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:19.727671 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:19.727344 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:19.727671 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:19.727420 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret podName:104b24f8-5b17-44c6-86a0-7ec02f210844 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:35.727400043 +0000 UTC m=+35.472260690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret") pod "global-pull-secret-syncer-rs4mt" (UID: "104b24f8-5b17-44c6-86a0-7ec02f210844") : object "kube-system"/"original-pull-secret" not registered Jun 02 09:35:19.796148 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:19.796114 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:19.796299 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:19.796247 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:19.796299 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:19.796265 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:19.796299 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:19.796279 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:19.796433 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:19.796381 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:19.796475 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:19.796444 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:20.894945 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:20.894911 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" event={"ID":"04663179e1eba50a8978c5ee623c34af","Type":"ContainerStarted","Data":"a3cd5a73abf449aee1b8a912a639f51952b977b121afb2374f04e586d1732de7"} Jun 02 09:35:20.897622 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:20.897574 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8lq28" event={"ID":"a2a72eb3-f28c-4737-afdc-9ebe86a28502","Type":"ContainerStarted","Data":"f96493a8e3047a988bf2e6c84dec2d317d6727ca2b6e5b9e9e97d67817b61e94"} Jun 02 09:35:20.902482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:20.902455 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-47cqt" event={"ID":"fe668441-597d-403b-b87f-2a247ff1743f","Type":"ContainerStarted","Data":"9c95cf90d7b73ffbbf1675c71e0e8b69072f8c8b96d47dfbedf7a62297cdd703"} Jun 02 09:35:20.918651 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:20.918404 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-85.ec2.internal" podStartSLOduration=19.91838975 podStartE2EDuration="19.91838975s" podCreationTimestamp="2026-06-02 09:35:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 09:35:20.917549943 +0000 UTC m=+20.662410612" watchObservedRunningTime="2026-06-02 09:35:20.91838975 +0000 UTC m=+20.663250417" Jun 02 09:35:20.959224 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:20.959185 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8lq28" podStartSLOduration=2.704147164 podStartE2EDuration="20.959164232s" podCreationTimestamp="2026-06-02 09:35:00 +0000 UTC" firstStartedPulling="2026-06-02 09:35:02.027221033 +0000 UTC m=+1.772081681" lastFinishedPulling="2026-06-02 09:35:20.282238104 +0000 UTC m=+20.027098749" observedRunningTime="2026-06-02 09:35:20.95901663 +0000 UTC m=+20.703877298" watchObservedRunningTime="2026-06-02 09:35:20.959164232 +0000 UTC m=+20.704024947" Jun 02 09:35:20.959334 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:20.959301 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-47cqt" podStartSLOduration=2.642896763 podStartE2EDuration="20.959294945s" podCreationTimestamp="2026-06-02 09:35:00 +0000 UTC" firstStartedPulling="2026-06-02 09:35:01.994050075 +0000 UTC m=+1.738910720" lastFinishedPulling="2026-06-02 09:35:20.310448251 +0000 UTC m=+20.055308902" observedRunningTime="2026-06-02 09:35:20.939235541 +0000 UTC m=+20.684096209" watchObservedRunningTime="2026-06-02 09:35:20.959294945 +0000 UTC m=+20.704155661" Jun 02 09:35:21.795628 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.795377 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:21.795821 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.795437 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:21.795821 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:21.795669 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:21.795821 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.795465 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:21.795821 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:21.795753 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:21.796049 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:21.795854 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:21.906363 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.906332 2567 generic.go:358] "Generic (PLEG): container finished" podID="7d9b405a1f2c345c58facdeefc16d450" containerID="e45be2b6fb663886849e7f9555fb796c7ed484dea8f5795d191175fe7285a803" exitCode=0 Jun 02 09:35:21.907042 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.906856 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" event={"ID":"7d9b405a1f2c345c58facdeefc16d450","Type":"ContainerDied","Data":"e45be2b6fb663886849e7f9555fb796c7ed484dea8f5795d191175fe7285a803"} Jun 02 09:35:21.911176 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.911151 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" event={"ID":"a7166909-a47b-48ac-b6d2-edf79e57794f","Type":"ContainerStarted","Data":"f296c1648f516692ca6dd9fe45b87120ee12a7095259afbad550ac9478e1962c"} Jun 02 09:35:21.911275 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.911185 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" event={"ID":"a7166909-a47b-48ac-b6d2-edf79e57794f","Type":"ContainerStarted","Data":"11e088cf9538092ce32efc64e81f17aaf5d81b84010fba17d95b5704fbed9d71"} Jun 02 09:35:21.911275 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.911199 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" event={"ID":"a7166909-a47b-48ac-b6d2-edf79e57794f","Type":"ContainerStarted","Data":"e1bdfae4cb2396ec761c8332aed7d84e3f3b6b6ba4e9f80377491c197c9adef0"} Jun 02 09:35:21.911275 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.911212 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" event={"ID":"a7166909-a47b-48ac-b6d2-edf79e57794f","Type":"ContainerStarted","Data":"2c2bbe6fbd69e55f7f9a16f8999e1a5d41b7c09a046927e72679264673861ace"} Jun 02 09:35:21.911275 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.911224 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" event={"ID":"a7166909-a47b-48ac-b6d2-edf79e57794f","Type":"ContainerStarted","Data":"a03cca59148dbc1f4e438122190bf87f1f165d9e29e9be785cb772300d216fbc"} Jun 02 09:35:21.911275 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.911237 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" event={"ID":"a7166909-a47b-48ac-b6d2-edf79e57794f","Type":"ContainerStarted","Data":"f9c08a97474e17641c1ae9e30cbb07388746aeb198a8e6340a660a5f6f6057dd"} Jun 02 09:35:21.912634 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.912614 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnqkc" event={"ID":"9d05c79d-aea4-4e8d-8cc7-2777d005b485","Type":"ContainerStarted","Data":"b400713a8b877150ea65a60b52dc7f75545465479e5b2f2b53a4b0a140dea604"} Jun 02 09:35:21.914369 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.914344 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bnrb7" event={"ID":"9b18a0c7-3fde-496c-b705-add77782201a","Type":"ContainerStarted","Data":"16467be570ec2348db3e10a1513b41c297ca904945060894ade00cb2fecd8824"} Jun 02 09:35:21.915893 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.915869 2567 generic.go:358] "Generic (PLEG): container finished" podID="2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c" containerID="7d097510014d9d191579f491e30882187de37f1d99eb656358a347d91e3ffe1c" exitCode=0 Jun 02 09:35:21.915997 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.915957 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" event={"ID":"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c","Type":"ContainerDied","Data":"7d097510014d9d191579f491e30882187de37f1d99eb656358a347d91e3ffe1c"} Jun 02 09:35:21.917225 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.917187 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" event={"ID":"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2","Type":"ContainerStarted","Data":"cbb9857ccb7dcb29e24dda4d0209d5d3ce9edf95baf24e0bafae329a1e65363d"} Jun 02 09:35:21.918862 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.918839 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bqlsv" event={"ID":"c107eb09-ff9f-443d-b736-00e14196e10a","Type":"ContainerStarted","Data":"f258805dd9e19d8564e4dc5f8d3bbb340977c02133d8530dc8ce524d8e690dfe"} Jun 02 09:35:21.940060 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.940022 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lnqkc" podStartSLOduration=3.663720113 podStartE2EDuration="21.940009916s" podCreationTimestamp="2026-06-02 09:35:00 +0000 UTC" firstStartedPulling="2026-06-02 09:35:02.006348713 +0000 UTC m=+1.751209357" lastFinishedPulling="2026-06-02 09:35:20.282638508 +0000 UTC m=+20.027499160" observedRunningTime="2026-06-02 09:35:21.939636507 +0000 UTC m=+21.684497173" watchObservedRunningTime="2026-06-02 09:35:21.940009916 +0000 UTC m=+21.684870582" Jun 02 09:35:21.978857 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.978789 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bnrb7" podStartSLOduration=3.684530479 podStartE2EDuration="21.978768339s" podCreationTimestamp="2026-06-02 09:35:00 +0000 UTC" firstStartedPulling="2026-06-02 09:35:01.987303516 +0000 UTC m=+1.732164163" lastFinishedPulling="2026-06-02 09:35:20.28154137 +0000 UTC m=+20.026402023" observedRunningTime="2026-06-02 09:35:21.978676096 +0000 UTC m=+21.723536764" watchObservedRunningTime="2026-06-02 09:35:21.978768339 +0000 UTC m=+21.723629006" Jun 02 09:35:21.988190 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.988170 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 09:35:21.994647 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:21.994600 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bqlsv" podStartSLOduration=3.714031585 podStartE2EDuration="21.994587905s" podCreationTimestamp="2026-06-02 09:35:00 +0000 UTC" firstStartedPulling="2026-06-02 09:35:02.001070592 +0000 UTC m=+1.745931237" lastFinishedPulling="2026-06-02 09:35:20.281626895 +0000 UTC m=+20.026487557" observedRunningTime="2026-06-02 09:35:21.994485384 +0000 UTC m=+21.739346051" watchObservedRunningTime="2026-06-02 09:35:21.994587905 +0000 UTC m=+21.739448624" Jun 02 09:35:22.064025 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:22.063952 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:22.064533 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:22.064517 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:22.744679 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:22.744570 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T09:35:21.988185554Z","UUID":"0e9dc49f-9592-48ca-96d4-d0daccab67d0","Handler":null,"Name":"","Endpoint":""} Jun 02 09:35:22.746437 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:22.746419 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 09:35:22.746593 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:22.746446 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 09:35:22.923214 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:22.923164 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" event={"ID":"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2","Type":"ContainerStarted","Data":"6ac4dc96f0bfe9009ae204e15f9d6582d570180b3a41b448892a4890b01ecb79"} Jun 02 09:35:22.923214 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:22.923203 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" event={"ID":"d3c1dc60-664f-4bd4-97e6-4441ca9eebf2","Type":"ContainerStarted","Data":"d76d388e9a4a5070d35d9cdd894d85794249969772bb890b4d0155ad3925277e"} Jun 02 09:35:22.924967 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:22.924917 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" event={"ID":"7d9b405a1f2c345c58facdeefc16d450","Type":"ContainerStarted","Data":"b0ce598f942e1ff17b56cc4b3551ab6f9e2a0c19fa5d21a696a68c688dc77d2a"} Jun 02 09:35:22.925594 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:22.925572 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:22.926030 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:22.926011 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lnqkc" Jun 02 09:35:22.944122 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:22.944085 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88xmj" podStartSLOduration=2.132644217 podStartE2EDuration="22.944064509s" podCreationTimestamp="2026-06-02 09:35:00 +0000 UTC" firstStartedPulling="2026-06-02 09:35:02.012534866 +0000 UTC m=+1.757395513" lastFinishedPulling="2026-06-02 09:35:22.823955144 +0000 UTC m=+22.568815805" observedRunningTime="2026-06-02 09:35:22.943397951 +0000 UTC m=+22.688258628" watchObservedRunningTime="2026-06-02 09:35:22.944064509 +0000 UTC m=+22.688925176" Jun 02 09:35:23.003544 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.003467 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-85.ec2.internal" podStartSLOduration=22.003455059 podStartE2EDuration="22.003455059s" podCreationTimestamp="2026-06-02 09:35:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 09:35:22.966877998 +0000 UTC m=+22.711738666" watchObservedRunningTime="2026-06-02 09:35:23.003455059 +0000 UTC m=+22.748315728" Jun 02 09:35:23.203616 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.203588 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-krgvk"] Jun 02 09:35:23.206740 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.206713 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-krgvk" Jun 02 09:35:23.209084 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.209058 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 09:35:23.209200 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.209099 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 09:35:23.209200 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.209114 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-96fdg\"" Jun 02 09:35:23.353967 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.353895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a160069-8e96-4a19-91b3-d7d03e43ddce-tmp-dir\") pod \"node-resolver-krgvk\" (UID: \"4a160069-8e96-4a19-91b3-d7d03e43ddce\") " pod="openshift-dns/node-resolver-krgvk" Jun 02 09:35:23.353967 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.353962 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nshfk\" (UniqueName: \"kubernetes.io/projected/4a160069-8e96-4a19-91b3-d7d03e43ddce-kube-api-access-nshfk\") pod \"node-resolver-krgvk\" (UID: \"4a160069-8e96-4a19-91b3-d7d03e43ddce\") " pod="openshift-dns/node-resolver-krgvk" Jun 02 09:35:23.354135 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.353999 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a160069-8e96-4a19-91b3-d7d03e43ddce-hosts-file\") pod \"node-resolver-krgvk\" (UID: \"4a160069-8e96-4a19-91b3-d7d03e43ddce\") " pod="openshift-dns/node-resolver-krgvk" Jun 02 09:35:23.455227 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.455204 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nshfk\" (UniqueName: \"kubernetes.io/projected/4a160069-8e96-4a19-91b3-d7d03e43ddce-kube-api-access-nshfk\") pod \"node-resolver-krgvk\" (UID: \"4a160069-8e96-4a19-91b3-d7d03e43ddce\") " pod="openshift-dns/node-resolver-krgvk" Jun 02 09:35:23.455325 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.455249 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a160069-8e96-4a19-91b3-d7d03e43ddce-hosts-file\") pod \"node-resolver-krgvk\" (UID: \"4a160069-8e96-4a19-91b3-d7d03e43ddce\") " pod="openshift-dns/node-resolver-krgvk" Jun 02 09:35:23.455325 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.455292 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a160069-8e96-4a19-91b3-d7d03e43ddce-tmp-dir\") pod \"node-resolver-krgvk\" (UID: \"4a160069-8e96-4a19-91b3-d7d03e43ddce\") " pod="openshift-dns/node-resolver-krgvk" Jun 02 09:35:23.455430 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.455388 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a160069-8e96-4a19-91b3-d7d03e43ddce-hosts-file\") pod \"node-resolver-krgvk\" (UID: \"4a160069-8e96-4a19-91b3-d7d03e43ddce\") " pod="openshift-dns/node-resolver-krgvk" Jun 02 09:35:23.455549 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.455532 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a160069-8e96-4a19-91b3-d7d03e43ddce-tmp-dir\") pod \"node-resolver-krgvk\" (UID: \"4a160069-8e96-4a19-91b3-d7d03e43ddce\") " pod="openshift-dns/node-resolver-krgvk" Jun 02 09:35:23.468368 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.468349 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nshfk\" (UniqueName: \"kubernetes.io/projected/4a160069-8e96-4a19-91b3-d7d03e43ddce-kube-api-access-nshfk\") pod \"node-resolver-krgvk\" (UID: \"4a160069-8e96-4a19-91b3-d7d03e43ddce\") " pod="openshift-dns/node-resolver-krgvk" Jun 02 09:35:23.516503 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.516475 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-krgvk" Jun 02 09:35:23.525859 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:23.525833 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a160069_8e96_4a19_91b3_d7d03e43ddce.slice/crio-763d5f192bc4cb373d90a21af1edb1580fc918f06301b0d4794dba221ee3e85b WatchSource:0}: Error finding container 763d5f192bc4cb373d90a21af1edb1580fc918f06301b0d4794dba221ee3e85b: Status 404 returned error can't find the container with id 763d5f192bc4cb373d90a21af1edb1580fc918f06301b0d4794dba221ee3e85b Jun 02 09:35:23.796188 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.795993 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:23.796347 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.796018 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:23.796347 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:23.796269 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:23.796466 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.796051 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:23.796466 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:23.796367 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:23.796563 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:23.796466 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:23.929033 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.928961 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" event={"ID":"a7166909-a47b-48ac-b6d2-edf79e57794f","Type":"ContainerStarted","Data":"537a8ef2e4f356eea7a28ad009bc887ca00c3211cfe2e02448357eb9ae7029df"} Jun 02 09:35:23.930157 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.930127 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-krgvk" event={"ID":"4a160069-8e96-4a19-91b3-d7d03e43ddce","Type":"ContainerStarted","Data":"7ad2ec98648aa9610d05148834e257253644f9f7b704eae224e77a6eb5471d21"} Jun 02 09:35:23.930272 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.930162 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-krgvk" event={"ID":"4a160069-8e96-4a19-91b3-d7d03e43ddce","Type":"ContainerStarted","Data":"763d5f192bc4cb373d90a21af1edb1580fc918f06301b0d4794dba221ee3e85b"} Jun 02 09:35:23.947924 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:23.947889 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-krgvk" podStartSLOduration=0.947878534 podStartE2EDuration="947.878534ms" podCreationTimestamp="2026-06-02 09:35:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 09:35:23.947679518 +0000 UTC m=+23.692540383" watchObservedRunningTime="2026-06-02 09:35:23.947878534 +0000 UTC m=+23.692739201" Jun 02 09:35:25.796414 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:25.796339 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:25.797007 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:25.796339 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:25.797007 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:25.796339 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:25.797007 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:25.796452 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:25.797007 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:25.796517 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:25.797007 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:25.796590 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:27.795684 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.795475 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:27.796277 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.795480 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:27.796277 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:27.795734 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:27.796277 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.795498 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:27.796277 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:27.795819 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:27.796277 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:27.795887 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:27.938871 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.938842 2567 generic.go:358] "Generic (PLEG): container finished" podID="2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c" containerID="0c77a19c0b83ef863b6b3cd1db73828af8d8689e6a6847ec2878951b738dd2ee" exitCode=0 Jun 02 09:35:27.938999 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.938923 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" event={"ID":"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c","Type":"ContainerDied","Data":"0c77a19c0b83ef863b6b3cd1db73828af8d8689e6a6847ec2878951b738dd2ee"} Jun 02 09:35:27.946255 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.946232 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" event={"ID":"a7166909-a47b-48ac-b6d2-edf79e57794f","Type":"ContainerStarted","Data":"be5a1ac662fe5ab5d328a25dd676086ec41686eceb06b17ffabb6402666655a4"} Jun 02 09:35:27.946544 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.946519 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:27.946626 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.946552 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:27.946626 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.946563 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:27.961400 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.961382 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:27.961574 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.961558 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:35:27.996866 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:27.996827 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" podStartSLOduration=9.172905587 podStartE2EDuration="27.996799516s" podCreationTimestamp="2026-06-02 09:35:00 +0000 UTC" firstStartedPulling="2026-06-02 09:35:02.023455799 +0000 UTC m=+1.768316444" lastFinishedPulling="2026-06-02 09:35:20.847349724 +0000 UTC m=+20.592210373" observedRunningTime="2026-06-02 09:35:27.996639233 +0000 UTC m=+27.741499900" watchObservedRunningTime="2026-06-02 09:35:27.996799516 +0000 UTC m=+27.741660182" Jun 02 09:35:29.377918 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:29.377886 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzrnz"] Jun 02 09:35:29.378282 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:29.378025 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:29.378282 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:29.378114 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:29.381382 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:29.381354 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rs4mt"] Jun 02 09:35:29.381490 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:29.381457 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:29.381553 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:29.381536 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:29.382427 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:29.382401 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qcqzq"] Jun 02 09:35:29.382526 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:29.382510 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:29.382609 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:29.382584 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:29.951481 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:29.951398 2567 generic.go:358] "Generic (PLEG): container finished" podID="2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c" containerID="dc0f8cf7ec39ce14f3aba6be1f6f26f7d488b23ae3e1f4bceed451954bf2e03b" exitCode=0 Jun 02 09:35:29.951481 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:29.951446 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" event={"ID":"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c","Type":"ContainerDied","Data":"dc0f8cf7ec39ce14f3aba6be1f6f26f7d488b23ae3e1f4bceed451954bf2e03b"} Jun 02 09:35:30.798730 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:30.798087 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:30.798730 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:30.798437 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:30.799271 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:30.798846 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:30.799271 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:30.798904 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:30.799271 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:30.799037 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:30.799454 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:30.799430 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:31.956937 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:31.956851 2567 generic.go:358] "Generic (PLEG): container finished" podID="2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c" containerID="a3ba94206ad544703efa910ac6af774b5a8b356b10109979adc7f04055fbcc62" exitCode=0 Jun 02 09:35:31.956937 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:31.956895 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" event={"ID":"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c","Type":"ContainerDied","Data":"a3ba94206ad544703efa910ac6af774b5a8b356b10109979adc7f04055fbcc62"} Jun 02 09:35:32.795906 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:32.795864 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:32.796087 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:32.795923 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:32.796087 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:32.795989 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:32.796211 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:32.796129 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcqzq" podUID="17dcae50-58fd-49b1-8afa-88e5b3eca13b" Jun 02 09:35:32.796259 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:32.796234 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs4mt" podUID="104b24f8-5b17-44c6-86a0-7ec02f210844" Jun 02 09:35:32.796354 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:32.796326 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrnz" podUID="09aaecf3-0414-4dde-8c6b-1f2bac4e7428" Jun 02 09:35:33.439426 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.439346 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:33.439976 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.439475 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:33.439976 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.439551 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs podName:17dcae50-58fd-49b1-8afa-88e5b3eca13b nodeName:}" failed. No retries permitted until 2026-06-02 09:36:05.439533263 +0000 UTC m=+65.184393922 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs") pod "network-metrics-daemon-qcqzq" (UID: "17dcae50-58fd-49b1-8afa-88e5b3eca13b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 09:35:33.543455 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.543397 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-85.ec2.internal" event="NodeReady" Jun 02 09:35:33.543632 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.543551 2567 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 09:35:33.585448 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.585417 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7898867997-c65b9"] Jun 02 09:35:33.613191 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.613161 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fq9nd"] Jun 02 09:35:33.613354 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.613308 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.617299 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.617252 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 09:35:33.617448 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.617349 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 09:35:33.617514 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.617498 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 09:35:33.618348 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.618326 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-69r7d\"" Jun 02 09:35:33.624299 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.624283 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 09:35:33.637560 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.637509 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s9fqx"] Jun 02 09:35:33.637671 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.637574 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.641231 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.640970 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-98tbs\"" Jun 02 09:35:33.641231 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.641026 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 09:35:33.641231 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.640970 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 09:35:33.641574 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.641538 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f66h\" (UniqueName: \"kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h\") pod \"network-check-target-hzrnz\" (UID: \"09aaecf3-0414-4dde-8c6b-1f2bac4e7428\") " pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:33.641674 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.641656 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 09:35:33.641735 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.641676 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 09:35:33.641735 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.641689 2567 projected.go:194] Error preparing data for projected volume kube-api-access-9f66h for pod openshift-network-diagnostics/network-check-target-hzrnz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:33.641855 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.641830 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h podName:09aaecf3-0414-4dde-8c6b-1f2bac4e7428 nodeName:}" failed. No retries permitted until 2026-06-02 09:36:05.641769054 +0000 UTC m=+65.386629701 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f66h" (UniqueName: "kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h") pod "network-check-target-hzrnz" (UID: "09aaecf3-0414-4dde-8c6b-1f2bac4e7428") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 09:35:33.655957 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.655933 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7898867997-c65b9"] Jun 02 09:35:33.655957 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.655955 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s9fqx"] Jun 02 09:35:33.656093 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.655963 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fq9nd"] Jun 02 09:35:33.656093 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.656052 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:35:33.658723 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.658701 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 09:35:33.658821 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.658778 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 09:35:33.659413 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.659298 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 09:35:33.659413 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.659388 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k79kf\"" Jun 02 09:35:33.742217 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742099 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-bound-sa-token\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.742217 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-image-registry-private-configuration\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.742434 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-certificates\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.742434 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742300 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-trusted-ca\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.742434 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dc512d-8837-47bf-b672-5b2381fd8ae8-tmp-dir\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.742434 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742351 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-installation-pull-secrets\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.742434 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlww8\" (UniqueName: \"kubernetes.io/projected/67dc512d-8837-47bf-b672-5b2381fd8ae8-kube-api-access-qlww8\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.742434 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742431 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.742824 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742469 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdbd156e-cfb5-4981-b885-4b25315f1ed3-ca-trust-extracted\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.742824 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742493 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhrnm\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-kube-api-access-lhrnm\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.742824 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742523 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67dc512d-8837-47bf-b672-5b2381fd8ae8-config-volume\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.742824 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.742562 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.843682 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.843649 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdbd156e-cfb5-4981-b885-4b25315f1ed3-ca-trust-extracted\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.843854 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.843693 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhrnm\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-kube-api-access-lhrnm\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.843854 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.843842 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67dc512d-8837-47bf-b672-5b2381fd8ae8-config-volume\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.843974 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.843887 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44bhj\" (UniqueName: \"kubernetes.io/projected/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-kube-api-access-44bhj\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:35:33.843974 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.843937 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.844091 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.843988 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-bound-sa-token\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.844091 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844034 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-image-registry-private-configuration\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.844189 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844087 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-certificates\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.844189 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844118 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdbd156e-cfb5-4981-b885-4b25315f1ed3-ca-trust-extracted\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.844189 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.844094 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 09:35:33.844189 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.844143 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7898867997-c65b9: secret "image-registry-tls" not found Jun 02 09:35:33.844189 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844169 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-trusted-ca\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.844413 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.844204 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls podName:cdbd156e-cfb5-4981-b885-4b25315f1ed3 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:34.344185559 +0000 UTC m=+34.089046214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls") pod "image-registry-7898867997-c65b9" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3") : secret "image-registry-tls" not found Jun 02 09:35:33.844413 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844223 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dc512d-8837-47bf-b672-5b2381fd8ae8-tmp-dir\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.844413 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844255 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-installation-pull-secrets\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.844413 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844283 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qlww8\" (UniqueName: \"kubernetes.io/projected/67dc512d-8837-47bf-b672-5b2381fd8ae8-kube-api-access-qlww8\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.844413 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844311 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:35:33.844413 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844352 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.844689 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.844438 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 09:35:33.844689 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.844484 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls podName:67dc512d-8837-47bf-b672-5b2381fd8ae8 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:34.344471473 +0000 UTC m=+34.089332118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls") pod "dns-default-fq9nd" (UID: "67dc512d-8837-47bf-b672-5b2381fd8ae8") : secret "dns-default-metrics-tls" not found Jun 02 09:35:33.844689 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844479 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67dc512d-8837-47bf-b672-5b2381fd8ae8-config-volume\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.844689 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844568 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dc512d-8837-47bf-b672-5b2381fd8ae8-tmp-dir\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.844924 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.844904 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-certificates\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.845099 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.845076 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-trusted-ca\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.848537 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.848513 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-installation-pull-secrets\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.848641 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.848553 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-image-registry-private-configuration\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.853998 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.853863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlww8\" (UniqueName: \"kubernetes.io/projected/67dc512d-8837-47bf-b672-5b2381fd8ae8-kube-api-access-qlww8\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:33.854136 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.854112 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-bound-sa-token\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.854402 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.854375 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhrnm\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-kube-api-access-lhrnm\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:33.945040 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.944995 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44bhj\" (UniqueName: \"kubernetes.io/projected/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-kube-api-access-44bhj\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:35:33.945224 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.945205 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:35:33.945346 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.945333 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 09:35:33.945399 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:33.945394 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert podName:cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:34.445382214 +0000 UTC m=+34.190242859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert") pod "ingress-canary-s9fqx" (UID: "cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4") : secret "canary-serving-cert" not found Jun 02 09:35:33.966832 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:33.966787 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44bhj\" (UniqueName: \"kubernetes.io/projected/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-kube-api-access-44bhj\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:35:34.347634 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.347583 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:34.347893 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:34.347772 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 09:35:34.347893 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:34.347795 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7898867997-c65b9: secret "image-registry-tls" not found Jun 02 09:35:34.347893 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.347854 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:34.347893 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:34.347869 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls podName:cdbd156e-cfb5-4981-b885-4b25315f1ed3 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:35.347853107 +0000 UTC m=+35.092713775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls") pod "image-registry-7898867997-c65b9" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3") : secret "image-registry-tls" not found Jun 02 09:35:34.348184 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:34.347997 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 09:35:34.348184 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:34.348065 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls podName:67dc512d-8837-47bf-b672-5b2381fd8ae8 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:35.348039694 +0000 UTC m=+35.092900348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls") pod "dns-default-fq9nd" (UID: "67dc512d-8837-47bf-b672-5b2381fd8ae8") : secret "dns-default-metrics-tls" not found Jun 02 09:35:34.448566 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.448537 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:35:34.449132 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:34.448686 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 09:35:34.449132 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:34.448740 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert podName:cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:35.448726324 +0000 UTC m=+35.193586969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert") pod "ingress-canary-s9fqx" (UID: "cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4") : secret "canary-serving-cert" not found Jun 02 09:35:34.799055 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.798983 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:35:34.799285 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.798983 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:35:34.799285 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.798991 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:34.801946 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.801920 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s46qh\"" Jun 02 09:35:34.802063 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.801959 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 09:35:34.802818 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.802782 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f8vl8\"" Jun 02 09:35:34.802945 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.802840 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 09:35:34.802945 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.802847 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 09:35:34.802945 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:34.802887 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 09:35:35.355954 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:35.355919 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:35.356187 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:35.355964 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:35.356187 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:35.356067 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 09:35:35.356187 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:35.356092 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 09:35:35.356187 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:35.356102 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7898867997-c65b9: secret "image-registry-tls" not found Jun 02 09:35:35.356187 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:35.356127 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls podName:67dc512d-8837-47bf-b672-5b2381fd8ae8 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:37.356114388 +0000 UTC m=+37.100975037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls") pod "dns-default-fq9nd" (UID: "67dc512d-8837-47bf-b672-5b2381fd8ae8") : secret "dns-default-metrics-tls" not found Jun 02 09:35:35.356187 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:35.356142 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls podName:cdbd156e-cfb5-4981-b885-4b25315f1ed3 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:37.356134865 +0000 UTC m=+37.100995510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls") pod "image-registry-7898867997-c65b9" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3") : secret "image-registry-tls" not found Jun 02 09:35:35.456824 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:35.456785 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:35:35.457148 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:35.456909 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 09:35:35.457148 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:35.456968 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert podName:cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:37.456952056 +0000 UTC m=+37.201812706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert") pod "ingress-canary-s9fqx" (UID: "cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4") : secret "canary-serving-cert" not found Jun 02 09:35:35.759561 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:35.759484 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:35.762079 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:35.762051 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104b24f8-5b17-44c6-86a0-7ec02f210844-original-pull-secret\") pod \"global-pull-secret-syncer-rs4mt\" (UID: \"104b24f8-5b17-44c6-86a0-7ec02f210844\") " pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:36.024004 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:36.023925 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs4mt" Jun 02 09:35:37.373553 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:37.373518 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:37.373986 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:37.373569 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:37.373986 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:37.373680 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 09:35:37.373986 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:37.373691 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7898867997-c65b9: secret "image-registry-tls" not found Jun 02 09:35:37.373986 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:37.373699 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 09:35:37.373986 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:37.373740 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls podName:cdbd156e-cfb5-4981-b885-4b25315f1ed3 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:41.373727093 +0000 UTC m=+41.118587738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls") pod "image-registry-7898867997-c65b9" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3") : secret "image-registry-tls" not found Jun 02 09:35:37.373986 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:37.373756 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls podName:67dc512d-8837-47bf-b672-5b2381fd8ae8 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:41.373748033 +0000 UTC m=+41.118608679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls") pod "dns-default-fq9nd" (UID: "67dc512d-8837-47bf-b672-5b2381fd8ae8") : secret "dns-default-metrics-tls" not found Jun 02 09:35:37.474370 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:37.474337 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:35:37.474534 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:37.474497 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 09:35:37.474596 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:37.474569 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert podName:cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:41.474550197 +0000 UTC m=+41.219410842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert") pod "ingress-canary-s9fqx" (UID: "cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4") : secret "canary-serving-cert" not found Jun 02 09:35:37.672706 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:37.672443 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rs4mt"] Jun 02 09:35:37.683124 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:35:37.683092 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104b24f8_5b17_44c6_86a0_7ec02f210844.slice/crio-8b6e0c053c1813d6132c533df8840b3b215dafa935500a80ea45c58c62c5fd09 WatchSource:0}: Error finding container 8b6e0c053c1813d6132c533df8840b3b215dafa935500a80ea45c58c62c5fd09: Status 404 returned error can't find the container with id 8b6e0c053c1813d6132c533df8840b3b215dafa935500a80ea45c58c62c5fd09 Jun 02 09:35:37.971471 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:37.971315 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" event={"ID":"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c","Type":"ContainerStarted","Data":"caf83c056ffe8ad7c8075574531678a9ca8d0f6ec764767acd1036dd60279041"} Jun 02 09:35:37.972661 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:37.972638 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rs4mt" event={"ID":"104b24f8-5b17-44c6-86a0-7ec02f210844","Type":"ContainerStarted","Data":"8b6e0c053c1813d6132c533df8840b3b215dafa935500a80ea45c58c62c5fd09"} Jun 02 09:35:38.978375 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:38.978287 2567 generic.go:358] "Generic (PLEG): container finished" podID="2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c" containerID="caf83c056ffe8ad7c8075574531678a9ca8d0f6ec764767acd1036dd60279041" exitCode=0 Jun 02 09:35:38.978375 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:38.978334 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" event={"ID":"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c","Type":"ContainerDied","Data":"caf83c056ffe8ad7c8075574531678a9ca8d0f6ec764767acd1036dd60279041"} Jun 02 09:35:39.983427 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:39.983387 2567 generic.go:358] "Generic (PLEG): container finished" podID="2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c" containerID="bfd56a697bf1e1604eeda432693c66aaf934598608853ca704d6e1f5c13bca98" exitCode=0 Jun 02 09:35:39.983859 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:39.983462 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" event={"ID":"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c","Type":"ContainerDied","Data":"bfd56a697bf1e1604eeda432693c66aaf934598608853ca704d6e1f5c13bca98"} Jun 02 09:35:40.988842 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:40.988794 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" event={"ID":"2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c","Type":"ContainerStarted","Data":"0bbc115a630d4f19aa8557a5f48604e2d9b6799ed0a3614738b671a90f1181b4"} Jun 02 09:35:41.015527 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:41.015482 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8p8wt" podStartSLOduration=5.321906822 podStartE2EDuration="41.015464745s" podCreationTimestamp="2026-06-02 09:35:00 +0000 UTC" firstStartedPulling="2026-06-02 09:35:02.018029597 +0000 UTC m=+1.762890243" lastFinishedPulling="2026-06-02 09:35:37.711587518 +0000 UTC m=+37.456448166" observedRunningTime="2026-06-02 09:35:41.013710784 +0000 UTC m=+40.758571452" watchObservedRunningTime="2026-06-02 09:35:41.015464745 +0000 UTC m=+40.760325413" Jun 02 09:35:41.400713 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:41.400676 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:41.400914 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:41.400784 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:41.400914 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:41.400860 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 09:35:41.400914 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:41.400884 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7898867997-c65b9: secret "image-registry-tls" not found Jun 02 09:35:41.401067 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:41.400913 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 09:35:41.401067 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:41.400960 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls podName:cdbd156e-cfb5-4981-b885-4b25315f1ed3 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:49.400940245 +0000 UTC m=+49.145800904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls") pod "image-registry-7898867997-c65b9" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3") : secret "image-registry-tls" not found Jun 02 09:35:41.401067 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:41.400979 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls podName:67dc512d-8837-47bf-b672-5b2381fd8ae8 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:49.400969453 +0000 UTC m=+49.145830106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls") pod "dns-default-fq9nd" (UID: "67dc512d-8837-47bf-b672-5b2381fd8ae8") : secret "dns-default-metrics-tls" not found Jun 02 09:35:41.501590 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:41.501552 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:35:41.501741 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:41.501671 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 09:35:41.501741 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:41.501738 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert podName:cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4 nodeName:}" failed. No retries permitted until 2026-06-02 09:35:49.501724311 +0000 UTC m=+49.246584961 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert") pod "ingress-canary-s9fqx" (UID: "cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4") : secret "canary-serving-cert" not found Jun 02 09:35:42.518750 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:42.518722 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-krgvk_4a160069-8e96-4a19-91b3-d7d03e43ddce/dns-node-resolver/0.log" Jun 02 09:35:42.993630 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:42.993598 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rs4mt" event={"ID":"104b24f8-5b17-44c6-86a0-7ec02f210844","Type":"ContainerStarted","Data":"39e46c2116c9b853146ec053336bfe7ad826bd97b7ec49f8d44ff4b24afd3d92"} Jun 02 09:35:43.011011 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:43.010944 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rs4mt" podStartSLOduration=34.973358987 podStartE2EDuration="40.01092986s" podCreationTimestamp="2026-06-02 09:35:03 +0000 UTC" firstStartedPulling="2026-06-02 09:35:37.688477183 +0000 UTC m=+37.433337842" lastFinishedPulling="2026-06-02 09:35:42.726048069 +0000 UTC m=+42.470908715" observedRunningTime="2026-06-02 09:35:43.010294612 +0000 UTC m=+42.755155278" watchObservedRunningTime="2026-06-02 09:35:43.01092986 +0000 UTC m=+42.755790583" Jun 02 09:35:43.521596 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:43.521567 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bnrb7_9b18a0c7-3fde-496c-b705-add77782201a/node-ca/0.log" Jun 02 09:35:49.453763 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:49.453732 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:35:49.454148 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:49.453771 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:35:49.454148 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:49.453885 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 09:35:49.454148 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:49.453894 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 09:35:49.454148 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:49.453977 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7898867997-c65b9: secret "image-registry-tls" not found Jun 02 09:35:49.454148 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:49.453979 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls podName:67dc512d-8837-47bf-b672-5b2381fd8ae8 nodeName:}" failed. No retries permitted until 2026-06-02 09:36:05.453957139 +0000 UTC m=+65.198817789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls") pod "dns-default-fq9nd" (UID: "67dc512d-8837-47bf-b672-5b2381fd8ae8") : secret "dns-default-metrics-tls" not found Jun 02 09:35:49.454148 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:49.454040 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls podName:cdbd156e-cfb5-4981-b885-4b25315f1ed3 nodeName:}" failed. No retries permitted until 2026-06-02 09:36:05.454025187 +0000 UTC m=+65.198885839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls") pod "image-registry-7898867997-c65b9" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3") : secret "image-registry-tls" not found Jun 02 09:35:49.554356 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:49.554330 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:35:49.554468 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:49.554414 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 09:35:49.554468 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:35:49.554449 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert podName:cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4 nodeName:}" failed. No retries permitted until 2026-06-02 09:36:05.554439788 +0000 UTC m=+65.299300432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert") pod "ingress-canary-s9fqx" (UID: "cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4") : secret "canary-serving-cert" not found Jun 02 09:35:59.969695 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:35:59.969668 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kzhrr" Jun 02 09:36:05.462379 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.462330 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:36:05.462379 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.462385 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:36:05.462933 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.462476 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:36:05.465697 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.465675 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 09:36:05.465827 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.465763 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67dc512d-8837-47bf-b672-5b2381fd8ae8-metrics-tls\") pod \"dns-default-fq9nd\" (UID: \"67dc512d-8837-47bf-b672-5b2381fd8ae8\") " pod="openshift-dns/dns-default-fq9nd" Jun 02 09:36:05.465939 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.465922 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls\") pod \"image-registry-7898867997-c65b9\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:36:05.474900 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.474880 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17dcae50-58fd-49b1-8afa-88e5b3eca13b-metrics-certs\") pod \"network-metrics-daemon-qcqzq\" (UID: \"17dcae50-58fd-49b1-8afa-88e5b3eca13b\") " pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:36:05.563333 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.563286 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:36:05.565515 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.565496 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4-cert\") pod \"ingress-canary-s9fqx\" (UID: \"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4\") " pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:36:05.666453 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.666412 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f66h\" (UniqueName: \"kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h\") pod \"network-check-target-hzrnz\" (UID: \"09aaecf3-0414-4dde-8c6b-1f2bac4e7428\") " pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:36:05.669551 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.669533 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 09:36:05.679395 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.679373 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 09:36:05.689597 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.689572 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f66h\" (UniqueName: \"kubernetes.io/projected/09aaecf3-0414-4dde-8c6b-1f2bac4e7428-kube-api-access-9f66h\") pod \"network-check-target-hzrnz\" (UID: \"09aaecf3-0414-4dde-8c6b-1f2bac4e7428\") " pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:36:05.714230 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.714176 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f8vl8\"" Jun 02 09:36:05.720396 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.720378 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s46qh\"" Jun 02 09:36:05.721428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.721414 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:36:05.728229 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.728205 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcqzq" Jun 02 09:36:05.729044 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.729029 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-69r7d\"" Jun 02 09:36:05.736340 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.736321 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:36:05.750775 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.750729 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-98tbs\"" Jun 02 09:36:05.758003 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.757584 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fq9nd" Jun 02 09:36:05.769960 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.769454 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k79kf\"" Jun 02 09:36:05.776774 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.776340 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s9fqx" Jun 02 09:36:05.879688 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.879640 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzrnz"] Jun 02 09:36:05.884157 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:05.884104 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09aaecf3_0414_4dde_8c6b_1f2bac4e7428.slice/crio-10f9362eb128eb08611e6173105bb14573ebe01bf221d24859bb8d05c1679d2e WatchSource:0}: Error finding container 10f9362eb128eb08611e6173105bb14573ebe01bf221d24859bb8d05c1679d2e: Status 404 returned error can't find the container with id 10f9362eb128eb08611e6173105bb14573ebe01bf221d24859bb8d05c1679d2e Jun 02 09:36:05.926981 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.926952 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fq9nd"] Jun 02 09:36:05.930050 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:05.930024 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67dc512d_8837_47bf_b672_5b2381fd8ae8.slice/crio-347956627aea6fa943398c18ea423fa45a380b075a86d5e966a49cc652a09003 WatchSource:0}: Error finding container 347956627aea6fa943398c18ea423fa45a380b075a86d5e966a49cc652a09003: Status 404 returned error can't find the container with id 347956627aea6fa943398c18ea423fa45a380b075a86d5e966a49cc652a09003 Jun 02 09:36:05.951211 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:05.951181 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s9fqx"] Jun 02 09:36:05.954894 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:05.954873 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdcc254d_03b3_48ae_8fcc_d9e3ea1d34d4.slice/crio-2e419f16c228e5bc9746cb42dc6783bc3e79577cf2070d0596777bbddde35acf WatchSource:0}: Error finding container 2e419f16c228e5bc9746cb42dc6783bc3e79577cf2070d0596777bbddde35acf: Status 404 returned error can't find the container with id 2e419f16c228e5bc9746cb42dc6783bc3e79577cf2070d0596777bbddde35acf Jun 02 09:36:06.039997 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:06.039917 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s9fqx" event={"ID":"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4","Type":"ContainerStarted","Data":"2e419f16c228e5bc9746cb42dc6783bc3e79577cf2070d0596777bbddde35acf"} Jun 02 09:36:06.040855 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:06.040832 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fq9nd" event={"ID":"67dc512d-8837-47bf-b672-5b2381fd8ae8","Type":"ContainerStarted","Data":"347956627aea6fa943398c18ea423fa45a380b075a86d5e966a49cc652a09003"} Jun 02 09:36:06.041800 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:06.041781 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzrnz" event={"ID":"09aaecf3-0414-4dde-8c6b-1f2bac4e7428","Type":"ContainerStarted","Data":"10f9362eb128eb08611e6173105bb14573ebe01bf221d24859bb8d05c1679d2e"} Jun 02 09:36:06.101300 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:06.101273 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qcqzq"] Jun 02 09:36:06.104183 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:06.104130 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17dcae50_58fd_49b1_8afa_88e5b3eca13b.slice/crio-e2430b3659d844450b21498ee3fbf82f278bdaa1441d9700827943cc8277d596 WatchSource:0}: Error finding container e2430b3659d844450b21498ee3fbf82f278bdaa1441d9700827943cc8277d596: Status 404 returned error can't find the container with id e2430b3659d844450b21498ee3fbf82f278bdaa1441d9700827943cc8277d596 Jun 02 09:36:06.104670 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:06.104649 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7898867997-c65b9"] Jun 02 09:36:06.107830 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:06.107790 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbd156e_cfb5_4981_b885_4b25315f1ed3.slice/crio-9cddf39b4085d31b53af78a4b9dd3a54494c99042f4c31d34638d7eb404e237d WatchSource:0}: Error finding container 9cddf39b4085d31b53af78a4b9dd3a54494c99042f4c31d34638d7eb404e237d: Status 404 returned error can't find the container with id 9cddf39b4085d31b53af78a4b9dd3a54494c99042f4c31d34638d7eb404e237d Jun 02 09:36:07.046547 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.046455 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7898867997-c65b9" event={"ID":"cdbd156e-cfb5-4981-b885-4b25315f1ed3","Type":"ContainerStarted","Data":"0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66"} Jun 02 09:36:07.046547 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.046513 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7898867997-c65b9" event={"ID":"cdbd156e-cfb5-4981-b885-4b25315f1ed3","Type":"ContainerStarted","Data":"9cddf39b4085d31b53af78a4b9dd3a54494c99042f4c31d34638d7eb404e237d"} Jun 02 09:36:07.047300 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.046548 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:36:07.047738 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.047693 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qcqzq" event={"ID":"17dcae50-58fd-49b1-8afa-88e5b3eca13b","Type":"ContainerStarted","Data":"e2430b3659d844450b21498ee3fbf82f278bdaa1441d9700827943cc8277d596"} Jun 02 09:36:07.069195 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.069145 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7898867997-c65b9" podStartSLOduration=40.069127859 podStartE2EDuration="40.069127859s" podCreationTimestamp="2026-06-02 09:35:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 09:36:07.068472283 +0000 UTC m=+66.813332950" watchObservedRunningTime="2026-06-02 09:36:07.069127859 +0000 UTC m=+66.813988527" Jun 02 09:36:07.508238 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.508202 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j"] Jun 02 09:36:07.522265 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.522233 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7898867997-c65b9"] Jun 02 09:36:07.522418 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.522275 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j"] Jun 02 09:36:07.522418 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.522394 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j" Jun 02 09:36:07.525325 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.525138 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 09:36:07.525325 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.525236 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zc9fl\"" Jun 02 09:36:07.525325 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.525278 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 09:36:07.580763 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.580732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f48cf9a2-5165-4713-a497-3d36d7abce05-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-q2x5j\" (UID: \"f48cf9a2-5165-4713-a497-3d36d7abce05\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j" Jun 02 09:36:07.580919 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.580790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f48cf9a2-5165-4713-a497-3d36d7abce05-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-q2x5j\" (UID: \"f48cf9a2-5165-4713-a497-3d36d7abce05\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j" Jun 02 09:36:07.611741 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.611714 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-jqwfj"] Jun 02 09:36:07.624233 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.624209 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fbc9df996-684js"] Jun 02 09:36:07.624389 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.624368 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-jqwfj" Jun 02 09:36:07.626778 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.626756 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 09:36:07.627134 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.627115 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 09:36:07.627296 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.627279 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vxnl5\"" Jun 02 09:36:07.644870 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.644844 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-jqwfj"] Jun 02 09:36:07.644870 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.644873 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fbc9df996-684js"] Jun 02 09:36:07.645060 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.644961 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.647491 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.647465 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wwvgb"] Jun 02 09:36:07.667888 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.667736 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.668930 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.668887 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wwvgb"] Jun 02 09:36:07.670918 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.670889 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rm8ng\"" Jun 02 09:36:07.671011 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.670965 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 09:36:07.671179 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.671145 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 09:36:07.671396 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.671363 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 09:36:07.672583 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.672492 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 09:36:07.681945 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.681922 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d82fcf3-33b9-4931-855f-8434cb2dacd5-image-registry-private-configuration\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.682037 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.681965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82fcf3-33b9-4931-855f-8434cb2dacd5-registry-tls\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.682037 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.682018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d82fcf3-33b9-4931-855f-8434cb2dacd5-ca-trust-extracted\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.682119 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.682063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d82fcf3-33b9-4931-855f-8434cb2dacd5-trusted-ca\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.682119 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.682096 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz5xw\" (UniqueName: \"kubernetes.io/projected/1d82fcf3-33b9-4931-855f-8434cb2dacd5-kube-api-access-cz5xw\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.682222 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.682135 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f48cf9a2-5165-4713-a497-3d36d7abce05-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-q2x5j\" (UID: \"f48cf9a2-5165-4713-a497-3d36d7abce05\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j" Jun 02 09:36:07.682222 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.682164 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d82fcf3-33b9-4931-855f-8434cb2dacd5-installation-pull-secrets\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.682222 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.682197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq5mw\" (UniqueName: \"kubernetes.io/projected/d1717961-7f3e-4494-a96f-9e90d6b1a523-kube-api-access-zq5mw\") pod \"downloads-c65b8dc4b-jqwfj\" (UID: \"d1717961-7f3e-4494-a96f-9e90d6b1a523\") " pod="openshift-console/downloads-c65b8dc4b-jqwfj" Jun 02 09:36:07.682364 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.682230 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d82fcf3-33b9-4931-855f-8434cb2dacd5-registry-certificates\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.682364 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.682255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d82fcf3-33b9-4931-855f-8434cb2dacd5-bound-sa-token\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.682364 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.682286 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f48cf9a2-5165-4713-a497-3d36d7abce05-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-q2x5j\" (UID: \"f48cf9a2-5165-4713-a497-3d36d7abce05\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j" Jun 02 09:36:07.682787 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.682767 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f48cf9a2-5165-4713-a497-3d36d7abce05-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-q2x5j\" (UID: \"f48cf9a2-5165-4713-a497-3d36d7abce05\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j" Jun 02 09:36:07.685047 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.685019 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f48cf9a2-5165-4713-a497-3d36d7abce05-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-q2x5j\" (UID: \"f48cf9a2-5165-4713-a497-3d36d7abce05\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j" Jun 02 09:36:07.783358 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.783520 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783343 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d82fcf3-33b9-4931-855f-8434cb2dacd5-ca-trust-extracted\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.783520 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783395 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cz5xw\" (UniqueName: \"kubernetes.io/projected/1d82fcf3-33b9-4931-855f-8434cb2dacd5-kube-api-access-cz5xw\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.783520 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783469 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d82fcf3-33b9-4931-855f-8434cb2dacd5-bound-sa-token\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.783675 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783528 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d82fcf3-33b9-4931-855f-8434cb2dacd5-registry-certificates\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.783675 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-crio-socket\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.783675 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.783675 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783626 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-data-volume\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.783675 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783665 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zq5mw\" (UniqueName: \"kubernetes.io/projected/d1717961-7f3e-4494-a96f-9e90d6b1a523-kube-api-access-zq5mw\") pod \"downloads-c65b8dc4b-jqwfj\" (UID: \"d1717961-7f3e-4494-a96f-9e90d6b1a523\") " pod="openshift-console/downloads-c65b8dc4b-jqwfj" Jun 02 09:36:07.783961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783692 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjz6l\" (UniqueName: \"kubernetes.io/projected/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-kube-api-access-jjz6l\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.783961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783725 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d82fcf3-33b9-4931-855f-8434cb2dacd5-ca-trust-extracted\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.783961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783734 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d82fcf3-33b9-4931-855f-8434cb2dacd5-trusted-ca\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.783961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783792 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d82fcf3-33b9-4931-855f-8434cb2dacd5-image-registry-private-configuration\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.783961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783850 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82fcf3-33b9-4931-855f-8434cb2dacd5-registry-tls\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.783961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.783886 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d82fcf3-33b9-4931-855f-8434cb2dacd5-installation-pull-secrets\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.784567 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.784510 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d82fcf3-33b9-4931-855f-8434cb2dacd5-registry-certificates\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.784567 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.784549 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d82fcf3-33b9-4931-855f-8434cb2dacd5-trusted-ca\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.786818 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.786760 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82fcf3-33b9-4931-855f-8434cb2dacd5-registry-tls\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.786916 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.786799 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d82fcf3-33b9-4931-855f-8434cb2dacd5-image-registry-private-configuration\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.787398 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.787376 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d82fcf3-33b9-4931-855f-8434cb2dacd5-installation-pull-secrets\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.795078 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.795021 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d82fcf3-33b9-4931-855f-8434cb2dacd5-bound-sa-token\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.797478 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.797454 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz5xw\" (UniqueName: \"kubernetes.io/projected/1d82fcf3-33b9-4931-855f-8434cb2dacd5-kube-api-access-cz5xw\") pod \"image-registry-fbc9df996-684js\" (UID: \"1d82fcf3-33b9-4931-855f-8434cb2dacd5\") " pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.797577 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.797506 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq5mw\" (UniqueName: \"kubernetes.io/projected/d1717961-7f3e-4494-a96f-9e90d6b1a523-kube-api-access-zq5mw\") pod \"downloads-c65b8dc4b-jqwfj\" (UID: \"d1717961-7f3e-4494-a96f-9e90d6b1a523\") " pod="openshift-console/downloads-c65b8dc4b-jqwfj" Jun 02 09:36:07.835431 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.835398 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j" Jun 02 09:36:07.884614 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.884573 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.884769 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.884631 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-crio-socket\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.884769 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.884672 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.884769 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.884703 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-data-volume\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.884769 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.884742 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjz6l\" (UniqueName: \"kubernetes.io/projected/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-kube-api-access-jjz6l\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.885003 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.884774 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-crio-socket\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.885402 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.885375 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-data-volume\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.885597 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.885571 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.887486 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.887443 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.895071 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.895023 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjz6l\" (UniqueName: \"kubernetes.io/projected/8dea1b51-eb5e-49f6-844b-04a6829c0d9c-kube-api-access-jjz6l\") pod \"insights-runtime-extractor-wwvgb\" (UID: \"8dea1b51-eb5e-49f6-844b-04a6829c0d9c\") " pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:07.935534 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.935505 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-jqwfj" Jun 02 09:36:07.955422 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.955186 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:07.978979 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:07.978955 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wwvgb" Jun 02 09:36:10.293597 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:10.287424 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fbc9df996-684js"] Jun 02 09:36:10.326586 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:10.326540 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-jqwfj"] Jun 02 09:36:10.331442 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:10.331410 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1717961_7f3e_4494_a96f_9e90d6b1a523.slice/crio-c8f7dbdb0858c38f05da9531d66b461bb6b8134567a64d695c24d27d68fe8ade WatchSource:0}: Error finding container c8f7dbdb0858c38f05da9531d66b461bb6b8134567a64d695c24d27d68fe8ade: Status 404 returned error can't find the container with id c8f7dbdb0858c38f05da9531d66b461bb6b8134567a64d695c24d27d68fe8ade Jun 02 09:36:10.537175 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:10.537144 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j"] Jun 02 09:36:10.540557 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:10.540514 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf48cf9a2_5165_4713_a497_3d36d7abce05.slice/crio-749a0d8a1a96a4dcc087df86f49b4b49810546981331ffec87f330ee423fd02c WatchSource:0}: Error finding container 749a0d8a1a96a4dcc087df86f49b4b49810546981331ffec87f330ee423fd02c: Status 404 returned error can't find the container with id 749a0d8a1a96a4dcc087df86f49b4b49810546981331ffec87f330ee423fd02c Jun 02 09:36:10.540743 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:10.540722 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wwvgb"] Jun 02 09:36:10.544601 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:10.544580 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dea1b51_eb5e_49f6_844b_04a6829c0d9c.slice/crio-0bedca547ddd16e7fabbdd878ddff0a9e4270fcddb00ada42141317a72523492 WatchSource:0}: Error finding container 0bedca547ddd16e7fabbdd878ddff0a9e4270fcddb00ada42141317a72523492: Status 404 returned error can't find the container with id 0bedca547ddd16e7fabbdd878ddff0a9e4270fcddb00ada42141317a72523492 Jun 02 09:36:11.061175 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.061093 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s9fqx" event={"ID":"cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4","Type":"ContainerStarted","Data":"bc7102247485f5f5c282240048b6fd49645b4c70c948219defc97cb088a07f5f"} Jun 02 09:36:11.063182 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.063146 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fq9nd" event={"ID":"67dc512d-8837-47bf-b672-5b2381fd8ae8","Type":"ContainerStarted","Data":"205c16a0652ab6dfb2190e70eed1ceb85d15b21ed368d3a3b19ad73441b21e58"} Jun 02 09:36:11.063321 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.063189 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fq9nd" event={"ID":"67dc512d-8837-47bf-b672-5b2381fd8ae8","Type":"ContainerStarted","Data":"7c5c533d05e7587f924d1a6326abca877f951c41ecc773a314dfc01c2a6e6525"} Jun 02 09:36:11.063445 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.063421 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fq9nd" Jun 02 09:36:11.065534 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.065506 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wwvgb" event={"ID":"8dea1b51-eb5e-49f6-844b-04a6829c0d9c","Type":"ContainerStarted","Data":"e3e8db5d2d46167fbfbabd54159e663d1641d0c16a05932205383feaf4162def"} Jun 02 09:36:11.065534 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.065541 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wwvgb" event={"ID":"8dea1b51-eb5e-49f6-844b-04a6829c0d9c","Type":"ContainerStarted","Data":"0bedca547ddd16e7fabbdd878ddff0a9e4270fcddb00ada42141317a72523492"} Jun 02 09:36:11.068000 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.067972 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzrnz" event={"ID":"09aaecf3-0414-4dde-8c6b-1f2bac4e7428","Type":"ContainerStarted","Data":"8bcc9ceb62e6eda185e5b17888d8860dbf0088ac6d7b1ad53a792d1f172edadc"} Jun 02 09:36:11.068129 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.068112 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:36:11.070381 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.070349 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qcqzq" event={"ID":"17dcae50-58fd-49b1-8afa-88e5b3eca13b","Type":"ContainerStarted","Data":"2b129b9477485bd1e58fffb3eb3da7e4c527d47b3d61888f18b3cc23724799e9"} Jun 02 09:36:11.070500 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.070385 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qcqzq" event={"ID":"17dcae50-58fd-49b1-8afa-88e5b3eca13b","Type":"ContainerStarted","Data":"e839581d87bb274f1b392e25ff7234ed4763f7ecff918780cc7271601c896c9a"} Jun 02 09:36:11.071478 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.071452 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j" event={"ID":"f48cf9a2-5165-4713-a497-3d36d7abce05","Type":"ContainerStarted","Data":"749a0d8a1a96a4dcc087df86f49b4b49810546981331ffec87f330ee423fd02c"} Jun 02 09:36:11.072886 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.072861 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fbc9df996-684js" event={"ID":"1d82fcf3-33b9-4931-855f-8434cb2dacd5","Type":"ContainerStarted","Data":"407d4c6cbc6ce537afd5c65f9a45cb7015fa8d691cec37a23ee547524c87082b"} Jun 02 09:36:11.072990 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.072888 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fbc9df996-684js" event={"ID":"1d82fcf3-33b9-4931-855f-8434cb2dacd5","Type":"ContainerStarted","Data":"bd3777c79dc10b193d6ae68a26554c3934588e928dcd76b895c1b6119e50d0b9"} Jun 02 09:36:11.072990 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.072985 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:11.074155 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.074132 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-jqwfj" event={"ID":"d1717961-7f3e-4494-a96f-9e90d6b1a523","Type":"ContainerStarted","Data":"c8f7dbdb0858c38f05da9531d66b461bb6b8134567a64d695c24d27d68fe8ade"} Jun 02 09:36:11.100926 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.100871 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s9fqx" podStartSLOduration=33.949110702 podStartE2EDuration="38.100855701s" podCreationTimestamp="2026-06-02 09:35:33 +0000 UTC" firstStartedPulling="2026-06-02 09:36:05.956548119 +0000 UTC m=+65.701408763" lastFinishedPulling="2026-06-02 09:36:10.108293101 +0000 UTC m=+69.853153762" observedRunningTime="2026-06-02 09:36:11.081156457 +0000 UTC m=+70.826017125" watchObservedRunningTime="2026-06-02 09:36:11.100855701 +0000 UTC m=+70.845716369" Jun 02 09:36:11.125552 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.124159 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fbc9df996-684js" podStartSLOduration=4.12414321 podStartE2EDuration="4.12414321s" podCreationTimestamp="2026-06-02 09:36:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 09:36:11.123487387 +0000 UTC m=+70.868348056" watchObservedRunningTime="2026-06-02 09:36:11.12414321 +0000 UTC m=+70.869003878" Jun 02 09:36:11.125552 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.125188 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hzrnz" podStartSLOduration=66.876153815 podStartE2EDuration="1m11.125176194s" podCreationTimestamp="2026-06-02 09:35:00 +0000 UTC" firstStartedPulling="2026-06-02 09:36:05.886336816 +0000 UTC m=+65.631197463" lastFinishedPulling="2026-06-02 09:36:10.13535919 +0000 UTC m=+69.880219842" observedRunningTime="2026-06-02 09:36:11.10137448 +0000 UTC m=+70.846235148" watchObservedRunningTime="2026-06-02 09:36:11.125176194 +0000 UTC m=+70.870036866" Jun 02 09:36:11.141114 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.140660 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qcqzq" podStartSLOduration=67.136492569 podStartE2EDuration="1m11.140645299s" podCreationTimestamp="2026-06-02 09:35:00 +0000 UTC" firstStartedPulling="2026-06-02 09:36:06.106318065 +0000 UTC m=+65.851178712" lastFinishedPulling="2026-06-02 09:36:10.110470783 +0000 UTC m=+69.855331442" observedRunningTime="2026-06-02 09:36:11.140196223 +0000 UTC m=+70.885056892" watchObservedRunningTime="2026-06-02 09:36:11.140645299 +0000 UTC m=+70.885505966" Jun 02 09:36:11.158839 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:11.158775 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-fq9nd" podStartSLOduration=34.008643118 podStartE2EDuration="38.158764931s" podCreationTimestamp="2026-06-02 09:35:33 +0000 UTC" firstStartedPulling="2026-06-02 09:36:05.932033026 +0000 UTC m=+65.676893688" lastFinishedPulling="2026-06-02 09:36:10.082154841 +0000 UTC m=+69.827015501" observedRunningTime="2026-06-02 09:36:11.157443843 +0000 UTC m=+70.902304513" watchObservedRunningTime="2026-06-02 09:36:11.158764931 +0000 UTC m=+70.903625599" Jun 02 09:36:12.079295 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:12.079211 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j" event={"ID":"f48cf9a2-5165-4713-a497-3d36d7abce05","Type":"ContainerStarted","Data":"d6ded732b7c54ced8bdc0b3205dd6022af9e26b032fb7e93e9e3702437cfff22"} Jun 02 09:36:12.081680 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:12.081645 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wwvgb" event={"ID":"8dea1b51-eb5e-49f6-844b-04a6829c0d9c","Type":"ContainerStarted","Data":"b7bf0212a5d3588666ca43236b4677a991fce001cac090b93ec64fcb4b8f3c71"} Jun 02 09:36:12.096188 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:12.096141 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-q2x5j" podStartSLOduration=3.891324412 podStartE2EDuration="5.096127864s" podCreationTimestamp="2026-06-02 09:36:07 +0000 UTC" firstStartedPulling="2026-06-02 09:36:10.542762705 +0000 UTC m=+70.287623350" lastFinishedPulling="2026-06-02 09:36:11.747566151 +0000 UTC m=+71.492426802" observedRunningTime="2026-06-02 09:36:12.095150986 +0000 UTC m=+71.840011654" watchObservedRunningTime="2026-06-02 09:36:12.096127864 +0000 UTC m=+71.840988530" Jun 02 09:36:13.087608 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:13.087561 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wwvgb" event={"ID":"8dea1b51-eb5e-49f6-844b-04a6829c0d9c","Type":"ContainerStarted","Data":"0e84d70a67b908a8191974f375d29d94e875a9f718db525f55432460919a5ccf"} Jun 02 09:36:13.113409 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:13.113352 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wwvgb" podStartSLOduration=3.8302203070000003 podStartE2EDuration="6.113333725s" podCreationTimestamp="2026-06-02 09:36:07 +0000 UTC" firstStartedPulling="2026-06-02 09:36:10.596796707 +0000 UTC m=+70.341657351" lastFinishedPulling="2026-06-02 09:36:12.879910108 +0000 UTC m=+72.624770769" observedRunningTime="2026-06-02 09:36:13.111292359 +0000 UTC m=+72.856153039" watchObservedRunningTime="2026-06-02 09:36:13.113333725 +0000 UTC m=+72.858194397" Jun 02 09:36:21.084729 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:21.084599 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fq9nd" Jun 02 09:36:27.124523 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:27.124495 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-jqwfj" event={"ID":"d1717961-7f3e-4494-a96f-9e90d6b1a523","Type":"ContainerStarted","Data":"a59f93d9b89182fc312e1254a874becc89f3be095a8a6769137152991a923087"} Jun 02 09:36:27.124865 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:27.124763 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-jqwfj" Jun 02 09:36:27.125890 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:27.125868 2567 patch_prober.go:28] interesting pod/downloads-c65b8dc4b-jqwfj container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.10:8080/\": dial tcp 10.133.0.10:8080: connect: connection refused" start-of-body= Jun 02 09:36:27.125937 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:27.125911 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-c65b8dc4b-jqwfj" podUID="d1717961-7f3e-4494-a96f-9e90d6b1a523" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.10:8080/\": dial tcp 10.133.0.10:8080: connect: connection refused" Jun 02 09:36:27.144428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:27.144387 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-jqwfj" podStartSLOduration=3.450628899 podStartE2EDuration="20.144374542s" podCreationTimestamp="2026-06-02 09:36:07 +0000 UTC" firstStartedPulling="2026-06-02 09:36:10.335296752 +0000 UTC m=+70.080157397" lastFinishedPulling="2026-06-02 09:36:27.029042391 +0000 UTC m=+86.773903040" observedRunningTime="2026-06-02 09:36:27.142573493 +0000 UTC m=+86.887434184" watchObservedRunningTime="2026-06-02 09:36:27.144374542 +0000 UTC m=+86.889235208" Jun 02 09:36:28.130730 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:28.130697 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-jqwfj" Jun 02 09:36:29.057449 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:29.057420 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:36:32.086824 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:32.086779 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fbc9df996-684js" Jun 02 09:36:34.070098 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.070051 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7898867997-c65b9" podUID="cdbd156e-cfb5-4981-b885-4b25315f1ed3" containerName="registry" containerID="cri-o://0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66" gracePeriod=30 Jun 02 09:36:34.341106 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.341080 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:36:34.489251 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.489219 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdbd156e-cfb5-4981-b885-4b25315f1ed3-ca-trust-extracted\") pod \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " Jun 02 09:36:34.489418 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.489274 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-installation-pull-secrets\") pod \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " Jun 02 09:36:34.489418 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.489303 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls\") pod \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " Jun 02 09:36:34.489418 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.489334 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhrnm\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-kube-api-access-lhrnm\") pod \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " Jun 02 09:36:34.489418 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.489361 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-bound-sa-token\") pod \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " Jun 02 09:36:34.489418 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.489393 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-image-registry-private-configuration\") pod \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " Jun 02 09:36:34.489689 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.489431 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-certificates\") pod \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " Jun 02 09:36:34.489689 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.489463 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-trusted-ca\") pod \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\" (UID: \"cdbd156e-cfb5-4981-b885-4b25315f1ed3\") " Jun 02 09:36:34.489958 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.489923 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cdbd156e-cfb5-4981-b885-4b25315f1ed3" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 09:36:34.490051 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.489979 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cdbd156e-cfb5-4981-b885-4b25315f1ed3" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 09:36:34.492197 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.492166 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cdbd156e-cfb5-4981-b885-4b25315f1ed3" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 09:36:34.492319 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.492217 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cdbd156e-cfb5-4981-b885-4b25315f1ed3" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 09:36:34.492319 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.492247 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cdbd156e-cfb5-4981-b885-4b25315f1ed3" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 09:36:34.492418 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.492305 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-kube-api-access-lhrnm" (OuterVolumeSpecName: "kube-api-access-lhrnm") pod "cdbd156e-cfb5-4981-b885-4b25315f1ed3" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3"). InnerVolumeSpecName "kube-api-access-lhrnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 09:36:34.492472 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.492443 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cdbd156e-cfb5-4981-b885-4b25315f1ed3" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 09:36:34.502185 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.502143 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdbd156e-cfb5-4981-b885-4b25315f1ed3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cdbd156e-cfb5-4981-b885-4b25315f1ed3" (UID: "cdbd156e-cfb5-4981-b885-4b25315f1ed3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 09:36:34.590927 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.590875 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-trusted-ca\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 02 09:36:34.590927 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.590896 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdbd156e-cfb5-4981-b885-4b25315f1ed3-ca-trust-extracted\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 02 09:36:34.590927 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.590906 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-installation-pull-secrets\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 02 09:36:34.590927 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.590916 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-tls\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 02 09:36:34.590927 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.590924 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhrnm\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-kube-api-access-lhrnm\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 02 09:36:34.591188 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.590932 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdbd156e-cfb5-4981-b885-4b25315f1ed3-bound-sa-token\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 02 09:36:34.591188 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.590947 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdbd156e-cfb5-4981-b885-4b25315f1ed3-image-registry-private-configuration\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 02 09:36:34.591188 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:34.590962 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdbd156e-cfb5-4981-b885-4b25315f1ed3-registry-certificates\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 02 09:36:35.147891 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:35.147858 2567 generic.go:358] "Generic (PLEG): container finished" podID="cdbd156e-cfb5-4981-b885-4b25315f1ed3" containerID="0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66" exitCode=0 Jun 02 09:36:35.148343 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:35.147930 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7898867997-c65b9" event={"ID":"cdbd156e-cfb5-4981-b885-4b25315f1ed3","Type":"ContainerDied","Data":"0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66"} Jun 02 09:36:35.148343 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:35.147964 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7898867997-c65b9" Jun 02 09:36:35.148343 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:35.147981 2567 scope.go:117] "RemoveContainer" containerID="0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66" Jun 02 09:36:35.148343 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:35.147968 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7898867997-c65b9" event={"ID":"cdbd156e-cfb5-4981-b885-4b25315f1ed3","Type":"ContainerDied","Data":"9cddf39b4085d31b53af78a4b9dd3a54494c99042f4c31d34638d7eb404e237d"} Jun 02 09:36:35.156568 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:35.156534 2567 scope.go:117] "RemoveContainer" containerID="0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66" Jun 02 09:36:35.156919 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:36:35.156887 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66\": container with ID starting with 0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66 not found: ID does not exist" containerID="0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66" Jun 02 09:36:35.157031 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:35.156928 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66"} err="failed to get container status \"0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66\": rpc error: code = NotFound desc = could not find container \"0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66\": container with ID starting with 0d4fcb171664dd1bcad9a7f0ac7eb20d2237d0dcb25d43813401f33466136a66 not found: ID does not exist" Jun 02 09:36:35.167699 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:35.167674 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7898867997-c65b9"] Jun 02 09:36:35.172096 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:35.172076 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7898867997-c65b9"] Jun 02 09:36:36.799081 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:36.799054 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdbd156e-cfb5-4981-b885-4b25315f1ed3" path="/var/lib/kubelet/pods/cdbd156e-cfb5-4981-b885-4b25315f1ed3/volumes" Jun 02 09:36:37.884353 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.884322 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-j6zrq"] Jun 02 09:36:37.884763 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.884518 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdbd156e-cfb5-4981-b885-4b25315f1ed3" containerName="registry" Jun 02 09:36:37.884763 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.884528 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdbd156e-cfb5-4981-b885-4b25315f1ed3" containerName="registry" Jun 02 09:36:37.884763 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.884571 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="cdbd156e-cfb5-4981-b885-4b25315f1ed3" containerName="registry" Jun 02 09:36:37.913684 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.913659 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-j6zrq"] Jun 02 09:36:37.913800 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.913777 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:37.917535 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.917513 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 09:36:37.918715 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.918691 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5wcgz\"" Jun 02 09:36:37.919102 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.918703 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 09:36:37.919102 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.918774 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 09:36:37.919102 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.918774 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 09:36:37.919102 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.918829 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 09:36:37.919801 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.919779 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-kv57v"] Jun 02 09:36:37.938731 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.938713 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-kv57v"] Jun 02 09:36:37.938850 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.938826 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:37.943488 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.943467 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 09:36:37.943665 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.943626 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zw797\"" Jun 02 09:36:37.943898 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.943878 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 09:36:37.943982 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.943964 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 09:36:37.948288 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.948259 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2gxtz"] Jun 02 09:36:37.961465 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.961444 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:37.967564 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.967548 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 09:36:37.967673 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.967656 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 09:36:37.967846 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.967831 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ns7lh\"" Jun 02 09:36:37.967921 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:37.967908 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 09:36:38.014310 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.014284 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.014433 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.014314 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.014433 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.014339 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh5vj\" (UniqueName: \"kubernetes.io/projected/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-kube-api-access-lh5vj\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.014433 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.014410 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.115123 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115098 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.115286 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115130 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-tls\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.115286 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115209 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.115286 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115241 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-wtmp\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.115286 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115261 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-accelerators-collector-config\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.115286 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbqqf\" (UniqueName: \"kubernetes.io/projected/406f662d-09ff-4b07-bd78-a56a1673c64d-kube-api-access-tbqqf\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.115442 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-textfile\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.115442 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115317 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/406f662d-09ff-4b07-bd78-a56a1673c64d-metrics-client-ca\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.115442 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115382 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.115442 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mts7\" (UniqueName: \"kubernetes.io/projected/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-api-access-4mts7\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.115573 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115443 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.115573 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115466 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/406f662d-09ff-4b07-bd78-a56a1673c64d-root\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.115573 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115495 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.115573 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115525 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ccec21-385a-4b05-926e-1ccb4ec74f6b-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.115573 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:36:38.115526 2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 09:36:38.115573 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115556 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lh5vj\" (UniqueName: \"kubernetes.io/projected/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-kube-api-access-lh5vj\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.115854 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:36:38.115588 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-openshift-state-metrics-tls podName:5a7b884c-5d2a-4d15-8975-fc6ae59a6424 nodeName:}" failed. No retries permitted until 2026-06-02 09:36:38.615571456 +0000 UTC m=+98.360432101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-j6zrq" (UID: "5a7b884c-5d2a-4d15-8975-fc6ae59a6424") : secret "openshift-state-metrics-tls" not found Jun 02 09:36:38.115854 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/90ccec21-385a-4b05-926e-1ccb4ec74f6b-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.115854 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.115854 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115656 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/406f662d-09ff-4b07-bd78-a56a1673c64d-sys\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.115854 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.115679 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.116229 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.116213 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.117613 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.117596 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.127130 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.127109 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh5vj\" (UniqueName: \"kubernetes.io/projected/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-kube-api-access-lh5vj\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.216486 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216192 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-tls\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.216486 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216240 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.216486 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216270 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-wtmp\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.216486 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216298 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-accelerators-collector-config\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.216486 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216327 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbqqf\" (UniqueName: \"kubernetes.io/projected/406f662d-09ff-4b07-bd78-a56a1673c64d-kube-api-access-tbqqf\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.216486 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216358 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-textfile\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.216486 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216385 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/406f662d-09ff-4b07-bd78-a56a1673c64d-metrics-client-ca\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.216486 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216451 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mts7\" (UniqueName: \"kubernetes.io/projected/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-api-access-4mts7\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.216993 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216493 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/406f662d-09ff-4b07-bd78-a56a1673c64d-root\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.216993 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216522 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.216993 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216551 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ccec21-385a-4b05-926e-1ccb4ec74f6b-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.216993 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216583 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/90ccec21-385a-4b05-926e-1ccb4ec74f6b-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.216993 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216630 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.216993 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216670 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/406f662d-09ff-4b07-bd78-a56a1673c64d-sys\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.216993 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216710 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.216993 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216714 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-wtmp\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.217392 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.217316 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.217453 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.216624 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/406f662d-09ff-4b07-bd78-a56a1673c64d-root\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.217453 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.217413 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ccec21-385a-4b05-926e-1ccb4ec74f6b-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.217554 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.217460 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/406f662d-09ff-4b07-bd78-a56a1673c64d-sys\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.217836 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.217798 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/90ccec21-385a-4b05-926e-1ccb4ec74f6b-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.217947 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.217884 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-accelerators-collector-config\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.218356 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.218021 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/406f662d-09ff-4b07-bd78-a56a1673c64d-metrics-client-ca\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.218356 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.218231 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-textfile\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.219685 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.219659 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.219887 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.219867 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-tls\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.220205 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.220186 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.220369 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.220349 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/406f662d-09ff-4b07-bd78-a56a1673c64d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.225555 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.225531 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbqqf\" (UniqueName: \"kubernetes.io/projected/406f662d-09ff-4b07-bd78-a56a1673c64d-kube-api-access-tbqqf\") pod \"node-exporter-2gxtz\" (UID: \"406f662d-09ff-4b07-bd78-a56a1673c64d\") " pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.226161 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.226140 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mts7\" (UniqueName: \"kubernetes.io/projected/90ccec21-385a-4b05-926e-1ccb4ec74f6b-kube-api-access-4mts7\") pod \"kube-state-metrics-8469c486bb-kv57v\" (UID: \"90ccec21-385a-4b05-926e-1ccb4ec74f6b\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.252130 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.252103 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" Jun 02 09:36:38.269801 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.269779 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2gxtz" Jun 02 09:36:38.276953 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:38.276932 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406f662d_09ff_4b07_bd78_a56a1673c64d.slice/crio-97f9f1786c7800201d347d7b8e0ecc626184edca4ed5830c740ef0fc84a412c1 WatchSource:0}: Error finding container 97f9f1786c7800201d347d7b8e0ecc626184edca4ed5830c740ef0fc84a412c1: Status 404 returned error can't find the container with id 97f9f1786c7800201d347d7b8e0ecc626184edca4ed5830c740ef0fc84a412c1 Jun 02 09:36:38.372776 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.372742 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-kv57v"] Jun 02 09:36:38.375383 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:38.375361 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ccec21_385a_4b05_926e_1ccb4ec74f6b.slice/crio-bfab17309177d42db13669a04996e03ec06d8d9ce2454573c902d1e14deed065 WatchSource:0}: Error finding container bfab17309177d42db13669a04996e03ec06d8d9ce2454573c902d1e14deed065: Status 404 returned error can't find the container with id bfab17309177d42db13669a04996e03ec06d8d9ce2454573c902d1e14deed065 Jun 02 09:36:38.619991 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.619963 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.622248 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.622223 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a7b884c-5d2a-4d15-8975-fc6ae59a6424-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-j6zrq\" (UID: \"5a7b884c-5d2a-4d15-8975-fc6ae59a6424\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.823521 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.823495 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" Jun 02 09:36:38.971842 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:38.971793 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-j6zrq"] Jun 02 09:36:38.974840 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:38.974797 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7b884c_5d2a_4d15_8975_fc6ae59a6424.slice/crio-4f1a34132bc5572d0e4f1a133e1cb308f44fb69b7c82eafe3e5e21312bdf68e3 WatchSource:0}: Error finding container 4f1a34132bc5572d0e4f1a133e1cb308f44fb69b7c82eafe3e5e21312bdf68e3: Status 404 returned error can't find the container with id 4f1a34132bc5572d0e4f1a133e1cb308f44fb69b7c82eafe3e5e21312bdf68e3 Jun 02 09:36:39.160266 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:39.160194 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" event={"ID":"90ccec21-385a-4b05-926e-1ccb4ec74f6b","Type":"ContainerStarted","Data":"bfab17309177d42db13669a04996e03ec06d8d9ce2454573c902d1e14deed065"} Jun 02 09:36:39.161516 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:39.161478 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2gxtz" event={"ID":"406f662d-09ff-4b07-bd78-a56a1673c64d","Type":"ContainerStarted","Data":"97f9f1786c7800201d347d7b8e0ecc626184edca4ed5830c740ef0fc84a412c1"} Jun 02 09:36:39.163076 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:39.163049 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" event={"ID":"5a7b884c-5d2a-4d15-8975-fc6ae59a6424","Type":"ContainerStarted","Data":"a0613d408c9431a87747533bc9f7ea453be505c9a5821535f741debfdd8d791e"} Jun 02 09:36:39.163191 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:39.163082 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" event={"ID":"5a7b884c-5d2a-4d15-8975-fc6ae59a6424","Type":"ContainerStarted","Data":"4f1a34132bc5572d0e4f1a133e1cb308f44fb69b7c82eafe3e5e21312bdf68e3"} Jun 02 09:36:40.061325 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.061292 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv"] Jun 02 09:36:40.085114 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.085088 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv"] Jun 02 09:36:40.085285 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.085222 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.089957 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.089930 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 09:36:40.089957 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.089955 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 09:36:40.090114 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.089966 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 09:36:40.091105 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.091082 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 09:36:40.091215 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.091143 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 09:36:40.091215 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.091143 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a84hfbcnlshm9\"" Jun 02 09:36:40.091332 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.091151 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5b87s\"" Jun 02 09:36:40.167683 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.167648 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" event={"ID":"5a7b884c-5d2a-4d15-8975-fc6ae59a6424","Type":"ContainerStarted","Data":"3ebf4dc808c1e3660d65b6ac3c07b1ac78536f6035e3274a381f7448c8e0816f"} Jun 02 09:36:40.233076 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.233042 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-tls\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.233076 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.233076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.233249 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.233098 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.233249 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.233156 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-grpc-tls\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.233249 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.233216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkbzj\" (UniqueName: \"kubernetes.io/projected/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-kube-api-access-kkbzj\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.233343 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.233256 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.233343 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.233280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.233343 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.233313 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-metrics-client-ca\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.334358 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.334335 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkbzj\" (UniqueName: \"kubernetes.io/projected/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-kube-api-access-kkbzj\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.334459 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.334379 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.334459 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.334400 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.334459 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.334419 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-metrics-client-ca\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.334459 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.334440 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-tls\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.334669 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.334583 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.334669 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.334632 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.334786 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.334679 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-grpc-tls\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.335324 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.335299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-metrics-client-ca\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.336995 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.336949 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.337093 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.337075 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.337330 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.337307 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.337546 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.337526 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-grpc-tls\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.337617 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.337538 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-tls\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.337672 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.337613 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.342852 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.342834 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkbzj\" (UniqueName: \"kubernetes.io/projected/ff9fff9d-1e45-44a4-a434-aa2565fb64b9-kube-api-access-kkbzj\") pod \"thanos-querier-7bf5bdccd5-kwstv\" (UID: \"ff9fff9d-1e45-44a4-a434-aa2565fb64b9\") " pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.394381 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.394358 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:40.574249 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:40.573855 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv"] Jun 02 09:36:40.607900 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:40.607666 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9fff9d_1e45_44a4_a434_aa2565fb64b9.slice/crio-ebfdf4ba218d27efa98f3c46e2bbd8b5204671493de0618c82d5afaed8af8add WatchSource:0}: Error finding container ebfdf4ba218d27efa98f3c46e2bbd8b5204671493de0618c82d5afaed8af8add: Status 404 returned error can't find the container with id ebfdf4ba218d27efa98f3c46e2bbd8b5204671493de0618c82d5afaed8af8add Jun 02 09:36:41.172282 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:41.172243 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" event={"ID":"90ccec21-385a-4b05-926e-1ccb4ec74f6b","Type":"ContainerStarted","Data":"e92524e27519457d43588b3d8e0eb5d65c28e6e142578dca49e0942b72bdaa16"} Jun 02 09:36:41.172282 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:41.172283 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" event={"ID":"90ccec21-385a-4b05-926e-1ccb4ec74f6b","Type":"ContainerStarted","Data":"f61da41085b423471a1bfb37cdfeae31376fd91553f70b810c59aa160e0fb75e"} Jun 02 09:36:41.172789 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:41.172299 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" event={"ID":"90ccec21-385a-4b05-926e-1ccb4ec74f6b","Type":"ContainerStarted","Data":"24faf70ccd0ff249d42ef4c071c86b131e22e17af9aa3187ede4ab7acf5c9892"} Jun 02 09:36:41.173575 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:41.173551 2567 generic.go:358] "Generic (PLEG): container finished" podID="406f662d-09ff-4b07-bd78-a56a1673c64d" containerID="8165923a243e13cfcd4b18057d73f44ae01f46cbe9bb14481493f6a5ea9710f6" exitCode=0 Jun 02 09:36:41.173669 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:41.173640 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2gxtz" event={"ID":"406f662d-09ff-4b07-bd78-a56a1673c64d","Type":"ContainerDied","Data":"8165923a243e13cfcd4b18057d73f44ae01f46cbe9bb14481493f6a5ea9710f6"} Jun 02 09:36:41.174545 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:41.174530 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" event={"ID":"ff9fff9d-1e45-44a4-a434-aa2565fb64b9","Type":"ContainerStarted","Data":"ebfdf4ba218d27efa98f3c46e2bbd8b5204671493de0618c82d5afaed8af8add"} Jun 02 09:36:41.191155 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:41.191123 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-kv57v" podStartSLOduration=2.279308287 podStartE2EDuration="4.191111934s" podCreationTimestamp="2026-06-02 09:36:37 +0000 UTC" firstStartedPulling="2026-06-02 09:36:38.37727143 +0000 UTC m=+98.122132078" lastFinishedPulling="2026-06-02 09:36:40.289075073 +0000 UTC m=+100.033935725" observedRunningTime="2026-06-02 09:36:41.190087106 +0000 UTC m=+100.934947773" watchObservedRunningTime="2026-06-02 09:36:41.191111934 +0000 UTC m=+100.935972609" Jun 02 09:36:42.084502 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.084470 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hzrnz" Jun 02 09:36:42.180046 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.179983 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2gxtz" event={"ID":"406f662d-09ff-4b07-bd78-a56a1673c64d","Type":"ContainerStarted","Data":"9b30e30552d650836bc896de7678ee8143f5b7a5c1a6211ee5d82d6b83a3fd83"} Jun 02 09:36:42.180046 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.180024 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2gxtz" event={"ID":"406f662d-09ff-4b07-bd78-a56a1673c64d","Type":"ContainerStarted","Data":"896ff7bc5f4b75bc39c481bc5d8fd88f4c09af70a53c2c1b2d4c456ccfc99a52"} Jun 02 09:36:42.182085 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.182029 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" event={"ID":"5a7b884c-5d2a-4d15-8975-fc6ae59a6424","Type":"ContainerStarted","Data":"b9666cee5697df58bd1ef6b5b5b90962a286bc49b2d6659d225983f081e07b81"} Jun 02 09:36:42.199560 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.199493 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2gxtz" podStartSLOduration=3.191755827 podStartE2EDuration="5.199477448s" podCreationTimestamp="2026-06-02 09:36:37 +0000 UTC" firstStartedPulling="2026-06-02 09:36:38.278514772 +0000 UTC m=+98.023375416" lastFinishedPulling="2026-06-02 09:36:40.286236386 +0000 UTC m=+100.031097037" observedRunningTime="2026-06-02 09:36:42.198722404 +0000 UTC m=+101.943583104" watchObservedRunningTime="2026-06-02 09:36:42.199477448 +0000 UTC m=+101.944338116" Jun 02 09:36:42.221548 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.221502 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-j6zrq" podStartSLOduration=3.352851561 podStartE2EDuration="5.221484725s" podCreationTimestamp="2026-06-02 09:36:37 +0000 UTC" firstStartedPulling="2026-06-02 09:36:39.486349129 +0000 UTC m=+99.231209785" lastFinishedPulling="2026-06-02 09:36:41.35498229 +0000 UTC m=+101.099842949" observedRunningTime="2026-06-02 09:36:42.220331589 +0000 UTC m=+101.965192257" watchObservedRunningTime="2026-06-02 09:36:42.221484725 +0000 UTC m=+101.966345393" Jun 02 09:36:42.312667 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.312641 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5866955564-ckzpx"] Jun 02 09:36:42.331697 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.331673 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5866955564-ckzpx"] Jun 02 09:36:42.331854 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.331770 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.334731 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.334681 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 09:36:42.334845 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.334736 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 09:36:42.335237 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.335219 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 09:36:42.335290 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.335233 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lz2bs\"" Jun 02 09:36:42.335343 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.335233 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 09:36:42.335512 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.335500 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5m270itokd3vk\"" Jun 02 09:36:42.451961 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.451930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60cb1d14-b304-4e3f-8005-3b4dec401904-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.452112 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.451971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/60cb1d14-b304-4e3f-8005-3b4dec401904-audit-log\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.452112 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.452027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7cr2\" (UniqueName: \"kubernetes.io/projected/60cb1d14-b304-4e3f-8005-3b4dec401904-kube-api-access-g7cr2\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.452112 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.452080 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/60cb1d14-b304-4e3f-8005-3b4dec401904-secret-metrics-server-client-certs\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.452247 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.452134 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/60cb1d14-b304-4e3f-8005-3b4dec401904-metrics-server-audit-profiles\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.452247 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.452183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60cb1d14-b304-4e3f-8005-3b4dec401904-client-ca-bundle\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.452247 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.452204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/60cb1d14-b304-4e3f-8005-3b4dec401904-secret-metrics-server-tls\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.552786 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.552758 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60cb1d14-b304-4e3f-8005-3b4dec401904-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.552935 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.552797 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/60cb1d14-b304-4e3f-8005-3b4dec401904-audit-log\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.552935 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.552855 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7cr2\" (UniqueName: \"kubernetes.io/projected/60cb1d14-b304-4e3f-8005-3b4dec401904-kube-api-access-g7cr2\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.552935 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.552884 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/60cb1d14-b304-4e3f-8005-3b4dec401904-secret-metrics-server-client-certs\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.552935 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.552915 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/60cb1d14-b304-4e3f-8005-3b4dec401904-metrics-server-audit-profiles\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.553147 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.552962 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60cb1d14-b304-4e3f-8005-3b4dec401904-client-ca-bundle\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.553147 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.552995 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/60cb1d14-b304-4e3f-8005-3b4dec401904-secret-metrics-server-tls\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.553399 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.553373 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/60cb1d14-b304-4e3f-8005-3b4dec401904-audit-log\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.553549 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.553508 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60cb1d14-b304-4e3f-8005-3b4dec401904-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.553757 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.553738 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/60cb1d14-b304-4e3f-8005-3b4dec401904-metrics-server-audit-profiles\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.555370 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.555347 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/60cb1d14-b304-4e3f-8005-3b4dec401904-secret-metrics-server-client-certs\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.555460 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.555394 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60cb1d14-b304-4e3f-8005-3b4dec401904-client-ca-bundle\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.555460 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.555428 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/60cb1d14-b304-4e3f-8005-3b4dec401904-secret-metrics-server-tls\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.560637 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.560614 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7cr2\" (UniqueName: \"kubernetes.io/projected/60cb1d14-b304-4e3f-8005-3b4dec401904-kube-api-access-g7cr2\") pod \"metrics-server-5866955564-ckzpx\" (UID: \"60cb1d14-b304-4e3f-8005-3b4dec401904\") " pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.641184 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.641122 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:36:42.670255 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.670221 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx"] Jun 02 09:36:42.695786 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.695750 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx"] Jun 02 09:36:42.695928 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.695908 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx" Jun 02 09:36:42.699046 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.698799 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-fgpdk\"" Jun 02 09:36:42.699174 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.699057 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 09:36:42.774269 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.774236 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5866955564-ckzpx"] Jun 02 09:36:42.777113 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:42.777086 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60cb1d14_b304_4e3f_8005_3b4dec401904.slice/crio-e7ef203b0197e1628912e3761308f34307d8cb3a192829d84c3e30aa895837ae WatchSource:0}: Error finding container e7ef203b0197e1628912e3761308f34307d8cb3a192829d84c3e30aa895837ae: Status 404 returned error can't find the container with id e7ef203b0197e1628912e3761308f34307d8cb3a192829d84c3e30aa895837ae Jun 02 09:36:42.855732 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.855710 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b19c4146-78b1-4de2-9c7d-856555005051-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-dtgjx\" (UID: \"b19c4146-78b1-4de2-9c7d-856555005051\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx" Jun 02 09:36:42.957210 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:42.957139 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b19c4146-78b1-4de2-9c7d-856555005051-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-dtgjx\" (UID: \"b19c4146-78b1-4de2-9c7d-856555005051\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx" Jun 02 09:36:42.957386 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:36:42.957290 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 09:36:42.957386 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:36:42.957372 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19c4146-78b1-4de2-9c7d-856555005051-monitoring-plugin-cert podName:b19c4146-78b1-4de2-9c7d-856555005051 nodeName:}" failed. No retries permitted until 2026-06-02 09:36:43.457347749 +0000 UTC m=+103.202208469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b19c4146-78b1-4de2-9c7d-856555005051-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-dtgjx" (UID: "b19c4146-78b1-4de2-9c7d-856555005051") : secret "monitoring-plugin-cert" not found Jun 02 09:36:43.186601 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:43.186555 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5866955564-ckzpx" event={"ID":"60cb1d14-b304-4e3f-8005-3b4dec401904","Type":"ContainerStarted","Data":"e7ef203b0197e1628912e3761308f34307d8cb3a192829d84c3e30aa895837ae"} Jun 02 09:36:43.461820 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:43.461778 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b19c4146-78b1-4de2-9c7d-856555005051-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-dtgjx\" (UID: \"b19c4146-78b1-4de2-9c7d-856555005051\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx" Jun 02 09:36:43.464064 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:43.464036 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b19c4146-78b1-4de2-9c7d-856555005051-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-dtgjx\" (UID: \"b19c4146-78b1-4de2-9c7d-856555005051\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx" Jun 02 09:36:43.608915 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:43.608883 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx" Jun 02 09:36:43.735796 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:43.735724 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx"] Jun 02 09:36:43.830906 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:43.830865 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19c4146_78b1_4de2_9c7d_856555005051.slice/crio-ada194314f3a195e206b9a8cba7a00c44a72fbe64d24dff99051009a38a3536d WatchSource:0}: Error finding container ada194314f3a195e206b9a8cba7a00c44a72fbe64d24dff99051009a38a3536d: Status 404 returned error can't find the container with id ada194314f3a195e206b9a8cba7a00c44a72fbe64d24dff99051009a38a3536d Jun 02 09:36:44.191349 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.191319 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx" event={"ID":"b19c4146-78b1-4de2-9c7d-856555005051","Type":"ContainerStarted","Data":"ada194314f3a195e206b9a8cba7a00c44a72fbe64d24dff99051009a38a3536d"} Jun 02 09:36:44.193143 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.193113 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" event={"ID":"ff9fff9d-1e45-44a4-a434-aa2565fb64b9","Type":"ContainerStarted","Data":"d3f60e2709f97a426c9b394b818e5bee2267c9b4209a07a44851f343b1dd2dfb"} Jun 02 09:36:44.193250 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.193153 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" event={"ID":"ff9fff9d-1e45-44a4-a434-aa2565fb64b9","Type":"ContainerStarted","Data":"c00743ba2a3713f5d4f7d56c95b2c865f053cc87b9008ec41316e9e7acecc9b6"} Jun 02 09:36:44.237628 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.237498 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 09:36:44.255362 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.255335 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.258488 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.258420 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 09:36:44.258488 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.258483 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 09:36:44.258633 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.258418 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 09:36:44.258633 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.258420 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2mp8k50epsjff\"" Jun 02 09:36:44.258784 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.258769 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 09:36:44.259077 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.258790 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6qmf6\"" Jun 02 09:36:44.259077 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.258907 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 09:36:44.260034 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.259734 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 09:36:44.260034 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.259749 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 09:36:44.260034 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.259828 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 09:36:44.260034 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.259884 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 09:36:44.260034 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.259960 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 09:36:44.264212 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.263987 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 09:36:44.265154 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.265131 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 09:36:44.266910 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.266887 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 09:36:44.369660 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.369634 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.369794 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.369669 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.369794 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.369687 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.369794 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.369712 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.369794 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.369752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.369794 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.369774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370049 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.369850 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-web-config\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370049 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.369881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370049 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.369903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370049 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.369924 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370049 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.369968 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370049 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.370040 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370257 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.370061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-config-out\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370257 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.370077 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370257 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.370121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-config\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370257 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.370142 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370257 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.370162 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjcp2\" (UniqueName: \"kubernetes.io/projected/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-kube-api-access-jjcp2\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.370257 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.370188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.471085 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.471017 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.471085 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.471072 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.471298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.471095 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.471298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.471119 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.471298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.471154 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.471298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.471180 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.471298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.471206 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-web-config\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.471298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.471238 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.472242 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.472178 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.472365 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.472259 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.472365 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.472301 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.472365 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.472329 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.472553 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.472372 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.472553 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.472410 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-config-out\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.472553 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.472437 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.472553 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.472473 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-config\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.472553 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.472500 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.472553 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.472532 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjcp2\" (UniqueName: \"kubernetes.io/projected/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-kube-api-access-jjcp2\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.472863 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.472561 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.473262 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.473237 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.473554 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.473526 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.474196 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.474165 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.474982 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.474885 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-web-config\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.476513 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.475616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.476513 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.475941 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.476513 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.476396 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.477409 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.477355 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.477409 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.477380 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.477409 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.477390 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.477661 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.477637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.478395 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.478210 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.478395 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.478342 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.478889 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.478867 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-config-out\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.479747 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.479722 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.480345 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.480323 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-config\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.482673 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.482650 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjcp2\" (UniqueName: \"kubernetes.io/projected/de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7-kube-api-access-jjcp2\") pod \"prometheus-k8s-0\" (UID: \"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.569398 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.569333 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:44.720641 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:44.720610 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 09:36:45.085774 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:36:45.085738 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1fc8f4_c3b0_46f4_bbd0_f79946bb1fd7.slice/crio-94df4e6195146273d60f008e6f65c5dc67a0b89011565cbaef5b2f2c1b608af5 WatchSource:0}: Error finding container 94df4e6195146273d60f008e6f65c5dc67a0b89011565cbaef5b2f2c1b608af5: Status 404 returned error can't find the container with id 94df4e6195146273d60f008e6f65c5dc67a0b89011565cbaef5b2f2c1b608af5 Jun 02 09:36:45.196948 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:45.196907 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7","Type":"ContainerStarted","Data":"94df4e6195146273d60f008e6f65c5dc67a0b89011565cbaef5b2f2c1b608af5"} Jun 02 09:36:45.199123 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:45.199081 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" event={"ID":"ff9fff9d-1e45-44a4-a434-aa2565fb64b9","Type":"ContainerStarted","Data":"7210b744dce5d0b1f7f80d885330918d92ad23735a23b60d0150f66456d67fe1"} Jun 02 09:36:46.204539 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:46.204506 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx" event={"ID":"b19c4146-78b1-4de2-9c7d-856555005051","Type":"ContainerStarted","Data":"76792ed723eb1af9343ae4490bfc979e072710956a3f27dc8feede7376d1bf1b"} Jun 02 09:36:46.206001 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:46.205981 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5866955564-ckzpx" event={"ID":"60cb1d14-b304-4e3f-8005-3b4dec401904","Type":"ContainerStarted","Data":"145f2051904035231fab2af2479fb76b1f0d5a3759e2d9dbe9aa9696aff1ff48"} Jun 02 09:36:47.216175 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:47.216140 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" event={"ID":"ff9fff9d-1e45-44a4-a434-aa2565fb64b9","Type":"ContainerStarted","Data":"d23e09474d61103fa3eb43bb81ef2f27acc87e8735b9af72427e1c38df62f128"} Jun 02 09:36:47.216482 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:47.216185 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" event={"ID":"ff9fff9d-1e45-44a4-a434-aa2565fb64b9","Type":"ContainerStarted","Data":"5227aeb9056cb209509493a5c5d1846bf41c4c054a5f8ae9099b10caee596e0e"} Jun 02 09:36:47.233363 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:47.233301 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5866955564-ckzpx" podStartSLOduration=1.9342914690000002 podStartE2EDuration="5.233282716s" podCreationTimestamp="2026-06-02 09:36:42 +0000 UTC" firstStartedPulling="2026-06-02 09:36:42.779267976 +0000 UTC m=+102.524128630" lastFinishedPulling="2026-06-02 09:36:46.078259216 +0000 UTC m=+105.823119877" observedRunningTime="2026-06-02 09:36:47.232203194 +0000 UTC m=+106.977063862" watchObservedRunningTime="2026-06-02 09:36:47.233282716 +0000 UTC m=+106.978143387" Jun 02 09:36:47.251311 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:47.251259 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx" podStartSLOduration=3.025647115 podStartE2EDuration="5.251239556s" podCreationTimestamp="2026-06-02 09:36:42 +0000 UTC" firstStartedPulling="2026-06-02 09:36:43.852192059 +0000 UTC m=+103.597052705" lastFinishedPulling="2026-06-02 09:36:46.0777845 +0000 UTC m=+105.822645146" observedRunningTime="2026-06-02 09:36:47.250356854 +0000 UTC m=+106.995217520" watchObservedRunningTime="2026-06-02 09:36:47.251239556 +0000 UTC m=+106.996100225" Jun 02 09:36:48.220389 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:48.220356 2567 generic.go:358] "Generic (PLEG): container finished" podID="de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7" containerID="832ac1fd130c16c3b31057c8e518a6ed156562c866fe8ad83d5f0db787569947" exitCode=0 Jun 02 09:36:48.220933 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:48.220440 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7","Type":"ContainerDied","Data":"832ac1fd130c16c3b31057c8e518a6ed156562c866fe8ad83d5f0db787569947"} Jun 02 09:36:48.223298 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:48.223278 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" event={"ID":"ff9fff9d-1e45-44a4-a434-aa2565fb64b9","Type":"ContainerStarted","Data":"3c2689065d06b1a3e5e7d1fe9f97a663ca25ec5bf5bb8b2367b17952e83d3d70"} Jun 02 09:36:48.223518 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:48.223466 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:48.270727 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:48.270682 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" podStartSLOduration=2.105520359 podStartE2EDuration="8.270669687s" podCreationTimestamp="2026-06-02 09:36:40 +0000 UTC" firstStartedPulling="2026-06-02 09:36:40.609975771 +0000 UTC m=+100.354836430" lastFinishedPulling="2026-06-02 09:36:46.77512511 +0000 UTC m=+106.519985758" observedRunningTime="2026-06-02 09:36:48.269417747 +0000 UTC m=+108.014278415" watchObservedRunningTime="2026-06-02 09:36:48.270669687 +0000 UTC m=+108.015530354" Jun 02 09:36:49.232715 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:49.232687 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7bf5bdccd5-kwstv" Jun 02 09:36:52.243232 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:52.243205 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7","Type":"ContainerStarted","Data":"19cf3cefe4caf888030d7c924ece93f9b054c41910764dd16397134f30cd0212"} Jun 02 09:36:52.243524 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:52.243241 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7","Type":"ContainerStarted","Data":"aae708aaf353f31cacaa48ca296dbcb3f93c4ade962c70987401f032ac0861eb"} Jun 02 09:36:53.249128 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:53.249094 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7","Type":"ContainerStarted","Data":"8f60eb56662321393efd9d79aaef03e783873bc8d8c699f610a52c770ac3893f"} Jun 02 09:36:53.249128 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:53.249135 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7","Type":"ContainerStarted","Data":"26591d2a79b6ba4add1a755167274dd1ac03765f1bc3d81c3979d4d295e77465"} Jun 02 09:36:53.249586 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:53.249148 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7","Type":"ContainerStarted","Data":"c3d802f617af22c1f18eb5f3cf1772f3efd5c0fa39b768901ef4fa5494f6117e"} Jun 02 09:36:53.249586 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:53.249162 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7","Type":"ContainerStarted","Data":"d4f43a3c7155cd4801ac7c9e05c352686fb4138e06ec7bfde41f053f3b21e4a3"} Jun 02 09:36:53.276848 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:53.276777 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.459732389 podStartE2EDuration="9.276759436s" podCreationTimestamp="2026-06-02 09:36:44 +0000 UTC" firstStartedPulling="2026-06-02 09:36:45.087693579 +0000 UTC m=+104.832554228" lastFinishedPulling="2026-06-02 09:36:51.904720627 +0000 UTC m=+111.649581275" observedRunningTime="2026-06-02 09:36:53.275008889 +0000 UTC m=+113.019869556" watchObservedRunningTime="2026-06-02 09:36:53.276759436 +0000 UTC m=+113.021620104" Jun 02 09:36:54.569725 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:54.569686 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:36:57.217061 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:57.217025 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx" Jun 02 09:36:57.221500 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:36:57.221479 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dtgjx" Jun 02 09:37:02.641916 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:37:02.641887 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:37:02.641916 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:37:02.641922 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:37:10.995022 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:37:10.994991 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s9fqx_cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4/serve-healthcheck-canary/0.log" Jun 02 09:37:22.653246 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:37:22.653215 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:37:22.660161 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:37:22.660131 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5866955564-ckzpx" Jun 02 09:37:44.570436 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:37:44.570401 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:37:44.589343 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:37:44.589318 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:37:45.418114 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:37:45.418088 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 09:40:00.698476 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:00.698451 2567 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 09:40:37.326101 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.326067 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc"] Jun 02 09:40:37.329238 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.329220 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc" Jun 02 09:40:37.331851 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.331829 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 02 09:40:37.332816 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.332784 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 02 09:40:37.332816 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.332792 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-98krw\"" Jun 02 09:40:37.339162 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.339139 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc"] Jun 02 09:40:37.424762 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.424735 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5frg\" (UniqueName: \"kubernetes.io/projected/b107f4fa-c565-4ce6-998e-91346a667f75-kube-api-access-j5frg\") pod \"jobset-operator-747c5859c7-c5bnc\" (UID: \"b107f4fa-c565-4ce6-998e-91346a667f75\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc" Jun 02 09:40:37.424902 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.424771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b107f4fa-c565-4ce6-998e-91346a667f75-tmp\") pod \"jobset-operator-747c5859c7-c5bnc\" (UID: \"b107f4fa-c565-4ce6-998e-91346a667f75\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc" Jun 02 09:40:37.525767 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.525736 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5frg\" (UniqueName: \"kubernetes.io/projected/b107f4fa-c565-4ce6-998e-91346a667f75-kube-api-access-j5frg\") pod \"jobset-operator-747c5859c7-c5bnc\" (UID: \"b107f4fa-c565-4ce6-998e-91346a667f75\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc" Jun 02 09:40:37.525942 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.525779 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b107f4fa-c565-4ce6-998e-91346a667f75-tmp\") pod \"jobset-operator-747c5859c7-c5bnc\" (UID: \"b107f4fa-c565-4ce6-998e-91346a667f75\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc" Jun 02 09:40:37.526182 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.526160 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b107f4fa-c565-4ce6-998e-91346a667f75-tmp\") pod \"jobset-operator-747c5859c7-c5bnc\" (UID: \"b107f4fa-c565-4ce6-998e-91346a667f75\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc" Jun 02 09:40:37.536108 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.536087 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5frg\" (UniqueName: \"kubernetes.io/projected/b107f4fa-c565-4ce6-998e-91346a667f75-kube-api-access-j5frg\") pod \"jobset-operator-747c5859c7-c5bnc\" (UID: \"b107f4fa-c565-4ce6-998e-91346a667f75\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc" Jun 02 09:40:37.651701 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.651629 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc" Jun 02 09:40:37.778006 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.777978 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc"] Jun 02 09:40:37.780956 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:40:37.780923 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb107f4fa_c565_4ce6_998e_91346a667f75.slice/crio-034ed9e14127c75f0e80d18bb317dd208a37b74cdeb9a278394d843ac55353ef WatchSource:0}: Error finding container 034ed9e14127c75f0e80d18bb317dd208a37b74cdeb9a278394d843ac55353ef: Status 404 returned error can't find the container with id 034ed9e14127c75f0e80d18bb317dd208a37b74cdeb9a278394d843ac55353ef Jun 02 09:40:37.782428 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.782409 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 09:40:37.861597 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:37.861567 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc" event={"ID":"b107f4fa-c565-4ce6-998e-91346a667f75","Type":"ContainerStarted","Data":"034ed9e14127c75f0e80d18bb317dd208a37b74cdeb9a278394d843ac55353ef"} Jun 02 09:40:40.871445 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:40.871403 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc" event={"ID":"b107f4fa-c565-4ce6-998e-91346a667f75","Type":"ContainerStarted","Data":"dd6c8b99dc4ba61a078092746f75245025dd6d5d121a53b016c6ce0228d72c95"} Jun 02 09:40:40.888466 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:40:40.888408 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-747c5859c7-c5bnc" podStartSLOduration=1.296677383 podStartE2EDuration="3.888391511s" podCreationTimestamp="2026-06-02 09:40:37 +0000 UTC" firstStartedPulling="2026-06-02 09:40:37.782529743 +0000 UTC m=+337.527390388" lastFinishedPulling="2026-06-02 09:40:40.374243856 +0000 UTC m=+340.119104516" observedRunningTime="2026-06-02 09:40:40.887375038 +0000 UTC m=+340.632235706" watchObservedRunningTime="2026-06-02 09:40:40.888391511 +0000 UTC m=+340.633252177" Jun 02 09:41:07.047665 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.047448 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8"] Jun 02 09:41:07.051795 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.051763 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:07.054638 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.054613 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 09:41:07.054754 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.054661 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 09:41:07.054754 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.054693 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 02 09:41:07.055739 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.055706 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-77hwv\"" Jun 02 09:41:07.055877 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.055787 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 02 09:41:07.057533 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.057500 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8"] Jun 02 09:41:07.117710 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.117684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/cda6f922-b47a-499a-a7d0-57711d3319de-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-s58b8\" (UID: \"cda6f922-b47a-499a-a7d0-57711d3319de\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:07.117854 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.117716 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wp5s\" (UniqueName: \"kubernetes.io/projected/cda6f922-b47a-499a-a7d0-57711d3319de-kube-api-access-2wp5s\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-s58b8\" (UID: \"cda6f922-b47a-499a-a7d0-57711d3319de\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:07.117854 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.117822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cda6f922-b47a-499a-a7d0-57711d3319de-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-s58b8\" (UID: \"cda6f922-b47a-499a-a7d0-57711d3319de\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:07.218220 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.218188 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/cda6f922-b47a-499a-a7d0-57711d3319de-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-s58b8\" (UID: \"cda6f922-b47a-499a-a7d0-57711d3319de\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:07.218220 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.218222 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wp5s\" (UniqueName: \"kubernetes.io/projected/cda6f922-b47a-499a-a7d0-57711d3319de-kube-api-access-2wp5s\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-s58b8\" (UID: \"cda6f922-b47a-499a-a7d0-57711d3319de\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:07.218394 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.218272 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cda6f922-b47a-499a-a7d0-57711d3319de-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-s58b8\" (UID: \"cda6f922-b47a-499a-a7d0-57711d3319de\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:07.218917 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.218900 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/cda6f922-b47a-499a-a7d0-57711d3319de-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-s58b8\" (UID: \"cda6f922-b47a-499a-a7d0-57711d3319de\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:07.220490 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.220470 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cda6f922-b47a-499a-a7d0-57711d3319de-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-s58b8\" (UID: \"cda6f922-b47a-499a-a7d0-57711d3319de\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:07.226727 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.226705 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wp5s\" (UniqueName: \"kubernetes.io/projected/cda6f922-b47a-499a-a7d0-57711d3319de-kube-api-access-2wp5s\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-s58b8\" (UID: \"cda6f922-b47a-499a-a7d0-57711d3319de\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:07.361584 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.361565 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:07.489357 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.489316 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8"] Jun 02 09:41:07.493986 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:41:07.493920 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcda6f922_b47a_499a_a7d0_57711d3319de.slice/crio-2edac1c78fca6c77c2fbbb64220a94ac1f1a8f0e5977aafef21247e6e274f979 WatchSource:0}: Error finding container 2edac1c78fca6c77c2fbbb64220a94ac1f1a8f0e5977aafef21247e6e274f979: Status 404 returned error can't find the container with id 2edac1c78fca6c77c2fbbb64220a94ac1f1a8f0e5977aafef21247e6e274f979 Jun 02 09:41:07.944860 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:07.944829 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" event={"ID":"cda6f922-b47a-499a-a7d0-57711d3319de","Type":"ContainerStarted","Data":"2edac1c78fca6c77c2fbbb64220a94ac1f1a8f0e5977aafef21247e6e274f979"} Jun 02 09:41:09.952552 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:09.952518 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" event={"ID":"cda6f922-b47a-499a-a7d0-57711d3319de","Type":"ContainerStarted","Data":"f03d9ecb1f1d8ec8d93f5b7c1031e09c329feb53bceb67b5d0fa20b9d1159ce1"} Jun 02 09:41:09.952943 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:09.952568 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:41:09.971836 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:09.971769 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" podStartSLOduration=0.61359919 podStartE2EDuration="2.971753958s" podCreationTimestamp="2026-06-02 09:41:07 +0000 UTC" firstStartedPulling="2026-06-02 09:41:07.496276497 +0000 UTC m=+367.241137146" lastFinishedPulling="2026-06-02 09:41:09.85443126 +0000 UTC m=+369.599291914" observedRunningTime="2026-06-02 09:41:09.970457864 +0000 UTC m=+369.715318531" watchObservedRunningTime="2026-06-02 09:41:09.971753958 +0000 UTC m=+369.716614625" Jun 02 09:41:25.962627 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:41:25.962596 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-s58b8" Jun 02 09:42:58.502385 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:58.502352 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77"] Jun 02 09:42:58.505318 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:58.505301 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" Jun 02 09:42:58.507605 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:58.507580 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-f9s85\"/\"kube-root-ca.crt\"" Jun 02 09:42:58.507727 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:58.507691 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-f9s85\"/\"default-dockercfg-sz5b2\"" Jun 02 09:42:58.508645 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:58.508624 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-f9s85\"/\"openshift-service-ca.crt\"" Jun 02 09:42:58.521770 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:58.521749 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77"] Jun 02 09:42:58.546884 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:58.546858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4xvb\" (UniqueName: \"kubernetes.io/projected/1dc22825-dfbc-464e-abe1-6f57b785521b-kube-api-access-r4xvb\") pod \"test-trainjob-25jd8-node-0-0-k2t77\" (UID: \"1dc22825-dfbc-464e-abe1-6f57b785521b\") " pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" Jun 02 09:42:58.648262 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:58.648227 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4xvb\" (UniqueName: \"kubernetes.io/projected/1dc22825-dfbc-464e-abe1-6f57b785521b-kube-api-access-r4xvb\") pod \"test-trainjob-25jd8-node-0-0-k2t77\" (UID: \"1dc22825-dfbc-464e-abe1-6f57b785521b\") " pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" Jun 02 09:42:58.656900 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:58.656878 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4xvb\" (UniqueName: \"kubernetes.io/projected/1dc22825-dfbc-464e-abe1-6f57b785521b-kube-api-access-r4xvb\") pod \"test-trainjob-25jd8-node-0-0-k2t77\" (UID: \"1dc22825-dfbc-464e-abe1-6f57b785521b\") " pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" Jun 02 09:42:58.813667 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:58.813596 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" Jun 02 09:42:58.946713 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:58.946677 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77"] Jun 02 09:42:58.952038 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:42:58.952010 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dc22825_dfbc_464e_abe1_6f57b785521b.slice/crio-4421be1f32f1a16d8c69f4006fa052dce851e2d6b57d58a3eed9f7eca9fe9143 WatchSource:0}: Error finding container 4421be1f32f1a16d8c69f4006fa052dce851e2d6b57d58a3eed9f7eca9fe9143: Status 404 returned error can't find the container with id 4421be1f32f1a16d8c69f4006fa052dce851e2d6b57d58a3eed9f7eca9fe9143 Jun 02 09:42:59.264393 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:42:59.264349 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" event={"ID":"1dc22825-dfbc-464e-abe1-6f57b785521b","Type":"ContainerStarted","Data":"4421be1f32f1a16d8c69f4006fa052dce851e2d6b57d58a3eed9f7eca9fe9143"} Jun 02 09:44:16.534914 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:16.534876 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" event={"ID":"1dc22825-dfbc-464e-abe1-6f57b785521b","Type":"ContainerStarted","Data":"29085b0c391a48aa3285378840f17614934004acaffb03d3722636596df09b1c"} Jun 02 09:44:16.551936 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:16.551887 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" podStartSLOduration=1.5884079629999999 podStartE2EDuration="1m18.55185244s" podCreationTimestamp="2026-06-02 09:42:58 +0000 UTC" firstStartedPulling="2026-06-02 09:42:58.953790441 +0000 UTC m=+478.698651087" lastFinishedPulling="2026-06-02 09:44:15.917234914 +0000 UTC m=+555.662095564" observedRunningTime="2026-06-02 09:44:16.551835958 +0000 UTC m=+556.296696623" watchObservedRunningTime="2026-06-02 09:44:16.55185244 +0000 UTC m=+556.296713111" Jun 02 09:44:19.354474 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:19.354441 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-f9s85_test-trainjob-25jd8-node-0-0-k2t77_1dc22825-dfbc-464e-abe1-6f57b785521b/node/0.log" Jun 02 09:44:19.545265 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:19.545235 2567 generic.go:358] "Generic (PLEG): container finished" podID="1dc22825-dfbc-464e-abe1-6f57b785521b" containerID="29085b0c391a48aa3285378840f17614934004acaffb03d3722636596df09b1c" exitCode=0 Jun 02 09:44:19.545424 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:19.545308 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" event={"ID":"1dc22825-dfbc-464e-abe1-6f57b785521b","Type":"ContainerDied","Data":"29085b0c391a48aa3285378840f17614934004acaffb03d3722636596df09b1c"} Jun 02 09:44:20.669979 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:20.669956 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" Jun 02 09:44:20.763378 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:20.763350 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4xvb\" (UniqueName: \"kubernetes.io/projected/1dc22825-dfbc-464e-abe1-6f57b785521b-kube-api-access-r4xvb\") pod \"1dc22825-dfbc-464e-abe1-6f57b785521b\" (UID: \"1dc22825-dfbc-464e-abe1-6f57b785521b\") " Jun 02 09:44:20.765483 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:20.765452 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dc22825-dfbc-464e-abe1-6f57b785521b-kube-api-access-r4xvb" (OuterVolumeSpecName: "kube-api-access-r4xvb") pod "1dc22825-dfbc-464e-abe1-6f57b785521b" (UID: "1dc22825-dfbc-464e-abe1-6f57b785521b"). InnerVolumeSpecName "kube-api-access-r4xvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 09:44:20.864855 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:20.864830 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4xvb\" (UniqueName: \"kubernetes.io/projected/1dc22825-dfbc-464e-abe1-6f57b785521b-kube-api-access-r4xvb\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 02 09:44:21.553361 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:21.553330 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" event={"ID":"1dc22825-dfbc-464e-abe1-6f57b785521b","Type":"ContainerDied","Data":"4421be1f32f1a16d8c69f4006fa052dce851e2d6b57d58a3eed9f7eca9fe9143"} Jun 02 09:44:21.553361 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:21.553362 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4421be1f32f1a16d8c69f4006fa052dce851e2d6b57d58a3eed9f7eca9fe9143" Jun 02 09:44:21.553569 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:21.553371 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77" Jun 02 09:44:21.812116 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:21.812039 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-f9s85_test-trainjob-25jd8-node-0-0-k2t77_1dc22825-dfbc-464e-abe1-6f57b785521b/node/0.log" Jun 02 09:44:22.921946 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:22.921916 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wv6vn/must-gather-9svnm"] Jun 02 09:44:22.922306 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:22.922205 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc22825-dfbc-464e-abe1-6f57b785521b" containerName="node" Jun 02 09:44:22.922306 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:22.922215 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc22825-dfbc-464e-abe1-6f57b785521b" containerName="node" Jun 02 09:44:22.922306 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:22.922268 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="1dc22825-dfbc-464e-abe1-6f57b785521b" containerName="node" Jun 02 09:44:22.924228 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:22.924212 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wv6vn/must-gather-9svnm" Jun 02 09:44:22.926914 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:22.926883 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wv6vn\"/\"openshift-service-ca.crt\"" Jun 02 09:44:22.927064 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:22.926924 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wv6vn\"/\"default-dockercfg-rs76z\"" Jun 02 09:44:22.927914 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:22.927901 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wv6vn\"/\"kube-root-ca.crt\"" Jun 02 09:44:22.932484 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:22.932462 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wv6vn/must-gather-9svnm"] Jun 02 09:44:23.083334 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:23.083312 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsf4k\" (UniqueName: \"kubernetes.io/projected/c66bd4ac-7856-48ea-b752-6d5998ea319c-kube-api-access-bsf4k\") pod \"must-gather-9svnm\" (UID: \"c66bd4ac-7856-48ea-b752-6d5998ea319c\") " pod="openshift-must-gather-wv6vn/must-gather-9svnm" Jun 02 09:44:23.083472 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:23.083343 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c66bd4ac-7856-48ea-b752-6d5998ea319c-must-gather-output\") pod \"must-gather-9svnm\" (UID: \"c66bd4ac-7856-48ea-b752-6d5998ea319c\") " pod="openshift-must-gather-wv6vn/must-gather-9svnm" Jun 02 09:44:23.184063 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:23.183997 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c66bd4ac-7856-48ea-b752-6d5998ea319c-must-gather-output\") pod \"must-gather-9svnm\" (UID: \"c66bd4ac-7856-48ea-b752-6d5998ea319c\") " pod="openshift-must-gather-wv6vn/must-gather-9svnm" Jun 02 09:44:23.184171 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:23.184086 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsf4k\" (UniqueName: \"kubernetes.io/projected/c66bd4ac-7856-48ea-b752-6d5998ea319c-kube-api-access-bsf4k\") pod \"must-gather-9svnm\" (UID: \"c66bd4ac-7856-48ea-b752-6d5998ea319c\") " pod="openshift-must-gather-wv6vn/must-gather-9svnm" Jun 02 09:44:23.184305 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:23.184288 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c66bd4ac-7856-48ea-b752-6d5998ea319c-must-gather-output\") pod \"must-gather-9svnm\" (UID: \"c66bd4ac-7856-48ea-b752-6d5998ea319c\") " pod="openshift-must-gather-wv6vn/must-gather-9svnm" Jun 02 09:44:23.192505 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:23.192478 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsf4k\" (UniqueName: \"kubernetes.io/projected/c66bd4ac-7856-48ea-b752-6d5998ea319c-kube-api-access-bsf4k\") pod \"must-gather-9svnm\" (UID: \"c66bd4ac-7856-48ea-b752-6d5998ea319c\") " pod="openshift-must-gather-wv6vn/must-gather-9svnm" Jun 02 09:44:23.234399 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:23.234378 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wv6vn/must-gather-9svnm" Jun 02 09:44:23.354350 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:23.354230 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wv6vn/must-gather-9svnm"] Jun 02 09:44:23.356886 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:44:23.356861 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc66bd4ac_7856_48ea_b752_6d5998ea319c.slice/crio-ac029b15098e4d135acca2dd88d0d29d0ea736f17accf09896931cf56c8f0825 WatchSource:0}: Error finding container ac029b15098e4d135acca2dd88d0d29d0ea736f17accf09896931cf56c8f0825: Status 404 returned error can't find the container with id ac029b15098e4d135acca2dd88d0d29d0ea736f17accf09896931cf56c8f0825 Jun 02 09:44:23.562229 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:23.562155 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wv6vn/must-gather-9svnm" event={"ID":"c66bd4ac-7856-48ea-b752-6d5998ea319c","Type":"ContainerStarted","Data":"ac029b15098e4d135acca2dd88d0d29d0ea736f17accf09896931cf56c8f0825"} Jun 02 09:44:26.846874 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:26.846828 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77"] Jun 02 09:44:26.850642 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:26.850617 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-f9s85/test-trainjob-25jd8-node-0-0-k2t77"] Jun 02 09:44:28.799671 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:28.799641 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dc22825-dfbc-464e-abe1-6f57b785521b" path="/var/lib/kubelet/pods/1dc22825-dfbc-464e-abe1-6f57b785521b/volumes" Jun 02 09:44:30.592636 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:30.592597 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wv6vn/must-gather-9svnm" event={"ID":"c66bd4ac-7856-48ea-b752-6d5998ea319c","Type":"ContainerStarted","Data":"a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf"} Jun 02 09:44:30.592636 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:30.592641 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wv6vn/must-gather-9svnm" event={"ID":"c66bd4ac-7856-48ea-b752-6d5998ea319c","Type":"ContainerStarted","Data":"714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177"} Jun 02 09:44:39.678943 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:39.678903 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-s58b8_cda6f922-b47a-499a-a7d0-57711d3319de/manager/0.log" Jun 02 09:44:40.158447 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:40.158414 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-s58b8_cda6f922-b47a-499a-a7d0-57711d3319de/manager/0.log" Jun 02 09:44:40.738902 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:44:40.738876 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-s58b8_cda6f922-b47a-499a-a7d0-57711d3319de/manager/0.log" Jun 02 09:45:17.758970 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:17.758935 2567 generic.go:358] "Generic (PLEG): container finished" podID="c66bd4ac-7856-48ea-b752-6d5998ea319c" containerID="714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177" exitCode=0 Jun 02 09:45:17.759362 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:17.759006 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wv6vn/must-gather-9svnm" event={"ID":"c66bd4ac-7856-48ea-b752-6d5998ea319c","Type":"ContainerDied","Data":"714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177"} Jun 02 09:45:17.759362 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:17.759334 2567 scope.go:117] "RemoveContainer" containerID="714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177" Jun 02 09:45:18.162169 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:18.162142 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wv6vn_must-gather-9svnm_c66bd4ac-7856-48ea-b752-6d5998ea319c/gather/0.log" Jun 02 09:45:21.455699 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:21.455636 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rs4mt_104b24f8-5b17-44c6-86a0-7ec02f210844/global-pull-secret-syncer/0.log" Jun 02 09:45:21.543970 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:21.543948 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lnqkc_9d05c79d-aea4-4e8d-8cc7-2777d005b485/konnectivity-agent/0.log" Jun 02 09:45:21.567000 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:21.566983 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-85.ec2.internal_04663179e1eba50a8978c5ee623c34af/haproxy/0.log" Jun 02 09:45:23.518771 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.518737 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-wv6vn/must-gather-9svnm"] Jun 02 09:45:23.519232 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.519013 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-wv6vn/must-gather-9svnm" podUID="c66bd4ac-7856-48ea-b752-6d5998ea319c" containerName="copy" containerID="cri-o://a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf" gracePeriod=2 Jun 02 09:45:23.524560 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.524533 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-wv6vn/must-gather-9svnm"] Jun 02 09:45:23.749976 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.749949 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wv6vn_must-gather-9svnm_c66bd4ac-7856-48ea-b752-6d5998ea319c/copy/0.log" Jun 02 09:45:23.750321 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.750299 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wv6vn/must-gather-9svnm" Jun 02 09:45:23.752680 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.752655 2567 status_manager.go:895] "Failed to get status for pod" podUID="c66bd4ac-7856-48ea-b752-6d5998ea319c" pod="openshift-must-gather-wv6vn/must-gather-9svnm" err="pods \"must-gather-9svnm\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wv6vn\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" Jun 02 09:45:23.781058 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.781008 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wv6vn_must-gather-9svnm_c66bd4ac-7856-48ea-b752-6d5998ea319c/copy/0.log" Jun 02 09:45:23.781296 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.781276 2567 generic.go:358] "Generic (PLEG): container finished" podID="c66bd4ac-7856-48ea-b752-6d5998ea319c" containerID="a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf" exitCode=143 Jun 02 09:45:23.781368 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.781314 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wv6vn/must-gather-9svnm" Jun 02 09:45:23.781412 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.781381 2567 scope.go:117] "RemoveContainer" containerID="a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf" Jun 02 09:45:23.783853 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.783798 2567 status_manager.go:895] "Failed to get status for pod" podUID="c66bd4ac-7856-48ea-b752-6d5998ea319c" pod="openshift-must-gather-wv6vn/must-gather-9svnm" err="pods \"must-gather-9svnm\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wv6vn\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" Jun 02 09:45:23.788264 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.788249 2567 scope.go:117] "RemoveContainer" containerID="714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177" Jun 02 09:45:23.799654 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.799638 2567 scope.go:117] "RemoveContainer" containerID="a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf" Jun 02 09:45:23.799880 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:45:23.799863 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf\": container with ID starting with a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf not found: ID does not exist" containerID="a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf" Jun 02 09:45:23.799941 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.799888 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf"} err="failed to get container status \"a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf\": rpc error: code = NotFound desc = could not find container \"a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf\": container with ID starting with a56b609c7a15190ebb1a69843d718f6e745ecccf13c43c9908051551242576bf not found: ID does not exist" Jun 02 09:45:23.799941 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.799906 2567 scope.go:117] "RemoveContainer" containerID="714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177" Jun 02 09:45:23.800138 ip-10-0-130-85 kubenswrapper[2567]: E0602 09:45:23.800121 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177\": container with ID starting with 714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177 not found: ID does not exist" containerID="714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177" Jun 02 09:45:23.800182 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.800142 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177"} err="failed to get container status \"714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177\": rpc error: code = NotFound desc = could not find container \"714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177\": container with ID starting with 714cae21005077d14c51675a8c011fcef836e32a108a3e311704fe4db28f6177 not found: ID does not exist" Jun 02 09:45:23.818636 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.818618 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsf4k\" (UniqueName: \"kubernetes.io/projected/c66bd4ac-7856-48ea-b752-6d5998ea319c-kube-api-access-bsf4k\") pod \"c66bd4ac-7856-48ea-b752-6d5998ea319c\" (UID: \"c66bd4ac-7856-48ea-b752-6d5998ea319c\") " Jun 02 09:45:23.818699 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.818664 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c66bd4ac-7856-48ea-b752-6d5998ea319c-must-gather-output\") pod \"c66bd4ac-7856-48ea-b752-6d5998ea319c\" (UID: \"c66bd4ac-7856-48ea-b752-6d5998ea319c\") " Jun 02 09:45:23.820587 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.820562 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c66bd4ac-7856-48ea-b752-6d5998ea319c-kube-api-access-bsf4k" (OuterVolumeSpecName: "kube-api-access-bsf4k") pod "c66bd4ac-7856-48ea-b752-6d5998ea319c" (UID: "c66bd4ac-7856-48ea-b752-6d5998ea319c"). InnerVolumeSpecName "kube-api-access-bsf4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 09:45:23.820790 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.820769 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c66bd4ac-7856-48ea-b752-6d5998ea319c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "c66bd4ac-7856-48ea-b752-6d5998ea319c" (UID: "c66bd4ac-7856-48ea-b752-6d5998ea319c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 09:45:23.919318 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.919296 2567 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c66bd4ac-7856-48ea-b752-6d5998ea319c-must-gather-output\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 02 09:45:23.919318 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:23.919316 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsf4k\" (UniqueName: \"kubernetes.io/projected/c66bd4ac-7856-48ea-b752-6d5998ea319c-kube-api-access-bsf4k\") on node \"ip-10-0-130-85.ec2.internal\" DevicePath \"\"" Jun 02 09:45:24.091868 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:24.091842 2567 status_manager.go:895] "Failed to get status for pod" podUID="c66bd4ac-7856-48ea-b752-6d5998ea319c" pod="openshift-must-gather-wv6vn/must-gather-9svnm" err="pods \"must-gather-9svnm\" is forbidden: User \"system:node:ip-10-0-130-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wv6vn\": no relationship found between node 'ip-10-0-130-85.ec2.internal' and this object" Jun 02 09:45:24.799582 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:24.799548 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c66bd4ac-7856-48ea-b752-6d5998ea319c" path="/var/lib/kubelet/pods/c66bd4ac-7856-48ea-b752-6d5998ea319c/volumes" Jun 02 09:45:24.971107 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:24.971015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-kv57v_90ccec21-385a-4b05-926e-1ccb4ec74f6b/kube-state-metrics/0.log" Jun 02 09:45:24.993794 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:24.993744 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-kv57v_90ccec21-385a-4b05-926e-1ccb4ec74f6b/kube-rbac-proxy-main/0.log" Jun 02 09:45:25.016889 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.016827 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-kv57v_90ccec21-385a-4b05-926e-1ccb4ec74f6b/kube-rbac-proxy-self/0.log" Jun 02 09:45:25.047157 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.047117 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5866955564-ckzpx_60cb1d14-b304-4e3f-8005-3b4dec401904/metrics-server/0.log" Jun 02 09:45:25.074966 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.074940 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-dtgjx_b19c4146-78b1-4de2-9c7d-856555005051/monitoring-plugin/0.log" Jun 02 09:45:25.107453 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.107417 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2gxtz_406f662d-09ff-4b07-bd78-a56a1673c64d/node-exporter/0.log" Jun 02 09:45:25.132413 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.132385 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2gxtz_406f662d-09ff-4b07-bd78-a56a1673c64d/kube-rbac-proxy/0.log" Jun 02 09:45:25.154234 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.154216 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2gxtz_406f662d-09ff-4b07-bd78-a56a1673c64d/init-textfile/0.log" Jun 02 09:45:25.345022 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.344997 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-j6zrq_5a7b884c-5d2a-4d15-8975-fc6ae59a6424/kube-rbac-proxy-main/0.log" Jun 02 09:45:25.372784 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.372759 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-j6zrq_5a7b884c-5d2a-4d15-8975-fc6ae59a6424/kube-rbac-proxy-self/0.log" Jun 02 09:45:25.396985 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.396966 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-j6zrq_5a7b884c-5d2a-4d15-8975-fc6ae59a6424/openshift-state-metrics/0.log" Jun 02 09:45:25.434567 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.434546 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7/prometheus/0.log" Jun 02 09:45:25.455940 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.455921 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7/config-reloader/0.log" Jun 02 09:45:25.480332 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.480319 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7/thanos-sidecar/0.log" Jun 02 09:45:25.506549 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.506533 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7/kube-rbac-proxy-web/0.log" Jun 02 09:45:25.541153 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.541131 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7/kube-rbac-proxy/0.log" Jun 02 09:45:25.576471 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.576453 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7/kube-rbac-proxy-thanos/0.log" Jun 02 09:45:25.601704 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.601650 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de1fc8f4-c3b0-46f4-bbd0-f79946bb1fd7/init-config-reloader/0.log" Jun 02 09:45:25.831632 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.831604 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bf5bdccd5-kwstv_ff9fff9d-1e45-44a4-a434-aa2565fb64b9/thanos-query/0.log" Jun 02 09:45:25.858730 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.858677 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bf5bdccd5-kwstv_ff9fff9d-1e45-44a4-a434-aa2565fb64b9/kube-rbac-proxy-web/0.log" Jun 02 09:45:25.890434 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.890418 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bf5bdccd5-kwstv_ff9fff9d-1e45-44a4-a434-aa2565fb64b9/kube-rbac-proxy/0.log" Jun 02 09:45:25.920075 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.920053 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bf5bdccd5-kwstv_ff9fff9d-1e45-44a4-a434-aa2565fb64b9/prom-label-proxy/0.log" Jun 02 09:45:25.945314 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.945300 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bf5bdccd5-kwstv_ff9fff9d-1e45-44a4-a434-aa2565fb64b9/kube-rbac-proxy-rules/0.log" Jun 02 09:45:25.972509 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:25.972492 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bf5bdccd5-kwstv_ff9fff9d-1e45-44a4-a434-aa2565fb64b9/kube-rbac-proxy-metrics/0.log" Jun 02 09:45:26.978206 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:26.978177 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-q2x5j_f48cf9a2-5165-4713-a497-3d36d7abce05/networking-console-plugin/0.log" Jun 02 09:45:27.761198 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.761170 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-jqwfj_d1717961-7f3e-4494-a96f-9e90d6b1a523/download-server/0.log" Jun 02 09:45:27.909007 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.908974 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x"] Jun 02 09:45:27.909266 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.909254 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c66bd4ac-7856-48ea-b752-6d5998ea319c" containerName="gather" Jun 02 09:45:27.909302 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.909268 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c66bd4ac-7856-48ea-b752-6d5998ea319c" containerName="gather" Jun 02 09:45:27.909302 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.909282 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c66bd4ac-7856-48ea-b752-6d5998ea319c" containerName="copy" Jun 02 09:45:27.909302 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.909288 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c66bd4ac-7856-48ea-b752-6d5998ea319c" containerName="copy" Jun 02 09:45:27.909398 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.909341 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="c66bd4ac-7856-48ea-b752-6d5998ea319c" containerName="copy" Jun 02 09:45:27.909398 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.909351 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="c66bd4ac-7856-48ea-b752-6d5998ea319c" containerName="gather" Jun 02 09:45:27.913075 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.913052 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:27.916392 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.916374 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lnfw4\"/\"openshift-service-ca.crt\"" Jun 02 09:45:27.916491 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.916380 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lnfw4\"/\"kube-root-ca.crt\"" Jun 02 09:45:27.917004 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.916982 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lnfw4\"/\"default-dockercfg-5nvcw\"" Jun 02 09:45:27.920967 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.920948 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x"] Jun 02 09:45:27.951547 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.951517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-lib-modules\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:27.951547 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.951549 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-proc\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:27.951728 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.951593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-sys\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:27.951728 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.951622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcmng\" (UniqueName: \"kubernetes.io/projected/2144d7d2-e861-4524-81f4-78c88ad02e0e-kube-api-access-bcmng\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:27.951728 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:27.951653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-podres\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.052481 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.052401 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-podres\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.052836 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.052477 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-lib-modules\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.052836 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.052506 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-proc\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.052836 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.052541 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-sys\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.052836 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.052560 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcmng\" (UniqueName: \"kubernetes.io/projected/2144d7d2-e861-4524-81f4-78c88ad02e0e-kube-api-access-bcmng\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.052836 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.052568 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-podres\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.052836 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.052575 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-lib-modules\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.052836 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.052628 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-sys\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.052836 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.052637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2144d7d2-e861-4524-81f4-78c88ad02e0e-proc\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.062171 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.062142 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcmng\" (UniqueName: \"kubernetes.io/projected/2144d7d2-e861-4524-81f4-78c88ad02e0e-kube-api-access-bcmng\") pod \"perf-node-gather-daemonset-8ft4x\" (UID: \"2144d7d2-e861-4524-81f4-78c88ad02e0e\") " pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.223652 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.223617 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.345998 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.345968 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x"] Jun 02 09:45:28.349110 ip-10-0-130-85 kubenswrapper[2567]: W0602 09:45:28.349083 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2144d7d2_e861_4524_81f4_78c88ad02e0e.slice/crio-06463b65b05e003163196af251e3546d434ef69afa1f64e43de393d554a0a28d WatchSource:0}: Error finding container 06463b65b05e003163196af251e3546d434ef69afa1f64e43de393d554a0a28d: Status 404 returned error can't find the container with id 06463b65b05e003163196af251e3546d434ef69afa1f64e43de393d554a0a28d Jun 02 09:45:28.785017 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.784943 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fq9nd_67dc512d-8837-47bf-b672-5b2381fd8ae8/dns/0.log" Jun 02 09:45:28.799739 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.799716 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:28.799877 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.799743 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" event={"ID":"2144d7d2-e861-4524-81f4-78c88ad02e0e","Type":"ContainerStarted","Data":"9b7203443a2e9e7b8130f325b12f19ebd3e1687b8def7c72e86bc07b88190f93"} Jun 02 09:45:28.799877 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.799756 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" event={"ID":"2144d7d2-e861-4524-81f4-78c88ad02e0e","Type":"ContainerStarted","Data":"06463b65b05e003163196af251e3546d434ef69afa1f64e43de393d554a0a28d"} Jun 02 09:45:28.808822 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.808791 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fq9nd_67dc512d-8837-47bf-b672-5b2381fd8ae8/kube-rbac-proxy/0.log" Jun 02 09:45:28.818639 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.818605 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" podStartSLOduration=1.8185939150000001 podStartE2EDuration="1.818593915s" podCreationTimestamp="2026-06-02 09:45:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 09:45:28.817271786 +0000 UTC m=+628.562132466" watchObservedRunningTime="2026-06-02 09:45:28.818593915 +0000 UTC m=+628.563454624" Jun 02 09:45:28.963027 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:28.963003 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-krgvk_4a160069-8e96-4a19-91b3-d7d03e43ddce/dns-node-resolver/0.log" Jun 02 09:45:29.381759 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:29.381732 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-fbc9df996-684js_1d82fcf3-33b9-4931-855f-8434cb2dacd5/registry/0.log" Jun 02 09:45:29.425393 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:29.425367 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bnrb7_9b18a0c7-3fde-496c-b705-add77782201a/node-ca/0.log" Jun 02 09:45:30.504972 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:30.504920 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s9fqx_cdcc254d-03b3-48ae-8fcc-d9e3ea1d34d4/serve-healthcheck-canary/0.log" Jun 02 09:45:30.931988 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:30.931958 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wwvgb_8dea1b51-eb5e-49f6-844b-04a6829c0d9c/kube-rbac-proxy/0.log" Jun 02 09:45:30.952872 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:30.952849 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wwvgb_8dea1b51-eb5e-49f6-844b-04a6829c0d9c/exporter/0.log" Jun 02 09:45:30.973712 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:30.973693 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wwvgb_8dea1b51-eb5e-49f6-844b-04a6829c0d9c/extractor/0.log" Jun 02 09:45:32.678926 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:32.678899 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-747c5859c7-c5bnc_b107f4fa-c565-4ce6-998e-91346a667f75/jobset-operator/0.log" Jun 02 09:45:34.811183 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:34.811157 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lnfw4/perf-node-gather-daemonset-8ft4x" Jun 02 09:45:37.380073 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:37.380048 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-47cqt_fe668441-597d-403b-b87f-2a247ff1743f/kube-multus/0.log" Jun 02 09:45:37.406996 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:37.406973 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p8wt_2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c/kube-multus-additional-cni-plugins/0.log" Jun 02 09:45:37.427570 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:37.427551 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p8wt_2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c/egress-router-binary-copy/0.log" Jun 02 09:45:37.449395 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:37.449375 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p8wt_2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c/cni-plugins/0.log" Jun 02 09:45:37.471520 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:37.471505 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p8wt_2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c/bond-cni-plugin/0.log" Jun 02 09:45:37.494581 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:37.494560 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p8wt_2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c/routeoverride-cni/0.log" Jun 02 09:45:37.516575 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:37.516560 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p8wt_2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c/whereabouts-cni-bincopy/0.log" Jun 02 09:45:37.537618 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:37.537597 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p8wt_2ecba2ce-0fae-4a93-a7c9-2fe33e5bc79c/whereabouts-cni/0.log" Jun 02 09:45:38.008222 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:38.008189 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qcqzq_17dcae50-58fd-49b1-8afa-88e5b3eca13b/network-metrics-daemon/0.log" Jun 02 09:45:38.028611 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:38.028588 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qcqzq_17dcae50-58fd-49b1-8afa-88e5b3eca13b/kube-rbac-proxy/0.log" Jun 02 09:45:39.185087 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:39.185060 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzhrr_a7166909-a47b-48ac-b6d2-edf79e57794f/ovn-controller/0.log" Jun 02 09:45:39.206694 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:39.206660 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzhrr_a7166909-a47b-48ac-b6d2-edf79e57794f/ovn-acl-logging/0.log" Jun 02 09:45:39.225723 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:39.225682 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzhrr_a7166909-a47b-48ac-b6d2-edf79e57794f/kube-rbac-proxy-node/0.log" Jun 02 09:45:39.247370 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:39.247353 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzhrr_a7166909-a47b-48ac-b6d2-edf79e57794f/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 09:45:39.270517 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:39.270462 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzhrr_a7166909-a47b-48ac-b6d2-edf79e57794f/northd/0.log" Jun 02 09:45:39.292970 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:39.292951 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzhrr_a7166909-a47b-48ac-b6d2-edf79e57794f/nbdb/0.log" Jun 02 09:45:39.315892 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:39.315874 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzhrr_a7166909-a47b-48ac-b6d2-edf79e57794f/sbdb/0.log" Jun 02 09:45:39.401620 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:39.401598 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kzhrr_a7166909-a47b-48ac-b6d2-edf79e57794f/ovnkube-controller/0.log" Jun 02 09:45:40.606861 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:40.606836 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hzrnz_09aaecf3-0414-4dde-8c6b-1f2bac4e7428/network-check-target-container/0.log" Jun 02 09:45:41.610150 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:41.610123 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-bqlsv_c107eb09-ff9f-443d-b736-00e14196e10a/iptables-alerter/0.log" Jun 02 09:45:42.274267 ip-10-0-130-85 kubenswrapper[2567]: I0602 09:45:42.274238 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8lq28_a2a72eb3-f28c-4737-afdc-9ebe86a28502/tuned/0.log"