Jun 03 16:16:12.426471 ip-10-0-129-211 systemd[1]: Starting Kubernetes Kubelet... Jun 03 16:16:12.938161 ip-10-0-129-211 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:16:12.938161 ip-10-0-129-211 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 16:16:12.938161 ip-10-0-129-211 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:16:12.938161 ip-10-0-129-211 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 16:16:12.938161 ip-10-0-129-211 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:16:12.941937 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.941844 2569 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 16:16:12.947229 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947210 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:16:12.947229 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947228 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:16:12.947229 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947232 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947235 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947239 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947242 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947244 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947247 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947250 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947252 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947255 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947258 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947260 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947263 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947266 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947268 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947272 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947275 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947278 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947281 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947284 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947287 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:16:12.947323 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947290 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947293 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947295 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947298 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947300 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947303 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947305 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947308 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947311 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947313 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947316 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947318 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947321 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947324 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947327 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947330 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947333 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947336 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947339 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947341 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:16:12.947826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947344 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947346 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947349 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947351 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947354 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947357 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947360 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947362 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947365 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947368 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947371 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947373 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947375 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947378 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947381 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947384 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947387 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947390 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947392 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947395 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:16:12.948347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947398 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947400 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947403 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947406 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947408 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947411 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947414 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947416 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947419 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947421 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947423 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947426 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947428 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947431 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947433 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947436 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947440 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947445 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947449 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:16:12.948828 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947453 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947457 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947460 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947462 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947465 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947893 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947900 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947905 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947909 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947912 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947915 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947918 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947921 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947924 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947927 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947929 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947932 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947935 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947938 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:16:12.949315 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947941 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947943 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947946 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947948 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947951 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947954 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947956 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947959 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947961 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947964 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947966 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947969 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947971 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947974 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947976 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947979 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947981 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947984 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947987 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:16:12.949812 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947989 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947992 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947995 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.947997 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948000 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948002 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948005 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948007 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948010 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948012 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948015 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948018 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948021 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948023 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948026 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948028 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948031 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948033 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948036 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948038 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:16:12.950337 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948041 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948043 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948046 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948049 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948051 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948054 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948057 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948060 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948062 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948065 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948067 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948070 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948072 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948075 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948078 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948080 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948083 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948085 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948088 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948108 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:16:12.950833 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948112 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948115 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948119 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948122 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948125 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948128 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948131 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948134 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948136 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948139 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948142 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948145 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.948147 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949004 2569 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949014 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949020 2569 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949025 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949029 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949033 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949037 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949042 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 16:16:12.951347 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949045 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949048 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949051 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949055 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949058 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949061 2569 flags.go:64] FLAG: --cgroup-root="" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949064 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949067 2569 flags.go:64] FLAG: --client-ca-file="" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949070 2569 flags.go:64] FLAG: --cloud-config="" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949073 2569 flags.go:64] FLAG: --cloud-provider="external" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949076 2569 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949081 2569 flags.go:64] FLAG: --cluster-domain="" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949084 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949088 2569 flags.go:64] FLAG: --config-dir="" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949105 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949109 2569 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949113 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949116 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949120 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949124 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949127 2569 flags.go:64] FLAG: --contention-profiling="false" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949130 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949133 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949136 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949140 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 16:16:12.951858 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949144 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949147 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949149 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949152 2569 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949155 2569 flags.go:64] FLAG: --enable-server="true" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949158 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949163 2569 flags.go:64] FLAG: --event-burst="100" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949166 2569 flags.go:64] FLAG: --event-qps="50" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949170 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949173 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949176 2569 flags.go:64] FLAG: --eviction-hard="" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949180 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949183 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949186 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949189 2569 flags.go:64] FLAG: --eviction-soft="" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949192 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949195 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949198 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949201 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949204 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949207 2569 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949210 2569 flags.go:64] FLAG: --feature-gates="" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949214 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949217 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949221 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 16:16:12.952485 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949224 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949228 2569 flags.go:64] FLAG: --healthz-port="10248" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949231 2569 flags.go:64] FLAG: --help="false" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949234 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-129-211.ec2.internal" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949238 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949241 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949244 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949247 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949251 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949253 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949256 2569 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949259 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949262 2569 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949265 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949268 2569 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949271 2569 flags.go:64] FLAG: --kube-reserved="" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949274 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949277 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949280 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949283 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949286 2569 flags.go:64] FLAG: --lock-file="" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949289 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949292 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949295 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 16:16:12.953085 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949300 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949303 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949307 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949310 2569 flags.go:64] FLAG: --logging-format="text" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949313 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949316 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949319 2569 flags.go:64] FLAG: --manifest-url="" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949322 2569 flags.go:64] FLAG: --manifest-url-header="" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949328 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949331 2569 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949336 2569 flags.go:64] FLAG: --max-pods="110" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949339 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949343 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949346 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949349 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949351 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949354 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949357 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949365 2569 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949368 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949371 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949374 2569 flags.go:64] FLAG: --pod-cidr="" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949376 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949383 2569 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 16:16:12.953677 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949386 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949389 2569 flags.go:64] FLAG: --pods-per-core="0" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949392 2569 flags.go:64] FLAG: --port="10250" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949395 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949398 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05e87864082fa0cbb" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949401 2569 flags.go:64] FLAG: --qos-reserved="" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949404 2569 flags.go:64] FLAG: --read-only-port="10255" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949407 2569 flags.go:64] FLAG: --register-node="true" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949410 2569 flags.go:64] FLAG: --register-schedulable="true" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949413 2569 flags.go:64] FLAG: --register-with-taints="" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949417 2569 flags.go:64] FLAG: --registry-burst="10" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949420 2569 flags.go:64] FLAG: --registry-qps="5" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949423 2569 flags.go:64] FLAG: --reserved-cpus="" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949425 2569 flags.go:64] FLAG: --reserved-memory="" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949429 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949432 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949435 2569 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949438 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949441 2569 flags.go:64] FLAG: --runonce="false" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949445 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949448 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949451 2569 flags.go:64] FLAG: --seccomp-default="false" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949454 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949457 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949460 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949463 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 16:16:12.954275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949466 2569 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949469 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949472 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949475 2569 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949478 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949481 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949483 2569 flags.go:64] FLAG: --system-cgroups="" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949486 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949492 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949495 2569 flags.go:64] FLAG: --tls-cert-file="" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949498 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949502 2569 flags.go:64] FLAG: --tls-min-version="" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949505 2569 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949507 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949510 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949513 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949516 2569 flags.go:64] FLAG: --v="2" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949520 2569 flags.go:64] FLAG: --version="false" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949524 2569 flags.go:64] FLAG: --vmodule="" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949529 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.949532 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949626 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949630 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949633 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:16:12.954902 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949636 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949639 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949643 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949645 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949648 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949650 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949653 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949656 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949658 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949661 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949663 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949666 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949668 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949671 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949674 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949676 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949679 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949682 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949684 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949686 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:16:12.955483 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949689 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949692 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949694 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949697 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949700 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949702 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949705 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949707 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949710 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949712 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949715 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949717 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949720 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949722 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949725 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949728 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949730 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949733 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949735 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:16:12.956026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949738 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949740 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949743 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949745 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949748 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949750 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949753 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949755 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949758 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949761 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949764 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949767 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949770 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949772 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949775 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949777 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949779 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949782 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949784 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949787 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:16:12.956574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949789 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949792 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949794 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949797 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949799 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949802 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949806 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949809 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949813 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949817 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949820 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949823 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949825 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949828 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949830 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949833 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949835 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949838 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949840 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949842 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:16:12.957089 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949845 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:16:12.957904 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949847 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:16:12.957904 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949850 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:16:12.957904 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.949852 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:16:12.957904 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.950447 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:16:12.959841 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.959816 2569 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 16:16:12.959841 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.959840 2569 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959895 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959901 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959905 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959908 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959911 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959914 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959917 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959920 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959923 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959926 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959928 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959931 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959934 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959937 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959940 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959943 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959945 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959948 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959951 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959953 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:16:12.959956 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959956 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959959 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959962 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959965 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959968 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959971 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959973 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959976 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959979 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959982 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959985 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959988 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959991 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959993 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959996 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.959999 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960001 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960004 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960006 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960009 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:16:12.960494 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960012 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960014 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960016 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960019 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960022 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960026 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960030 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960033 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960036 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960038 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960041 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960043 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960046 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960050 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960055 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960059 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960062 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960065 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960068 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:16:12.961026 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960071 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960074 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960076 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960079 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960082 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960085 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960087 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960105 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960109 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960112 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960114 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960117 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960120 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960122 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960125 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960128 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960130 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960136 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960139 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960142 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:16:12.961505 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960145 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960148 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960151 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960153 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960156 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960159 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960161 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.960168 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960269 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960274 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960277 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960280 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960283 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960286 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960290 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:16:12.962004 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960292 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960295 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960298 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960301 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960304 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960306 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960309 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960312 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960314 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960317 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960319 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960322 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960324 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960327 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960329 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960332 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960335 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960338 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960341 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960344 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:16:12.962447 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960346 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960349 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960351 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960354 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960357 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960360 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960363 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960366 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960368 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960371 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960374 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960376 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960379 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960381 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960384 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960387 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960390 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960392 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960394 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960397 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:16:12.962928 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960400 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960402 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960405 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960408 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960411 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960414 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960417 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960419 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960422 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960425 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960427 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960430 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960432 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960435 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960437 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960440 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960443 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960446 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960448 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:16:12.963484 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960452 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960456 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960459 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960461 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960464 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960467 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960469 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960472 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960475 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960477 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960480 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960482 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960485 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960488 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960490 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960493 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960495 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960498 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960501 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:16:12.963949 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:12.960503 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:16:12.964537 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.960509 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:16:12.964537 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.961354 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 16:16:12.965617 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.965602 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 16:16:12.966659 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.966647 2569 server.go:1019] "Starting client certificate rotation" Jun 03 16:16:12.966772 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.966754 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 16:16:12.966807 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.966798 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 16:16:12.998221 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:12.998198 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 16:16:13.001878 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.001854 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 16:16:13.019812 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.019789 2569 log.go:25] "Validated CRI v1 runtime API" Jun 03 16:16:13.026632 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.026613 2569 log.go:25] "Validated CRI v1 image API" Jun 03 16:16:13.027968 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.027953 2569 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 16:16:13.032520 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.032495 2569 fs.go:135] Filesystem UUIDs: map[2544a246-2e6a-46bd-b0bc-278db8c06add:/dev/nvme0n1p3 78afb832-0894-4afc-929f-d97be9f09add:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 03 16:16:13.032593 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.032519 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 16:16:13.038526 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.038404 2569 manager.go:217] Machine: {Timestamp:2026-06-03 16:16:13.037856482 +0000 UTC m=+0.479376888 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100287 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26aa6e4b27e17cd6ff39a72c1f3152 SystemUUID:ec26aa6e-4b27-e17c-d6ff-39a72c1f3152 BootID:a942cc94-c1a3-4b45-a8b6-0d084488ad53 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:96:0e:7d:6f:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:96:0e:7d:6f:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:31:ec:36:9c:f6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 16:16:13.038526 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.038518 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 16:16:13.038653 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.038598 2569 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 16:16:13.039797 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.039771 2569 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 16:16:13.039935 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.039799 2569 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-211.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 16:16:13.039980 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.039944 2569 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 16:16:13.039980 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.039952 2569 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 16:16:13.039980 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.039959 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 16:16:13.040869 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.040858 2569 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 16:16:13.042559 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.042548 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 03 16:16:13.042663 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.042654 2569 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 16:16:13.045415 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.045404 2569 kubelet.go:491] "Attempting to sync node with API server" Jun 03 16:16:13.045460 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.045419 2569 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 16:16:13.045460 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.045431 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 16:16:13.045460 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.045440 2569 kubelet.go:397] "Adding apiserver pod source" Jun 03 16:16:13.045460 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.045449 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 16:16:13.046864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.046852 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 16:16:13.046909 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.046871 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 16:16:13.048649 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.048629 2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 16:16:13.050385 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.050366 2569 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 16:16:13.052464 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.052450 2569 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 16:16:13.054472 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054459 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 16:16:13.054528 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054477 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 16:16:13.054528 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054484 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 16:16:13.054528 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054489 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 16:16:13.054528 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054498 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 16:16:13.054528 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054504 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 16:16:13.054528 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054510 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 16:16:13.054528 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054515 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 16:16:13.054528 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054522 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 16:16:13.054528 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054528 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 16:16:13.054793 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054536 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 16:16:13.054793 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.054542 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 16:16:13.055360 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.055349 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 16:16:13.055360 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.055359 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 16:16:13.056060 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.056036 2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 16:16:13.056131 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.056047 2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 16:16:13.058566 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.058552 2569 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 16:16:13.058648 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.058588 2569 server.go:1295] "Started kubelet" Jun 03 16:16:13.059365 ip-10-0-129-211 systemd[1]: Started Kubernetes Kubelet. Jun 03 16:16:13.059475 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.059386 2569 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 16:16:13.059475 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.059440 2569 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 16:16:13.059938 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.059777 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 16:16:13.060614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.060600 2569 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 16:16:13.062633 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.062619 2569 server.go:317] "Adding debug handlers to kubelet server" Jun 03 16:16:13.066048 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.066028 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 16:16:13.066470 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.066452 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 16:16:13.066688 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.066669 2569 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 16:16:13.066688 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.066688 2569 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 16:16:13.066833 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.066821 2569 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 16:16:13.066885 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.066872 2569 reconstruct.go:97] "Volume reconstruction finished" Jun 03 16:16:13.066924 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.066886 2569 reconciler.go:26] "Reconciler: start to sync state" Jun 03 16:16:13.067331 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.067307 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:13.067803 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.067787 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 16:16:13.067803 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.067804 2569 factory.go:55] Registering systemd factory Jun 03 16:16:13.067961 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.067814 2569 factory.go:223] Registration of the systemd container factory successfully Jun 03 16:16:13.068036 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.068023 2569 factory.go:153] Registering CRI-O factory Jun 03 16:16:13.068084 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.068039 2569 factory.go:223] Registration of the crio container factory successfully Jun 03 16:16:13.068084 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.068064 2569 factory.go:103] Registering Raw factory Jun 03 16:16:13.068084 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.068078 2569 manager.go:1196] Started watching for new ooms in manager Jun 03 16:16:13.068284 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.068262 2569 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 16:16:13.068511 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.068495 2569 manager.go:319] Starting recovery of all containers Jun 03 16:16:13.068699 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.068684 2569 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-211.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 16:16:13.069945 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.068815 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-211.ec2.internal.18b59e62608a63ea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-211.ec2.internal,UID:ip-10-0-129-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-211.ec2.internal,},FirstTimestamp:2026-06-03 16:16:13.058565098 +0000 UTC m=+0.500085505,LastTimestamp:2026-06-03 16:16:13.058565098 +0000 UTC m=+0.500085505,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-211.ec2.internal,}" Jun 03 16:16:13.075380 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.075174 2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 16:16:13.078000 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.077974 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 16:16:13.078000 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.077990 2569 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 16:16:13.079278 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.079251 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p648n" Jun 03 16:16:13.081516 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.081384 2569 manager.go:324] Recovery completed Jun 03 16:16:13.085519 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.085506 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:16:13.087701 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.087687 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:16:13.087787 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.087713 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:16:13.087787 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.087724 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:16:13.088232 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.088216 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 16:16:13.088232 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.088231 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 16:16:13.088311 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.088247 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 03 16:16:13.090529 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.090517 2569 policy_none.go:49] "None policy: Start" Jun 03 16:16:13.090582 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.090533 2569 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 16:16:13.090582 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.090544 2569 state_mem.go:35] "Initializing new in-memory state store" Jun 03 16:16:13.092531 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.092451 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-211.ec2.internal.18b59e626246f709 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-211.ec2.internal,UID:ip-10-0-129-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-211.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-211.ec2.internal,},FirstTimestamp:2026-06-03 16:16:13.087700745 +0000 UTC m=+0.529221150,LastTimestamp:2026-06-03 16:16:13.087700745 +0000 UTC m=+0.529221150,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-211.ec2.internal,}" Jun 03 16:16:13.092639 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.092623 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p648n" Jun 03 16:16:13.129736 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.129721 2569 manager.go:341] "Starting Device Plugin manager" Jun 03 16:16:13.145402 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.129752 2569 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 16:16:13.145402 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.129762 2569 server.go:85] "Starting device plugin registration server" Jun 03 16:16:13.145402 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.129989 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 16:16:13.145402 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.129998 2569 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 16:16:13.145402 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.130116 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 16:16:13.145402 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.130198 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 16:16:13.145402 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.130207 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 16:16:13.145402 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.130904 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 16:16:13.145402 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.130945 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:13.205618 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.205549 2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 16:16:13.205618 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.205585 2569 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 16:16:13.205618 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.205604 2569 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 16:16:13.205618 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.205610 2569 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 16:16:13.205911 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.205645 2569 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 16:16:13.208121 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.208086 2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:16:13.230135 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.230113 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:16:13.231145 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.231130 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:16:13.231202 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.231163 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:16:13.231202 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.231175 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:16:13.231202 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.231199 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.242186 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.242166 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.242238 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.242188 2569 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-211.ec2.internal\": node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:13.253328 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.253302 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:13.306396 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.306365 2569 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal"] Jun 03 16:16:13.306540 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.306441 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:16:13.307393 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.307377 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:16:13.307488 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.307409 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:16:13.307488 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.307423 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:16:13.308944 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.308928 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:16:13.309118 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.309085 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.309172 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.309147 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:16:13.309624 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.309605 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:16:13.309712 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.309636 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:16:13.309712 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.309610 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:16:13.309712 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.309651 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:16:13.309712 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.309663 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:16:13.309712 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.309690 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:16:13.310816 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.310799 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.310885 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.310826 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:16:13.311574 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.311558 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:16:13.311649 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.311586 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:16:13.311649 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.311599 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:16:13.334772 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.334751 2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-211.ec2.internal\" not found" node="ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.339223 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.339203 2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-211.ec2.internal\" not found" node="ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.353720 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.353699 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:13.368039 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.368016 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/edd520124a020bf42a516e1b37201af6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"edd520124a020bf42a516e1b37201af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.368147 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.368042 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edd520124a020bf42a516e1b37201af6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"edd520124a020bf42a516e1b37201af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.368147 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.368066 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/99943b78259665c5d1ab9b3113dfe749-config\") pod \"kube-apiserver-proxy-ip-10-0-129-211.ec2.internal\" (UID: \"99943b78259665c5d1ab9b3113dfe749\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.453819 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.453787 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:13.468336 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.468267 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/edd520124a020bf42a516e1b37201af6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"edd520124a020bf42a516e1b37201af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.468336 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.468302 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edd520124a020bf42a516e1b37201af6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"edd520124a020bf42a516e1b37201af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.468336 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.468327 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/99943b78259665c5d1ab9b3113dfe749-config\") pod \"kube-apiserver-proxy-ip-10-0-129-211.ec2.internal\" (UID: \"99943b78259665c5d1ab9b3113dfe749\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.468512 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.468354 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/edd520124a020bf42a516e1b37201af6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"edd520124a020bf42a516e1b37201af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.468512 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.468361 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/99943b78259665c5d1ab9b3113dfe749-config\") pod \"kube-apiserver-proxy-ip-10-0-129-211.ec2.internal\" (UID: \"99943b78259665c5d1ab9b3113dfe749\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.468512 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.468365 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edd520124a020bf42a516e1b37201af6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal\" (UID: \"edd520124a020bf42a516e1b37201af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.554717 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.554673 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:13.637483 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.637435 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.643673 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.643654 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jun 03 16:16:13.655418 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.655393 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:13.756002 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.755903 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:13.856375 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.856349 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:13.956989 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:13.956955 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:13.966120 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.966078 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 16:16:13.966276 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:13.966260 2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 16:16:14.057950 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:14.057881 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:14.067149 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.067126 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 16:16:14.090292 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.090271 2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 16:16:14.094391 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.094365 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 16:11:13 +0000 UTC" deadline="2027-10-30 04:19:44.031111253 +0000 UTC" Jun 03 16:16:14.094391 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.094388 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12324h3m29.93672581s" Jun 03 16:16:14.158932 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:14.158900 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:14.172185 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.172164 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tnzfb" Jun 03 16:16:14.182373 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.182352 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tnzfb" Jun 03 16:16:14.183698 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:14.183663 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd520124a020bf42a516e1b37201af6.slice/crio-932978073a4c7f5c48a4f4caed05e5ea387a3281f2f2cdd987efac0f5f791fe8 WatchSource:0}: Error finding container 932978073a4c7f5c48a4f4caed05e5ea387a3281f2f2cdd987efac0f5f791fe8: Status 404 returned error can't find the container with id 932978073a4c7f5c48a4f4caed05e5ea387a3281f2f2cdd987efac0f5f791fe8 Jun 03 16:16:14.183870 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:14.183857 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99943b78259665c5d1ab9b3113dfe749.slice/crio-857e2c0cf6245307db2ed0543b706da8f153c67e931413810a67dfca5121146d WatchSource:0}: Error finding container 857e2c0cf6245307db2ed0543b706da8f153c67e931413810a67dfca5121146d: Status 404 returned error can't find the container with id 857e2c0cf6245307db2ed0543b706da8f153c67e931413810a67dfca5121146d Jun 03 16:16:14.188029 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.188007 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:16:14.208038 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.207994 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" event={"ID":"99943b78259665c5d1ab9b3113dfe749","Type":"ContainerStarted","Data":"857e2c0cf6245307db2ed0543b706da8f153c67e931413810a67dfca5121146d"} Jun 03 16:16:14.210774 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.210750 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" event={"ID":"edd520124a020bf42a516e1b37201af6","Type":"ContainerStarted","Data":"932978073a4c7f5c48a4f4caed05e5ea387a3281f2f2cdd987efac0f5f791fe8"} Jun 03 16:16:14.218529 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.218512 2569 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:16:14.259810 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:14.259787 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-211.ec2.internal\" not found" Jun 03 16:16:14.325378 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.325319 2569 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:16:14.367627 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.367605 2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" Jun 03 16:16:14.381638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.381615 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 16:16:14.382749 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.382737 2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" Jun 03 16:16:14.395165 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.395150 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 16:16:14.500616 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.500586 2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:16:14.985739 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:14.985704 2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:16:15.047424 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.047388 2569 apiserver.go:52] "Watching apiserver" Jun 03 16:16:15.055287 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.055261 2569 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 16:16:15.055681 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.055652 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-vdkm8","kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw","openshift-cluster-node-tuning-operator/tuned-56pcr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal","openshift-multus/multus-k48r5","openshift-multus/network-metrics-daemon-hbskv","openshift-network-diagnostics/network-check-target-csjz9","openshift-dns/node-resolver-qjc7p","openshift-image-registry/node-ca-qg52k","openshift-multus/multus-additional-cni-plugins-cxfnf","openshift-network-operator/iptables-alerter-m9g4n","openshift-ovn-kubernetes/ovnkube-node-gmxxc"] Jun 03 16:16:15.057339 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.057315 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:15.057436 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.057396 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:15.058612 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.058586 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.059841 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.059823 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.061795 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.061277 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hsh7p\"" Jun 03 16:16:15.061795 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.061334 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 16:16:15.061795 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.061278 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 16:16:15.061795 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.061486 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 16:16:15.062042 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.061994 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:16:15.062200 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.062184 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lr4nf\"" Jun 03 16:16:15.062491 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.062479 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 16:16:15.062990 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.062968 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:15.064719 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.064697 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.065526 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.065505 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n47mq\"" Jun 03 16:16:15.065741 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.065724 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 16:16:15.065828 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.065721 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 16:16:15.066517 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.066235 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:15.066517 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.066298 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:15.067009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.066989 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 16:16:15.067828 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.067261 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 16:16:15.067828 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.067416 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 16:16:15.067828 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.067438 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 16:16:15.067828 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.067586 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qjc7p" Jun 03 16:16:15.067828 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.067633 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-99z86\"" Jun 03 16:16:15.068949 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.068912 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qg52k" Jun 03 16:16:15.069049 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.069031 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.072427 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.071856 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 16:16:15.072427 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.072123 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8pkh2\"" Jun 03 16:16:15.072427 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.072347 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 16:16:15.072427 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.072398 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 16:16:15.072654 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.072450 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 16:16:15.072654 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.072513 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 16:16:15.072654 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.072456 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 16:16:15.072654 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.072457 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-24lpd\"" Jun 03 16:16:15.073138 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.073055 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m4xjw\"" Jun 03 16:16:15.073138 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.073056 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 16:16:15.073449 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.073425 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m9g4n" Jun 03 16:16:15.075790 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.075738 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.075790 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.075774 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-socket-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.075934 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.075802 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-lib-modules\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.075934 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.075825 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-device-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.075934 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.075849 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-system-cni-dir\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.075934 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.075873 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-run-k8s-cni-cncf-io\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.075934 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.075895 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-var-lib-cni-bin\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.075934 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.075919 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-hostroot\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.076236 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.075946 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-tuned\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.076236 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.075898 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.076236 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076001 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62ld2\" (UniqueName: \"kubernetes.io/projected/153ff263-c2c3-45a0-901a-a616452d6a1f-kube-api-access-62ld2\") pod \"node-ca-qg52k\" (UID: \"153ff263-c2c3-45a0-901a-a616452d6a1f\") " pod="openshift-image-registry/node-ca-qg52k" Jun 03 16:16:15.076236 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076028 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88xg\" (UniqueName: \"kubernetes.io/projected/26aa42e6-df1e-4d38-abee-815e1408b049-kube-api-access-z88xg\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:15.076236 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076052 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-kubernetes\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.076236 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076127 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-sys\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.076236 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076151 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-tmp\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.076236 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076198 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrv22\" (UniqueName: \"kubernetes.io/projected/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-kube-api-access-jrv22\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076238 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/153ff263-c2c3-45a0-901a-a616452d6a1f-serviceca\") pod \"node-ca-qg52k\" (UID: \"153ff263-c2c3-45a0-901a-a616452d6a1f\") " pod="openshift-image-registry/node-ca-qg52k" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076267 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-sys-fs\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076302 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-multus-conf-dir\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076335 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtj6m\" (UniqueName: \"kubernetes.io/projected/6b70d1f9-8487-4928-900b-356cf62370a1-kube-api-access-gtj6m\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076358 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-var-lib-kubelet\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076379 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-host\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076410 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-etc-selinux\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076454 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knf5s\" (UniqueName: \"kubernetes.io/projected/9769144e-c158-45ca-88f7-b6fc3631ac31-kube-api-access-knf5s\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076490 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-multus-cni-dir\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076524 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-multus-socket-dir-parent\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076538 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076549 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-run-netns\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076572 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076583 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-var-lib-cni-multus\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076622 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-sysconfig\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076651 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-run\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076657 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076678 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:15.077157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076704 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g8xqd\"" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076704 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-registration-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076788 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-var-lib-kubelet\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076814 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-etc-kubernetes\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076842 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-sysctl-d\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076872 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/433c1936-2255-45ef-b882-7c6c347b9e49-konnectivity-ca\") pod \"konnectivity-agent-vdkm8\" (UID: \"433c1936-2255-45ef-b882-7c6c347b9e49\") " pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076896 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d94987-c995-4436-a994-94fbbd06166d-tmp-dir\") pod \"node-resolver-qjc7p\" (UID: \"62d94987-c995-4436-a994-94fbbd06166d\") " pod="openshift-dns/node-resolver-qjc7p" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076918 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-cnibin\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076952 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-os-release\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.076978 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-modprobe-d\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.077004 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-sysctl-conf\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.077045 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/153ff263-c2c3-45a0-901a-a616452d6a1f-host\") pod \"node-ca-qg52k\" (UID: \"153ff263-c2c3-45a0-901a-a616452d6a1f\") " pod="openshift-image-registry/node-ca-qg52k" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.077068 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b70d1f9-8487-4928-900b-356cf62370a1-cni-binary-copy\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.077146 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b70d1f9-8487-4928-900b-356cf62370a1-multus-daemon-config\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.077187 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-run-multus-certs\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.077300 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-systemd\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.077336 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/433c1936-2255-45ef-b882-7c6c347b9e49-agent-certs\") pod \"konnectivity-agent-vdkm8\" (UID: \"433c1936-2255-45ef-b882-7c6c347b9e49\") " pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:15.078009 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.077363 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7p7r\" (UniqueName: \"kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r\") pod \"network-check-target-csjz9\" (UID: \"63aed83b-71b8-4721-b0b4-f36beef888a6\") " pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:15.078811 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.077412 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/62d94987-c995-4436-a994-94fbbd06166d-hosts-file\") pod \"node-resolver-qjc7p\" (UID: \"62d94987-c995-4436-a994-94fbbd06166d\") " pod="openshift-dns/node-resolver-qjc7p" Jun 03 16:16:15.078811 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.077489 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk4tf\" (UniqueName: \"kubernetes.io/projected/62d94987-c995-4436-a994-94fbbd06166d-kube-api-access-vk4tf\") pod \"node-resolver-qjc7p\" (UID: \"62d94987-c995-4436-a994-94fbbd06166d\") " pod="openshift-dns/node-resolver-qjc7p" Jun 03 16:16:15.078811 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.078370 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 16:16:15.078951 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.078843 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 16:16:15.078999 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.078954 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 16:16:15.079817 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.079786 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 16:16:15.079907 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.079826 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 16:16:15.079907 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.079834 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 16:16:15.079907 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.079853 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2m2bf\"" Jun 03 16:16:15.167688 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.167656 2569 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 16:16:15.178247 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.177822 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-run-systemd\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.178247 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.177875 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-cni-netd\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.178247 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.177911 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/153ff263-c2c3-45a0-901a-a616452d6a1f-serviceca\") pod \"node-ca-qg52k\" (UID: \"153ff263-c2c3-45a0-901a-a616452d6a1f\") " pod="openshift-image-registry/node-ca-qg52k" Jun 03 16:16:15.178247 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.177948 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-cnibin\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.178247 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178002 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.178247 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178039 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knf5s\" (UniqueName: \"kubernetes.io/projected/9769144e-c158-45ca-88f7-b6fc3631ac31-kube-api-access-knf5s\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.178247 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178075 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-multus-cni-dir\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.178247 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178125 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-os-release\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.178247 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178155 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ce280fa-ee1d-46d1-b433-f490213e54c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.178247 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178188 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-ovnkube-config\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.178247 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178226 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-ovnkube-script-lib\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178263 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178297 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-registration-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178332 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2cc17c88-db37-4569-a7aa-707bc78cc228-iptables-alerter-script\") pod \"iptables-alerter-m9g4n\" (UID: \"2cc17c88-db37-4569-a7aa-707bc78cc228\") " pod="openshift-network-operator/iptables-alerter-m9g4n" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178365 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-kubelet\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178395 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-run-openvswitch\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178430 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-sysctl-d\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178462 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d94987-c995-4436-a994-94fbbd06166d-tmp-dir\") pod \"node-resolver-qjc7p\" (UID: \"62d94987-c995-4436-a994-94fbbd06166d\") " pod="openshift-dns/node-resolver-qjc7p" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178488 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-cnibin\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178516 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-modprobe-d\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178536 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/153ff263-c2c3-45a0-901a-a616452d6a1f-host\") pod \"node-ca-qg52k\" (UID: \"153ff263-c2c3-45a0-901a-a616452d6a1f\") " pod="openshift-image-registry/node-ca-qg52k" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178555 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b70d1f9-8487-4928-900b-356cf62370a1-cni-binary-copy\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178582 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-run-multus-certs\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178608 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvgvb\" (UniqueName: \"kubernetes.io/projected/2cc17c88-db37-4569-a7aa-707bc78cc228-kube-api-access-xvgvb\") pod \"iptables-alerter-m9g4n\" (UID: \"2cc17c88-db37-4569-a7aa-707bc78cc228\") " pod="openshift-network-operator/iptables-alerter-m9g4n" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178631 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-slash\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178651 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-node-log\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178680 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-systemd\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.178857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178702 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/433c1936-2255-45ef-b882-7c6c347b9e49-agent-certs\") pod \"konnectivity-agent-vdkm8\" (UID: \"433c1936-2255-45ef-b882-7c6c347b9e49\") " pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178724 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7p7r\" (UniqueName: \"kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r\") pod \"network-check-target-csjz9\" (UID: \"63aed83b-71b8-4721-b0b4-f36beef888a6\") " pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178748 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vk4tf\" (UniqueName: \"kubernetes.io/projected/62d94987-c995-4436-a994-94fbbd06166d-kube-api-access-vk4tf\") pod \"node-resolver-qjc7p\" (UID: \"62d94987-c995-4436-a994-94fbbd06166d\") " pod="openshift-dns/node-resolver-qjc7p" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178772 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178793 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ce280fa-ee1d-46d1-b433-f490213e54c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178813 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz4gl\" (UniqueName: \"kubernetes.io/projected/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-kube-api-access-nz4gl\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178843 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2cc17c88-db37-4569-a7aa-707bc78cc228-host-slash\") pod \"iptables-alerter-m9g4n\" (UID: \"2cc17c88-db37-4569-a7aa-707bc78cc228\") " pod="openshift-network-operator/iptables-alerter-m9g4n" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178866 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178887 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-systemd-units\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178909 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-var-lib-openvswitch\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178962 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-tuned\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.178985 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62ld2\" (UniqueName: \"kubernetes.io/projected/153ff263-c2c3-45a0-901a-a616452d6a1f-kube-api-access-62ld2\") pod \"node-ca-qg52k\" (UID: \"153ff263-c2c3-45a0-901a-a616452d6a1f\") " pod="openshift-image-registry/node-ca-qg52k" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179015 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z88xg\" (UniqueName: \"kubernetes.io/projected/26aa42e6-df1e-4d38-abee-815e1408b049-kube-api-access-z88xg\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-env-overrides\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179055 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-kubernetes\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179082 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-sys\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179121 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-tmp\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.179614 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179141 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrv22\" (UniqueName: \"kubernetes.io/projected/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-kube-api-access-jrv22\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179173 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-sys-fs\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179195 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-multus-conf-dir\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179293 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-systemd\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179328 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/153ff263-c2c3-45a0-901a-a616452d6a1f-host\") pod \"node-ca-qg52k\" (UID: \"153ff263-c2c3-45a0-901a-a616452d6a1f\") " pod="openshift-image-registry/node-ca-qg52k" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179333 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtj6m\" (UniqueName: \"kubernetes.io/projected/6b70d1f9-8487-4928-900b-356cf62370a1-kube-api-access-gtj6m\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179362 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-kubernetes\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179337 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-registration-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179358 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-run-multus-certs\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179373 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-var-lib-kubelet\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179490 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-sys-fs\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179508 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-cnibin\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179529 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-sysctl-d\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179543 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-var-lib-kubelet\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179559 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-modprobe-d\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179576 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-host\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179657 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-multus-cni-dir\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179735 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-multus-conf-dir\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.179838 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:15.180434 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179899 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-sys\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.179911 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d94987-c995-4436-a994-94fbbd06166d-tmp-dir\") pod \"node-resolver-qjc7p\" (UID: \"62d94987-c995-4436-a994-94fbbd06166d\") " pod="openshift-dns/node-resolver-qjc7p" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180358 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180463 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-etc-selinux\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.180489 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs podName:26aa42e6-df1e-4d38-abee-815e1408b049 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:15.680446969 +0000 UTC m=+3.121967385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs") pod "network-metrics-daemon-hbskv" (UID: "26aa42e6-df1e-4d38-abee-815e1408b049") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180532 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-multus-socket-dir-parent\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180562 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-etc-selinux\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180596 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180573 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-run-netns\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180616 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-run-netns\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180648 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-var-lib-cni-multus\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180827 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-multus-socket-dir-parent\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180915 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-var-lib-kubelet\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180952 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-etc-openvswitch\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.180996 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-sysconfig\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181054 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-run\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181087 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-etc-kubernetes\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.181352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181136 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ce280fa-ee1d-46d1-b433-f490213e54c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181168 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181194 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-cni-bin\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181228 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/433c1936-2255-45ef-b882-7c6c347b9e49-konnectivity-ca\") pod \"konnectivity-agent-vdkm8\" (UID: \"433c1936-2255-45ef-b882-7c6c347b9e49\") " pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181291 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b70d1f9-8487-4928-900b-356cf62370a1-cni-binary-copy\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181304 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-os-release\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181335 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtwpx\" (UniqueName: \"kubernetes.io/projected/2ce280fa-ee1d-46d1-b433-f490213e54c7-kube-api-access-wtwpx\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181353 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/153ff263-c2c3-45a0-901a-a616452d6a1f-serviceca\") pod \"node-ca-qg52k\" (UID: \"153ff263-c2c3-45a0-901a-a616452d6a1f\") " pod="openshift-image-registry/node-ca-qg52k" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181360 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-run-netns\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181378 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-host\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181391 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-run-ovn\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181419 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-log-socket\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181526 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-sysctl-conf\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181565 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b70d1f9-8487-4928-900b-356cf62370a1-multus-daemon-config\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181653 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-sysconfig\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181734 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-system-cni-dir\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181799 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/62d94987-c995-4436-a994-94fbbd06166d-hosts-file\") pod \"node-resolver-qjc7p\" (UID: \"62d94987-c995-4436-a994-94fbbd06166d\") " pod="openshift-dns/node-resolver-qjc7p" Jun 03 16:16:15.182164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181831 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-sysctl-conf\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181840 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-socket-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181875 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-system-cni-dir\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181906 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-hostroot\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181934 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-var-lib-cni-multus\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181940 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-ovn-node-metrics-cert\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181975 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-run\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.181994 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/433c1936-2255-45ef-b882-7c6c347b9e49-konnectivity-ca\") pod \"konnectivity-agent-vdkm8\" (UID: \"433c1936-2255-45ef-b882-7c6c347b9e49\") " pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182024 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-lib-modules\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182082 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-var-lib-kubelet\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182107 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/62d94987-c995-4436-a994-94fbbd06166d-hosts-file\") pod \"node-resolver-qjc7p\" (UID: \"62d94987-c995-4436-a994-94fbbd06166d\") " pod="openshift-dns/node-resolver-qjc7p" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182108 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-socket-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182109 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-system-cni-dir\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182184 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-etc-kubernetes\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182191 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-device-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182274 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-run-k8s-cni-cncf-io\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182277 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9769144e-c158-45ca-88f7-b6fc3631ac31-device-dir\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182306 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b70d1f9-8487-4928-900b-356cf62370a1-multus-daemon-config\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.182864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182354 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-var-lib-cni-bin\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.183674 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182374 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-os-release\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.183674 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182430 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-lib-modules\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.183674 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182449 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-hostroot\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.183674 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182452 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-var-lib-cni-bin\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.183674 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.182497 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b70d1f9-8487-4928-900b-356cf62370a1-host-run-k8s-cni-cncf-io\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.183674 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.183134 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:11:14 +0000 UTC" deadline="2028-01-23 02:41:37.405001196 +0000 UTC" Jun 03 16:16:15.183674 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.183159 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14362h25m22.221846358s" Jun 03 16:16:15.184693 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.184623 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/433c1936-2255-45ef-b882-7c6c347b9e49-agent-certs\") pod \"konnectivity-agent-vdkm8\" (UID: \"433c1936-2255-45ef-b882-7c6c347b9e49\") " pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:15.185056 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.185015 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-tmp\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.185056 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.185026 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-etc-tuned\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.188143 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.188120 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:16:15.188234 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.188149 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:16:15.188234 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.188165 2569 projected.go:194] Error preparing data for projected volume kube-api-access-c7p7r for pod openshift-network-diagnostics/network-check-target-csjz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:15.188234 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.188231 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r podName:63aed83b-71b8-4721-b0b4-f36beef888a6 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:15.688214305 +0000 UTC m=+3.129734712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c7p7r" (UniqueName: "kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r") pod "network-check-target-csjz9" (UID: "63aed83b-71b8-4721-b0b4-f36beef888a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:15.190273 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.190245 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88xg\" (UniqueName: \"kubernetes.io/projected/26aa42e6-df1e-4d38-abee-815e1408b049-kube-api-access-z88xg\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:15.191118 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.190916 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrv22\" (UniqueName: \"kubernetes.io/projected/f236ff1b-16dd-4cd6-a8b4-9a788fdfad91-kube-api-access-jrv22\") pod \"tuned-56pcr\" (UID: \"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91\") " pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.191118 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.190961 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62ld2\" (UniqueName: \"kubernetes.io/projected/153ff263-c2c3-45a0-901a-a616452d6a1f-kube-api-access-62ld2\") pod \"node-ca-qg52k\" (UID: \"153ff263-c2c3-45a0-901a-a616452d6a1f\") " pod="openshift-image-registry/node-ca-qg52k" Jun 03 16:16:15.192514 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.192482 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knf5s\" (UniqueName: \"kubernetes.io/projected/9769144e-c158-45ca-88f7-b6fc3631ac31-kube-api-access-knf5s\") pod \"aws-ebs-csi-driver-node-624zw\" (UID: \"9769144e-c158-45ca-88f7-b6fc3631ac31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.192857 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.192836 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtj6m\" (UniqueName: \"kubernetes.io/projected/6b70d1f9-8487-4928-900b-356cf62370a1-kube-api-access-gtj6m\") pod \"multus-k48r5\" (UID: \"6b70d1f9-8487-4928-900b-356cf62370a1\") " pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.194241 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.194224 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk4tf\" (UniqueName: \"kubernetes.io/projected/62d94987-c995-4436-a994-94fbbd06166d-kube-api-access-vk4tf\") pod \"node-resolver-qjc7p\" (UID: \"62d94987-c995-4436-a994-94fbbd06166d\") " pod="openshift-dns/node-resolver-qjc7p" Jun 03 16:16:15.283587 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283500 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-kubelet\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.283587 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283543 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-run-openvswitch\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.283587 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283571 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvgvb\" (UniqueName: \"kubernetes.io/projected/2cc17c88-db37-4569-a7aa-707bc78cc228-kube-api-access-xvgvb\") pod \"iptables-alerter-m9g4n\" (UID: \"2cc17c88-db37-4569-a7aa-707bc78cc228\") " pod="openshift-network-operator/iptables-alerter-m9g4n" Jun 03 16:16:15.283845 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283638 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-run-openvswitch\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.283845 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283637 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-kubelet\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.283845 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283687 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-slash\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.283845 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283710 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-slash\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.283845 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283721 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-node-log\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.283845 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283755 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-node-log\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.283845 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283766 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ce280fa-ee1d-46d1-b433-f490213e54c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.283845 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283790 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nz4gl\" (UniqueName: \"kubernetes.io/projected/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-kube-api-access-nz4gl\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.283845 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283816 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2cc17c88-db37-4569-a7aa-707bc78cc228-host-slash\") pod \"iptables-alerter-m9g4n\" (UID: \"2cc17c88-db37-4569-a7aa-707bc78cc228\") " pod="openshift-network-operator/iptables-alerter-m9g4n" Jun 03 16:16:15.283845 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283839 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283870 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-systemd-units\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283888 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2cc17c88-db37-4569-a7aa-707bc78cc228-host-slash\") pod \"iptables-alerter-m9g4n\" (UID: \"2cc17c88-db37-4569-a7aa-707bc78cc228\") " pod="openshift-network-operator/iptables-alerter-m9g4n" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283895 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-var-lib-openvswitch\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283952 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-var-lib-openvswitch\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283982 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-systemd-units\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.283976 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-env-overrides\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284027 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284057 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-etc-openvswitch\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284122 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ce280fa-ee1d-46d1-b433-f490213e54c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284153 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284179 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-cni-bin\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284312 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284208 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtwpx\" (UniqueName: \"kubernetes.io/projected/2ce280fa-ee1d-46d1-b433-f490213e54c7-kube-api-access-wtwpx\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284442 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-etc-openvswitch\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284464 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-cni-bin\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284480 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-run-netns\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284512 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284515 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-env-overrides\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284517 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-run-ovn\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284553 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-run-ovn\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284556 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-run-netns\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284560 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ce280fa-ee1d-46d1-b433-f490213e54c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284578 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-log-socket\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284612 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-system-cni-dir\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284616 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-log-socket\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284646 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-ovn-node-metrics-cert\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284691 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-run-systemd\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284712 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-system-cni-dir\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284749 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-run-systemd\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284755 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-cni-netd\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.284820 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284717 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-cni-netd\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284786 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-cnibin\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284814 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284842 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-os-release\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284865 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ce280fa-ee1d-46d1-b433-f490213e54c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284890 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-ovnkube-config\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284914 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-ovnkube-script-lib\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284933 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284949 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-cnibin\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.284978 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2cc17c88-db37-4569-a7aa-707bc78cc228-iptables-alerter-script\") pod \"iptables-alerter-m9g4n\" (UID: \"2cc17c88-db37-4569-a7aa-707bc78cc228\") " pod="openshift-network-operator/iptables-alerter-m9g4n" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.285139 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ce280fa-ee1d-46d1-b433-f490213e54c7-os-release\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.285479 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-ovnkube-config\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.285638 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.285517 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2cc17c88-db37-4569-a7aa-707bc78cc228-iptables-alerter-script\") pod \"iptables-alerter-m9g4n\" (UID: \"2cc17c88-db37-4569-a7aa-707bc78cc228\") " pod="openshift-network-operator/iptables-alerter-m9g4n" Jun 03 16:16:15.286233 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.285677 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-ovnkube-script-lib\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.286233 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.285823 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ce280fa-ee1d-46d1-b433-f490213e54c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.286378 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.286356 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ce280fa-ee1d-46d1-b433-f490213e54c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.287435 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.287415 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-ovn-node-metrics-cert\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.294039 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.294015 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz4gl\" (UniqueName: \"kubernetes.io/projected/bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b-kube-api-access-nz4gl\") pod \"ovnkube-node-gmxxc\" (UID: \"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.294529 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.294509 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvgvb\" (UniqueName: \"kubernetes.io/projected/2cc17c88-db37-4569-a7aa-707bc78cc228-kube-api-access-xvgvb\") pod \"iptables-alerter-m9g4n\" (UID: \"2cc17c88-db37-4569-a7aa-707bc78cc228\") " pod="openshift-network-operator/iptables-alerter-m9g4n" Jun 03 16:16:15.294628 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.294576 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtwpx\" (UniqueName: \"kubernetes.io/projected/2ce280fa-ee1d-46d1-b433-f490213e54c7-kube-api-access-wtwpx\") pod \"multus-additional-cni-plugins-cxfnf\" (UID: \"2ce280fa-ee1d-46d1-b433-f490213e54c7\") " pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.379900 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.379871 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" Jun 03 16:16:15.388796 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.388765 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-56pcr" Jun 03 16:16:15.396553 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.396526 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:15.402244 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.402212 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k48r5" Jun 03 16:16:15.409851 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.409824 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qjc7p" Jun 03 16:16:15.416531 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.416503 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qg52k" Jun 03 16:16:15.424142 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.424111 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" Jun 03 16:16:15.432774 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.432748 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m9g4n" Jun 03 16:16:15.438529 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.438508 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:15.687317 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.687271 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:15.687488 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.687421 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:15.687563 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.687505 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs podName:26aa42e6-df1e-4d38-abee-815e1408b049 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:16.687483597 +0000 UTC m=+4.129004010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs") pod "network-metrics-daemon-hbskv" (UID: "26aa42e6-df1e-4d38-abee-815e1408b049") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:15.788629 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:15.788591 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7p7r\" (UniqueName: \"kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r\") pod \"network-check-target-csjz9\" (UID: \"63aed83b-71b8-4721-b0b4-f36beef888a6\") " pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:15.788807 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.788744 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:16:15.788807 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.788764 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:16:15.788807 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.788776 2569 projected.go:194] Error preparing data for projected volume kube-api-access-c7p7r for pod openshift-network-diagnostics/network-check-target-csjz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:15.788928 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:15.788837 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r podName:63aed83b-71b8-4721-b0b4-f36beef888a6 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:16.788818689 +0000 UTC m=+4.230339084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7p7r" (UniqueName: "kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r") pod "network-check-target-csjz9" (UID: "63aed83b-71b8-4721-b0b4-f36beef888a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:15.921946 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:15.921842 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce280fa_ee1d_46d1_b433_f490213e54c7.slice/crio-8c8d17e9c127a43e0c1e90fc5ecc3f742950feace5d9cd0f25781a228516fbeb WatchSource:0}: Error finding container 8c8d17e9c127a43e0c1e90fc5ecc3f742950feace5d9cd0f25781a228516fbeb: Status 404 returned error can't find the container with id 8c8d17e9c127a43e0c1e90fc5ecc3f742950feace5d9cd0f25781a228516fbeb Jun 03 16:16:15.923044 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:15.923006 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b70d1f9_8487_4928_900b_356cf62370a1.slice/crio-78fc2303ea13ad9bd4d9b463a905629b859aa2aa0704d81a6a6acc44700f22c4 WatchSource:0}: Error finding container 78fc2303ea13ad9bd4d9b463a905629b859aa2aa0704d81a6a6acc44700f22c4: Status 404 returned error can't find the container with id 78fc2303ea13ad9bd4d9b463a905629b859aa2aa0704d81a6a6acc44700f22c4 Jun 03 16:16:15.924417 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:15.924372 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d94987_c995_4436_a994_94fbbd06166d.slice/crio-489202e10386d90ea457f89efaca52a60413bfd0eee115c43ca1e8b65325effe WatchSource:0}: Error finding container 489202e10386d90ea457f89efaca52a60413bfd0eee115c43ca1e8b65325effe: Status 404 returned error can't find the container with id 489202e10386d90ea457f89efaca52a60413bfd0eee115c43ca1e8b65325effe Jun 03 16:16:15.927953 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:15.927931 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433c1936_2255_45ef_b882_7c6c347b9e49.slice/crio-597ba2267fde54a244a2ddcb52b57315c4d94abe38c36475a64eb4e5b390c813 WatchSource:0}: Error finding container 597ba2267fde54a244a2ddcb52b57315c4d94abe38c36475a64eb4e5b390c813: Status 404 returned error can't find the container with id 597ba2267fde54a244a2ddcb52b57315c4d94abe38c36475a64eb4e5b390c813 Jun 03 16:16:15.928574 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:15.928515 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9769144e_c158_45ca_88f7_b6fc3631ac31.slice/crio-bd62265db2ff37d9d1ca2033e69718358373645d4aa597801907626093c08820 WatchSource:0}: Error finding container bd62265db2ff37d9d1ca2033e69718358373645d4aa597801907626093c08820: Status 404 returned error can't find the container with id bd62265db2ff37d9d1ca2033e69718358373645d4aa597801907626093c08820 Jun 03 16:16:15.929738 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:15.929715 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc17c88_db37_4569_a7aa_707bc78cc228.slice/crio-e79f08d92d9eeb9d67a926cf280e38edb4697a3482b01ebf39182c223a744580 WatchSource:0}: Error finding container e79f08d92d9eeb9d67a926cf280e38edb4697a3482b01ebf39182c223a744580: Status 404 returned error can't find the container with id e79f08d92d9eeb9d67a926cf280e38edb4697a3482b01ebf39182c223a744580 Jun 03 16:16:15.930709 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:15.930687 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf236ff1b_16dd_4cd6_a8b4_9a788fdfad91.slice/crio-f709c370f98c6c433e28ced700dd81f852baa65efaed908c04d024e5a62a0028 WatchSource:0}: Error finding container f709c370f98c6c433e28ced700dd81f852baa65efaed908c04d024e5a62a0028: Status 404 returned error can't find the container with id f709c370f98c6c433e28ced700dd81f852baa65efaed908c04d024e5a62a0028 Jun 03 16:16:15.931996 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:15.931882 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0eca9f_d9e5_4f6a_8cee_0c8bcabb9a2b.slice/crio-c58c97a0f1ef9d65eeab26359d651877a1905449eeb5f7a19795fe4a5ecc5c13 WatchSource:0}: Error finding container c58c97a0f1ef9d65eeab26359d651877a1905449eeb5f7a19795fe4a5ecc5c13: Status 404 returned error can't find the container with id c58c97a0f1ef9d65eeab26359d651877a1905449eeb5f7a19795fe4a5ecc5c13 Jun 03 16:16:15.933012 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:15.932988 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod153ff263_c2c3_45a0_901a_a616452d6a1f.slice/crio-9a8883256628fca3a0e49953a7487be896c494051a29a29c534a081009ac9a87 WatchSource:0}: Error finding container 9a8883256628fca3a0e49953a7487be896c494051a29a29c534a081009ac9a87: Status 404 returned error can't find the container with id 9a8883256628fca3a0e49953a7487be896c494051a29a29c534a081009ac9a87 Jun 03 16:16:16.184177 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.183974 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:11:14 +0000 UTC" deadline="2028-01-12 14:45:22.489225936 +0000 UTC" Jun 03 16:16:16.184177 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.184172 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14110h29m6.305057178s" Jun 03 16:16:16.213784 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.213744 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" event={"ID":"99943b78259665c5d1ab9b3113dfe749","Type":"ContainerStarted","Data":"5b9b4a083da81d1ae965f2599f948c1749d21fcc556c0bd2299ccbf44a164ce5"} Jun 03 16:16:16.214780 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.214747 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qg52k" event={"ID":"153ff263-c2c3-45a0-901a-a616452d6a1f","Type":"ContainerStarted","Data":"9a8883256628fca3a0e49953a7487be896c494051a29a29c534a081009ac9a87"} Jun 03 16:16:16.215735 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.215705 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-56pcr" event={"ID":"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91","Type":"ContainerStarted","Data":"f709c370f98c6c433e28ced700dd81f852baa65efaed908c04d024e5a62a0028"} Jun 03 16:16:16.216630 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.216603 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m9g4n" event={"ID":"2cc17c88-db37-4569-a7aa-707bc78cc228","Type":"ContainerStarted","Data":"e79f08d92d9eeb9d67a926cf280e38edb4697a3482b01ebf39182c223a744580"} Jun 03 16:16:16.217511 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.217492 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" event={"ID":"9769144e-c158-45ca-88f7-b6fc3631ac31","Type":"ContainerStarted","Data":"bd62265db2ff37d9d1ca2033e69718358373645d4aa597801907626093c08820"} Jun 03 16:16:16.218470 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.218445 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k48r5" event={"ID":"6b70d1f9-8487-4928-900b-356cf62370a1","Type":"ContainerStarted","Data":"78fc2303ea13ad9bd4d9b463a905629b859aa2aa0704d81a6a6acc44700f22c4"} Jun 03 16:16:16.219418 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.219396 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" event={"ID":"2ce280fa-ee1d-46d1-b433-f490213e54c7","Type":"ContainerStarted","Data":"8c8d17e9c127a43e0c1e90fc5ecc3f742950feace5d9cd0f25781a228516fbeb"} Jun 03 16:16:16.221538 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.221519 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" event={"ID":"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b","Type":"ContainerStarted","Data":"c58c97a0f1ef9d65eeab26359d651877a1905449eeb5f7a19795fe4a5ecc5c13"} Jun 03 16:16:16.222378 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.222353 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vdkm8" event={"ID":"433c1936-2255-45ef-b882-7c6c347b9e49","Type":"ContainerStarted","Data":"597ba2267fde54a244a2ddcb52b57315c4d94abe38c36475a64eb4e5b390c813"} Jun 03 16:16:16.223237 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.223220 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qjc7p" event={"ID":"62d94987-c995-4436-a994-94fbbd06166d","Type":"ContainerStarted","Data":"489202e10386d90ea457f89efaca52a60413bfd0eee115c43ca1e8b65325effe"} Jun 03 16:16:16.227493 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.227453 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-211.ec2.internal" podStartSLOduration=2.227443155 podStartE2EDuration="2.227443155s" podCreationTimestamp="2026-06-03 16:16:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:16:16.227328906 +0000 UTC m=+3.668849320" watchObservedRunningTime="2026-06-03 16:16:16.227443155 +0000 UTC m=+3.668963569" Jun 03 16:16:16.696624 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.696027 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:16.696624 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:16.696211 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:16.696624 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:16.696279 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs podName:26aa42e6-df1e-4d38-abee-815e1408b049 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:18.696260343 +0000 UTC m=+6.137780735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs") pod "network-metrics-daemon-hbskv" (UID: "26aa42e6-df1e-4d38-abee-815e1408b049") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:16.796603 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:16.796481 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7p7r\" (UniqueName: \"kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r\") pod \"network-check-target-csjz9\" (UID: \"63aed83b-71b8-4721-b0b4-f36beef888a6\") " pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:16.796783 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:16.796672 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:16:16.796783 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:16.796697 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:16:16.796783 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:16.796711 2569 projected.go:194] Error preparing data for projected volume kube-api-access-c7p7r for pod openshift-network-diagnostics/network-check-target-csjz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:16.796783 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:16.796773 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r podName:63aed83b-71b8-4721-b0b4-f36beef888a6 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:18.796754477 +0000 UTC m=+6.238274885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7p7r" (UniqueName: "kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r") pod "network-check-target-csjz9" (UID: "63aed83b-71b8-4721-b0b4-f36beef888a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:17.206502 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:17.206387 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:17.206502 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:17.206412 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:17.207012 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:17.206513 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:17.207012 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:17.206967 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:17.246773 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:17.246733 2569 generic.go:358] "Generic (PLEG): container finished" podID="edd520124a020bf42a516e1b37201af6" containerID="81e2efb4c9e972b9258042aa38356d5fdad7f9c5291aef5c13b2f22a6595cb28" exitCode=0 Jun 03 16:16:17.247743 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:17.247715 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" event={"ID":"edd520124a020bf42a516e1b37201af6","Type":"ContainerDied","Data":"81e2efb4c9e972b9258042aa38356d5fdad7f9c5291aef5c13b2f22a6595cb28"} Jun 03 16:16:18.266649 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:18.266614 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" event={"ID":"edd520124a020bf42a516e1b37201af6","Type":"ContainerStarted","Data":"7a74a7b4d7572dc2b6024b0ef57c6dc6101b67cfe2cf82d1d80b2215066e1525"} Jun 03 16:16:18.712447 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:18.712393 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:18.712623 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:18.712543 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:18.712623 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:18.712606 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs podName:26aa42e6-df1e-4d38-abee-815e1408b049 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:22.712588095 +0000 UTC m=+10.154108494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs") pod "network-metrics-daemon-hbskv" (UID: "26aa42e6-df1e-4d38-abee-815e1408b049") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:18.813571 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:18.813533 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7p7r\" (UniqueName: \"kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r\") pod \"network-check-target-csjz9\" (UID: \"63aed83b-71b8-4721-b0b4-f36beef888a6\") " pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:18.813753 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:18.813723 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:16:18.813753 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:18.813742 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:16:18.813753 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:18.813754 2569 projected.go:194] Error preparing data for projected volume kube-api-access-c7p7r for pod openshift-network-diagnostics/network-check-target-csjz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:18.813914 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:18.813817 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r podName:63aed83b-71b8-4721-b0b4-f36beef888a6 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:22.813798816 +0000 UTC m=+10.255319216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7p7r" (UniqueName: "kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r") pod "network-check-target-csjz9" (UID: "63aed83b-71b8-4721-b0b4-f36beef888a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:19.206059 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:19.206021 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:19.206262 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:19.206169 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:19.206570 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:19.206544 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:19.206729 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:19.206688 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:21.210587 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:21.210558 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:21.211038 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:21.210558 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:21.211038 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:21.210698 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:21.211038 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:21.210778 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:22.747042 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:22.747003 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:22.747500 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:22.747075 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:22.747500 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:22.747175 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs podName:26aa42e6-df1e-4d38-abee-815e1408b049 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:30.74715476 +0000 UTC m=+18.188675166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs") pod "network-metrics-daemon-hbskv" (UID: "26aa42e6-df1e-4d38-abee-815e1408b049") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:22.847428 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:22.847390 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7p7r\" (UniqueName: \"kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r\") pod \"network-check-target-csjz9\" (UID: \"63aed83b-71b8-4721-b0b4-f36beef888a6\") " pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:22.847599 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:22.847553 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:16:22.847599 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:22.847576 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:16:22.847599 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:22.847589 2569 projected.go:194] Error preparing data for projected volume kube-api-access-c7p7r for pod openshift-network-diagnostics/network-check-target-csjz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:22.847755 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:22.847649 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r podName:63aed83b-71b8-4721-b0b4-f36beef888a6 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:30.847630034 +0000 UTC m=+18.289150451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7p7r" (UniqueName: "kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r") pod "network-check-target-csjz9" (UID: "63aed83b-71b8-4721-b0b4-f36beef888a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:23.207074 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:23.207036 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:23.207790 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:23.207304 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:23.207790 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:23.207531 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:23.207790 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:23.207788 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:25.206686 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:25.206646 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:25.207118 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:25.206703 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:25.207118 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:25.206780 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:25.207118 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:25.206916 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:27.206437 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:27.206401 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:27.206437 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:27.206429 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:27.206956 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:27.206526 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:27.206956 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:27.206659 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:28.311753 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.311695 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-211.ec2.internal" podStartSLOduration=14.31167977 podStartE2EDuration="14.31167977s" podCreationTimestamp="2026-06-03 16:16:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:16:18.283798303 +0000 UTC m=+5.725318718" watchObservedRunningTime="2026-06-03 16:16:28.31167977 +0000 UTC m=+15.753200184" Jun 03 16:16:28.312209 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.311923 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tw5kk"] Jun 03 16:16:28.314788 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.314769 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:28.314882 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:28.314839 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw5kk" podUID="a9ba7a73-fe61-4452-b668-b08d885130ea" Jun 03 16:16:28.386075 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.386017 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9ba7a73-fe61-4452-b668-b08d885130ea-dbus\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:28.386248 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.386169 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:28.386248 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.386225 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9ba7a73-fe61-4452-b668-b08d885130ea-kubelet-config\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:28.487370 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.487336 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:28.487543 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.487392 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9ba7a73-fe61-4452-b668-b08d885130ea-kubelet-config\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:28.487543 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.487431 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9ba7a73-fe61-4452-b668-b08d885130ea-dbus\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:28.487543 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:28.487500 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:28.487696 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.487547 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9ba7a73-fe61-4452-b668-b08d885130ea-kubelet-config\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:28.487696 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:28.487589 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret podName:a9ba7a73-fe61-4452-b668-b08d885130ea nodeName:}" failed. No retries permitted until 2026-06-03 16:16:28.987564786 +0000 UTC m=+16.429085196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret") pod "global-pull-secret-syncer-tw5kk" (UID: "a9ba7a73-fe61-4452-b668-b08d885130ea") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:28.487696 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.487597 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9ba7a73-fe61-4452-b668-b08d885130ea-dbus\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:28.992642 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:28.992602 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:28.992837 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:28.992768 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:28.992895 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:28.992852 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret podName:a9ba7a73-fe61-4452-b668-b08d885130ea nodeName:}" failed. No retries permitted until 2026-06-03 16:16:29.992829129 +0000 UTC m=+17.434349537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret") pod "global-pull-secret-syncer-tw5kk" (UID: "a9ba7a73-fe61-4452-b668-b08d885130ea") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:29.206530 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:29.206498 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:29.206702 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:29.206511 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:29.206702 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:29.206602 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:29.206819 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:29.206714 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:30.000035 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:29.999996 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:30.000489 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:30.000198 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:30.000489 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:30.000280 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret podName:a9ba7a73-fe61-4452-b668-b08d885130ea nodeName:}" failed. No retries permitted until 2026-06-03 16:16:32.000259496 +0000 UTC m=+19.441779908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret") pod "global-pull-secret-syncer-tw5kk" (UID: "a9ba7a73-fe61-4452-b668-b08d885130ea") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:30.206810 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:30.206777 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:30.206982 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:30.206954 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw5kk" podUID="a9ba7a73-fe61-4452-b668-b08d885130ea" Jun 03 16:16:30.805920 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:30.805883 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:30.806115 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:30.805998 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:30.806115 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:30.806079 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs podName:26aa42e6-df1e-4d38-abee-815e1408b049 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:46.806056382 +0000 UTC m=+34.247576781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs") pod "network-metrics-daemon-hbskv" (UID: "26aa42e6-df1e-4d38-abee-815e1408b049") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:30.906295 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:30.906252 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7p7r\" (UniqueName: \"kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r\") pod \"network-check-target-csjz9\" (UID: \"63aed83b-71b8-4721-b0b4-f36beef888a6\") " pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:30.906481 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:30.906418 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:16:30.906481 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:30.906443 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:16:30.906481 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:30.906454 2569 projected.go:194] Error preparing data for projected volume kube-api-access-c7p7r for pod openshift-network-diagnostics/network-check-target-csjz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:30.906610 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:30.906546 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r podName:63aed83b-71b8-4721-b0b4-f36beef888a6 nodeName:}" failed. No retries permitted until 2026-06-03 16:16:46.90652761 +0000 UTC m=+34.348048022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7p7r" (UniqueName: "kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r") pod "network-check-target-csjz9" (UID: "63aed83b-71b8-4721-b0b4-f36beef888a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:31.206688 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:31.206643 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:31.206688 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:31.206684 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:31.207346 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:31.206787 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:31.207346 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:31.207167 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:32.015972 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:32.015936 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:32.016151 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:32.016058 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:32.016151 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:32.016130 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret podName:a9ba7a73-fe61-4452-b668-b08d885130ea nodeName:}" failed. No retries permitted until 2026-06-03 16:16:36.016113993 +0000 UTC m=+23.457634389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret") pod "global-pull-secret-syncer-tw5kk" (UID: "a9ba7a73-fe61-4452-b668-b08d885130ea") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:32.205961 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:32.205926 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:32.206134 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:32.206045 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw5kk" podUID="a9ba7a73-fe61-4452-b668-b08d885130ea" Jun 03 16:16:33.206464 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:33.206428 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:33.206904 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:33.206526 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:33.206904 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:33.206631 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:33.206904 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:33.206759 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:34.206585 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.206402 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:34.207153 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:34.206663 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw5kk" podUID="a9ba7a73-fe61-4452-b668-b08d885130ea" Jun 03 16:16:34.295353 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.295321 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" event={"ID":"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b","Type":"ContainerStarted","Data":"725af1c357c1a18e227890b4f68f8c4da6939c9ac67e389b488bb67d78e5fa30"} Jun 03 16:16:34.295453 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.295364 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" event={"ID":"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b","Type":"ContainerStarted","Data":"0bdcc33fd08768f57b7492cbc6c16ee5584e750ae57b1a359bac5fc69fef1f85"} Jun 03 16:16:34.296597 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.296573 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vdkm8" event={"ID":"433c1936-2255-45ef-b882-7c6c347b9e49","Type":"ContainerStarted","Data":"a59f004603fe76e3956508742bc19f58e7928b09221f85208720725c847ebe6e"} Jun 03 16:16:34.297825 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.297803 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qjc7p" event={"ID":"62d94987-c995-4436-a994-94fbbd06166d","Type":"ContainerStarted","Data":"af897b7422a1f6c5880e5b6cef5c5fb1a13ff56f422f8e41c6ee459c61440b26"} Jun 03 16:16:34.298971 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.298952 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qg52k" event={"ID":"153ff263-c2c3-45a0-901a-a616452d6a1f","Type":"ContainerStarted","Data":"c4344dc60b1bab7fd52f20add9edad8f6e1b808154becb14d4449c8863f8576f"} Jun 03 16:16:34.300082 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.300064 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-56pcr" event={"ID":"f236ff1b-16dd-4cd6-a8b4-9a788fdfad91","Type":"ContainerStarted","Data":"f1a6b65dcf9c998f8ef2b578aaf106bd3683410ff8629ccea29a804e282de778"} Jun 03 16:16:34.301268 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.301251 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" event={"ID":"9769144e-c158-45ca-88f7-b6fc3631ac31","Type":"ContainerStarted","Data":"74872afbdfaeed0f20e8f646488d84aae6d034b54b944ba03fdb6c7e1650e6ae"} Jun 03 16:16:34.302492 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.302471 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k48r5" event={"ID":"6b70d1f9-8487-4928-900b-356cf62370a1","Type":"ContainerStarted","Data":"1595983e8f1f66dc52443613415d056019d022950e35f0721c53dafb599366fe"} Jun 03 16:16:34.303749 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.303728 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" event={"ID":"2ce280fa-ee1d-46d1-b433-f490213e54c7","Type":"ContainerStarted","Data":"302174cccaad5330c8bb703334990051d7dc2f37365be00753ae3bc2da7899c5"} Jun 03 16:16:34.315464 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.315423 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vdkm8" podStartSLOduration=3.76375715 podStartE2EDuration="21.31541063s" podCreationTimestamp="2026-06-03 16:16:13 +0000 UTC" firstStartedPulling="2026-06-03 16:16:15.92970163 +0000 UTC m=+3.371222027" lastFinishedPulling="2026-06-03 16:16:33.4813551 +0000 UTC m=+20.922875507" observedRunningTime="2026-06-03 16:16:34.315012994 +0000 UTC m=+21.756533409" watchObservedRunningTime="2026-06-03 16:16:34.31541063 +0000 UTC m=+21.756931044" Jun 03 16:16:34.332519 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.332468 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-56pcr" podStartSLOduration=3.419561953 podStartE2EDuration="21.33245485s" podCreationTimestamp="2026-06-03 16:16:13 +0000 UTC" firstStartedPulling="2026-06-03 16:16:15.932315656 +0000 UTC m=+3.373836051" lastFinishedPulling="2026-06-03 16:16:33.845208541 +0000 UTC m=+21.286728948" observedRunningTime="2026-06-03 16:16:34.332142345 +0000 UTC m=+21.773662760" watchObservedRunningTime="2026-06-03 16:16:34.33245485 +0000 UTC m=+21.773975266" Jun 03 16:16:34.351444 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.351340 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-k48r5" podStartSLOduration=3.394132043 podStartE2EDuration="21.351320198s" podCreationTimestamp="2026-06-03 16:16:13 +0000 UTC" firstStartedPulling="2026-06-03 16:16:15.924812873 +0000 UTC m=+3.366333281" lastFinishedPulling="2026-06-03 16:16:33.882001043 +0000 UTC m=+21.323521436" observedRunningTime="2026-06-03 16:16:34.350550148 +0000 UTC m=+21.792070564" watchObservedRunningTime="2026-06-03 16:16:34.351320198 +0000 UTC m=+21.792840615" Jun 03 16:16:34.370070 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.370020 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qjc7p" podStartSLOduration=3.45111239 podStartE2EDuration="21.370005245s" podCreationTimestamp="2026-06-03 16:16:13 +0000 UTC" firstStartedPulling="2026-06-03 16:16:15.926322636 +0000 UTC m=+3.367843028" lastFinishedPulling="2026-06-03 16:16:33.845215476 +0000 UTC m=+21.286735883" observedRunningTime="2026-06-03 16:16:34.36987995 +0000 UTC m=+21.811400366" watchObservedRunningTime="2026-06-03 16:16:34.370005245 +0000 UTC m=+21.811525660" Jun 03 16:16:34.389921 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:34.389869 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qg52k" podStartSLOduration=3.843124008 podStartE2EDuration="21.389852495s" podCreationTimestamp="2026-06-03 16:16:13 +0000 UTC" firstStartedPulling="2026-06-03 16:16:15.934630775 +0000 UTC m=+3.376151167" lastFinishedPulling="2026-06-03 16:16:33.481359241 +0000 UTC m=+20.922879654" observedRunningTime="2026-06-03 16:16:34.389641477 +0000 UTC m=+21.831161891" watchObservedRunningTime="2026-06-03 16:16:34.389852495 +0000 UTC m=+21.831372911" Jun 03 16:16:35.199000 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.198975 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 16:16:35.205804 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.205784 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:35.205909 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:35.205888 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:35.205948 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.205922 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:35.205980 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:35.205970 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:35.306576 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.306538 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m9g4n" event={"ID":"2cc17c88-db37-4569-a7aa-707bc78cc228","Type":"ContainerStarted","Data":"c338574c8f15d357d318a805022c5c3bfd89a5c8076fa4ce0c9a0a8acf173ba5"} Jun 03 16:16:35.308061 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.308039 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" event={"ID":"9769144e-c158-45ca-88f7-b6fc3631ac31","Type":"ContainerStarted","Data":"4831baaec1efd5cbdf07ccebe2745471b4ebb90e454cd45213165bb882042868"} Jun 03 16:16:35.309285 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.309260 2569 generic.go:358] "Generic (PLEG): container finished" podID="2ce280fa-ee1d-46d1-b433-f490213e54c7" containerID="302174cccaad5330c8bb703334990051d7dc2f37365be00753ae3bc2da7899c5" exitCode=0 Jun 03 16:16:35.309358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.309337 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" event={"ID":"2ce280fa-ee1d-46d1-b433-f490213e54c7","Type":"ContainerDied","Data":"302174cccaad5330c8bb703334990051d7dc2f37365be00753ae3bc2da7899c5"} Jun 03 16:16:35.311767 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.311751 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/ovn-acl-logging/0.log" Jun 03 16:16:35.312025 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.312007 2569 generic.go:358] "Generic (PLEG): container finished" podID="bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b" containerID="725af1c357c1a18e227890b4f68f8c4da6939c9ac67e389b488bb67d78e5fa30" exitCode=1 Jun 03 16:16:35.312139 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.312120 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" event={"ID":"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b","Type":"ContainerDied","Data":"725af1c357c1a18e227890b4f68f8c4da6939c9ac67e389b488bb67d78e5fa30"} Jun 03 16:16:35.312189 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.312150 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" event={"ID":"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b","Type":"ContainerStarted","Data":"18fa7b00890620bb3b4e4bb26e9ab9a9dd4b79dd8ae059bceac85c1304418eda"} Jun 03 16:16:35.312189 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.312161 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" event={"ID":"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b","Type":"ContainerStarted","Data":"c1b7d105b91701cb58f93bd66d56309f2e8fafe184a853d764d668d93d0c3bdd"} Jun 03 16:16:35.312189 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.312169 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" event={"ID":"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b","Type":"ContainerStarted","Data":"71b6fd17c92452e5f1e13aede325a6f3989851271a04be085b00e097f3bcf892"} Jun 03 16:16:35.312189 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.312176 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" event={"ID":"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b","Type":"ContainerStarted","Data":"dde26105b02bcc197f8667a30e70c9c988e756bb4f94972bc466f3c8c5881d42"} Jun 03 16:16:35.322813 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:35.322769 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m9g4n" podStartSLOduration=4.773129127 podStartE2EDuration="22.322757296s" podCreationTimestamp="2026-06-03 16:16:13 +0000 UTC" firstStartedPulling="2026-06-03 16:16:15.931802853 +0000 UTC m=+3.373323247" lastFinishedPulling="2026-06-03 16:16:33.481431019 +0000 UTC m=+20.922951416" observedRunningTime="2026-06-03 16:16:35.322543833 +0000 UTC m=+22.764064260" watchObservedRunningTime="2026-06-03 16:16:35.322757296 +0000 UTC m=+22.764277711" Jun 03 16:16:36.047396 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:36.047369 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:36.047639 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:36.047551 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:36.047639 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:36.047630 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret podName:a9ba7a73-fe61-4452-b668-b08d885130ea nodeName:}" failed. No retries permitted until 2026-06-03 16:16:44.047609826 +0000 UTC m=+31.489130222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret") pod "global-pull-secret-syncer-tw5kk" (UID: "a9ba7a73-fe61-4452-b668-b08d885130ea") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:36.140438 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:36.140339 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T16:16:35.19899476Z","UUID":"fb8d743d-28a0-4b14-bad9-485804835d3b","Handler":null,"Name":"","Endpoint":""} Jun 03 16:16:36.142798 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:36.142775 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 16:16:36.142900 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:36.142807 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 16:16:36.206636 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:36.206607 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:36.206789 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:36.206717 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw5kk" podUID="a9ba7a73-fe61-4452-b668-b08d885130ea" Jun 03 16:16:36.318960 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:36.318863 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" event={"ID":"9769144e-c158-45ca-88f7-b6fc3631ac31","Type":"ContainerStarted","Data":"a5555c80e9a1e8c038b51fce77a7edd44898c33a53272944fb0e23c95386d965"} Jun 03 16:16:36.342372 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:36.342177 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-624zw" podStartSLOduration=3.239066337 podStartE2EDuration="23.342165016s" podCreationTimestamp="2026-06-03 16:16:13 +0000 UTC" firstStartedPulling="2026-06-03 16:16:15.930226795 +0000 UTC m=+3.371747199" lastFinishedPulling="2026-06-03 16:16:36.033325277 +0000 UTC m=+23.474845878" observedRunningTime="2026-06-03 16:16:36.341730194 +0000 UTC m=+23.783250610" watchObservedRunningTime="2026-06-03 16:16:36.342165016 +0000 UTC m=+23.783685430" Jun 03 16:16:37.206740 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:37.206704 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:37.206740 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:37.206704 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:37.206957 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:37.206838 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:37.206957 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:37.206941 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:37.323910 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:37.323881 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/ovn-acl-logging/0.log" Jun 03 16:16:37.324483 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:37.324222 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" event={"ID":"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b","Type":"ContainerStarted","Data":"b8472ac0fae0c5f7d3f8474989e06652d24da882a5000b04cae267d5ad503ace"} Jun 03 16:16:38.206425 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:38.206396 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:38.206574 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:38.206514 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw5kk" podUID="a9ba7a73-fe61-4452-b668-b08d885130ea" Jun 03 16:16:39.020973 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:39.020950 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:39.021681 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:39.021667 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:39.206633 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:39.206598 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:39.206633 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:39.206623 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:39.206819 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:39.206739 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:39.206856 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:39.206844 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:39.330523 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:39.330422 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/ovn-acl-logging/0.log" Jun 03 16:16:39.330803 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:39.330783 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" event={"ID":"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b","Type":"ContainerStarted","Data":"93906c1777b86d13c82f468096ee65ad26075d7471a0abca33008377a5f66ba4"} Jun 03 16:16:39.330906 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:39.330891 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:39.331287 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:39.331268 2569 scope.go:117] "RemoveContainer" containerID="725af1c357c1a18e227890b4f68f8c4da6939c9ac67e389b488bb67d78e5fa30" Jun 03 16:16:39.331364 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:39.331302 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vdkm8" Jun 03 16:16:40.206161 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.206120 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:40.206627 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:40.206257 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw5kk" podUID="a9ba7a73-fe61-4452-b668-b08d885130ea" Jun 03 16:16:40.336403 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.336380 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/ovn-acl-logging/0.log" Jun 03 16:16:40.336702 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.336678 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" event={"ID":"bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b","Type":"ContainerStarted","Data":"857860252f3e9cd84b57a17157be068ddbf8b4d60da751e2dc55726e702628a3"} Jun 03 16:16:40.337082 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.337013 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:40.337082 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.337041 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:40.337082 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.337053 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:40.353726 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.353701 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:40.354351 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.354332 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:16:40.372420 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.372372 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" podStartSLOduration=9.388580876 podStartE2EDuration="27.372357792s" podCreationTimestamp="2026-06-03 16:16:13 +0000 UTC" firstStartedPulling="2026-06-03 16:16:15.934667542 +0000 UTC m=+3.376187938" lastFinishedPulling="2026-06-03 16:16:33.918444445 +0000 UTC m=+21.359964854" observedRunningTime="2026-06-03 16:16:40.371484506 +0000 UTC m=+27.813004956" watchObservedRunningTime="2026-06-03 16:16:40.372357792 +0000 UTC m=+27.813878206" Jun 03 16:16:40.984920 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.984884 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tw5kk"] Jun 03 16:16:40.985157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.984997 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:40.985157 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:40.985132 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw5kk" podUID="a9ba7a73-fe61-4452-b668-b08d885130ea" Jun 03 16:16:40.985828 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.985791 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-csjz9"] Jun 03 16:16:40.985959 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.985908 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:40.986121 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:40.985989 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:40.986598 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.986569 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hbskv"] Jun 03 16:16:40.986692 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:40.986680 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:40.986789 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:40.986764 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:42.206816 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:42.206786 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:42.207208 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:42.206787 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:42.207208 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:42.206876 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw5kk" podUID="a9ba7a73-fe61-4452-b668-b08d885130ea" Jun 03 16:16:42.207208 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:42.206947 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:42.341869 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:42.341831 2569 generic.go:358] "Generic (PLEG): container finished" podID="2ce280fa-ee1d-46d1-b433-f490213e54c7" containerID="57409eb035730776b74d71a27e3dda7ee2c950e9f43d4d133576a047d411392f" exitCode=0 Jun 03 16:16:42.342032 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:42.341917 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" event={"ID":"2ce280fa-ee1d-46d1-b433-f490213e54c7","Type":"ContainerDied","Data":"57409eb035730776b74d71a27e3dda7ee2c950e9f43d4d133576a047d411392f"} Jun 03 16:16:43.209471 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:43.209411 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:43.209930 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:43.209612 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:44.105328 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:44.105288 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:44.105480 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:44.105404 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:44.105480 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:44.105467 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret podName:a9ba7a73-fe61-4452-b668-b08d885130ea nodeName:}" failed. No retries permitted until 2026-06-03 16:17:00.105451506 +0000 UTC m=+47.546971899 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret") pod "global-pull-secret-syncer-tw5kk" (UID: "a9ba7a73-fe61-4452-b668-b08d885130ea") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:16:44.206358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:44.206323 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:44.206517 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:44.206323 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:44.206517 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:44.206425 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw5kk" podUID="a9ba7a73-fe61-4452-b668-b08d885130ea" Jun 03 16:16:44.206517 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:44.206495 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:44.348000 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:44.347964 2569 generic.go:358] "Generic (PLEG): container finished" podID="2ce280fa-ee1d-46d1-b433-f490213e54c7" containerID="bbbe781bb85cc84825e21abd02031cdee305ad5a78935c9c08198b711d13ad15" exitCode=0 Jun 03 16:16:44.348618 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:44.348013 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" event={"ID":"2ce280fa-ee1d-46d1-b433-f490213e54c7","Type":"ContainerDied","Data":"bbbe781bb85cc84825e21abd02031cdee305ad5a78935c9c08198b711d13ad15"} Jun 03 16:16:45.205895 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:45.205860 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:45.206079 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:45.205968 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:46.205804 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:46.205755 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:46.206307 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:46.205755 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:46.206307 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:46.205879 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csjz9" podUID="63aed83b-71b8-4721-b0b4-f36beef888a6" Jun 03 16:16:46.206307 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:46.205942 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tw5kk" podUID="a9ba7a73-fe61-4452-b668-b08d885130ea" Jun 03 16:16:46.352937 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:46.352905 2569 generic.go:358] "Generic (PLEG): container finished" podID="2ce280fa-ee1d-46d1-b433-f490213e54c7" containerID="4bd9a7106891232b7aec6ebceeadb3a0166ec02742b1c7aa94e2b38032357ade" exitCode=0 Jun 03 16:16:46.353123 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:46.352966 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" event={"ID":"2ce280fa-ee1d-46d1-b433-f490213e54c7","Type":"ContainerDied","Data":"4bd9a7106891232b7aec6ebceeadb3a0166ec02742b1c7aa94e2b38032357ade"} Jun 03 16:16:46.827865 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:46.827821 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:46.828043 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:46.827975 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:46.828043 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:46.828041 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs podName:26aa42e6-df1e-4d38-abee-815e1408b049 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:18.82802592 +0000 UTC m=+66.269546312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs") pod "network-metrics-daemon-hbskv" (UID: "26aa42e6-df1e-4d38-abee-815e1408b049") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:16:46.928540 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:46.928489 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7p7r\" (UniqueName: \"kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r\") pod \"network-check-target-csjz9\" (UID: \"63aed83b-71b8-4721-b0b4-f36beef888a6\") " pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:46.928704 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:46.928631 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:16:46.928704 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:46.928649 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:16:46.928704 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:46.928658 2569 projected.go:194] Error preparing data for projected volume kube-api-access-c7p7r for pod openshift-network-diagnostics/network-check-target-csjz9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:46.928830 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:46.928716 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r podName:63aed83b-71b8-4721-b0b4-f36beef888a6 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:18.928700268 +0000 UTC m=+66.370220661 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c7p7r" (UniqueName: "kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r") pod "network-check-target-csjz9" (UID: "63aed83b-71b8-4721-b0b4-f36beef888a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:16:47.206257 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.206216 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:47.206747 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:47.206348 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:16:47.888110 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.888028 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-211.ec2.internal" event="NodeReady" Jun 03 16:16:47.888244 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.888162 2569 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 16:16:47.946802 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.946764 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v6hjx"] Jun 03 16:16:47.950607 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.950584 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2ps88"] Jun 03 16:16:47.950791 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.950764 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:47.953919 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.953901 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 16:16:47.954353 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.954333 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:16:47.954672 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.954559 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cxft7\"" Jun 03 16:16:47.954672 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.954648 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 16:16:47.957072 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.957054 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p9nrq\"" Jun 03 16:16:47.957305 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.957289 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 16:16:47.957385 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.957317 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 16:16:47.957385 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.957291 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 16:16:47.966303 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.966272 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v6hjx"] Jun 03 16:16:47.966922 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:47.966901 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2ps88"] Jun 03 16:16:48.037270 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.037231 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.037442 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.037326 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01961575-7bdf-417c-b10d-a616700d00df-tmp-dir\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.037442 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.037359 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01961575-7bdf-417c-b10d-a616700d00df-config-volume\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.037442 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.037381 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bj9m\" (UniqueName: \"kubernetes.io/projected/01961575-7bdf-417c-b10d-a616700d00df-kube-api-access-4bj9m\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.037442 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.037414 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tn6t\" (UniqueName: \"kubernetes.io/projected/939c43c6-27ae-4969-8eaa-756896d744cd-kube-api-access-2tn6t\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:16:48.037601 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.037476 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:16:48.138457 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.138367 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tn6t\" (UniqueName: \"kubernetes.io/projected/939c43c6-27ae-4969-8eaa-756896d744cd-kube-api-access-2tn6t\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:16:48.138457 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.138413 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:16:48.138697 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.138461 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.138697 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.138529 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01961575-7bdf-417c-b10d-a616700d00df-tmp-dir\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.138697 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.138563 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01961575-7bdf-417c-b10d-a616700d00df-config-volume\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.138697 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:48.138571 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:16:48.138697 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.138589 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bj9m\" (UniqueName: \"kubernetes.io/projected/01961575-7bdf-417c-b10d-a616700d00df-kube-api-access-4bj9m\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.138697 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:48.138631 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:16:48.138697 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:48.138644 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert podName:939c43c6-27ae-4969-8eaa-756896d744cd nodeName:}" failed. No retries permitted until 2026-06-03 16:16:48.638622068 +0000 UTC m=+36.080142469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert") pod "ingress-canary-2ps88" (UID: "939c43c6-27ae-4969-8eaa-756896d744cd") : secret "canary-serving-cert" not found Jun 03 16:16:48.138697 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:48.138686 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls podName:01961575-7bdf-417c-b10d-a616700d00df nodeName:}" failed. No retries permitted until 2026-06-03 16:16:48.638668982 +0000 UTC m=+36.080189394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls") pod "dns-default-v6hjx" (UID: "01961575-7bdf-417c-b10d-a616700d00df") : secret "dns-default-metrics-tls" not found Jun 03 16:16:48.139153 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.138860 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01961575-7bdf-417c-b10d-a616700d00df-tmp-dir\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.139367 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.139345 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01961575-7bdf-417c-b10d-a616700d00df-config-volume\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.152993 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.152969 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bj9m\" (UniqueName: \"kubernetes.io/projected/01961575-7bdf-417c-b10d-a616700d00df-kube-api-access-4bj9m\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.153203 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.153179 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tn6t\" (UniqueName: \"kubernetes.io/projected/939c43c6-27ae-4969-8eaa-756896d744cd-kube-api-access-2tn6t\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:16:48.206826 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.206782 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:16:48.207318 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.206786 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:16:48.211789 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.211757 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fp5cx\"" Jun 03 16:16:48.211917 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.211820 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 16:16:48.212016 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.212002 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 16:16:48.212068 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.212016 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 16:16:48.642762 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.642548 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:16:48.642953 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:48.642803 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:48.642953 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:48.642706 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:16:48.642953 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:48.642882 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert podName:939c43c6-27ae-4969-8eaa-756896d744cd nodeName:}" failed. No retries permitted until 2026-06-03 16:16:49.64286687 +0000 UTC m=+37.084387264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert") pod "ingress-canary-2ps88" (UID: "939c43c6-27ae-4969-8eaa-756896d744cd") : secret "canary-serving-cert" not found Jun 03 16:16:48.642953 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:48.642945 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:16:48.643176 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:48.643015 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls podName:01961575-7bdf-417c-b10d-a616700d00df nodeName:}" failed. No retries permitted until 2026-06-03 16:16:49.642998103 +0000 UTC m=+37.084518507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls") pod "dns-default-v6hjx" (UID: "01961575-7bdf-417c-b10d-a616700d00df") : secret "dns-default-metrics-tls" not found Jun 03 16:16:49.206189 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:49.206155 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:16:49.209897 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:49.209875 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 16:16:49.210232 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:49.209875 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fw46v\"" Jun 03 16:16:49.650331 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:49.650290 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:16:49.650507 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:49.650357 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:49.650507 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:49.650458 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:16:49.650623 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:49.650527 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert podName:939c43c6-27ae-4969-8eaa-756896d744cd nodeName:}" failed. No retries permitted until 2026-06-03 16:16:51.650509936 +0000 UTC m=+39.092030350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert") pod "ingress-canary-2ps88" (UID: "939c43c6-27ae-4969-8eaa-756896d744cd") : secret "canary-serving-cert" not found Jun 03 16:16:49.650623 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:49.650468 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:16:49.650623 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:49.650590 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls podName:01961575-7bdf-417c-b10d-a616700d00df nodeName:}" failed. No retries permitted until 2026-06-03 16:16:51.650578273 +0000 UTC m=+39.092098670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls") pod "dns-default-v6hjx" (UID: "01961575-7bdf-417c-b10d-a616700d00df") : secret "dns-default-metrics-tls" not found Jun 03 16:16:51.667174 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:51.667136 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:16:51.667577 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:51.667203 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:51.667577 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:51.667308 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:16:51.667577 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:51.667387 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls podName:01961575-7bdf-417c-b10d-a616700d00df nodeName:}" failed. No retries permitted until 2026-06-03 16:16:55.66736662 +0000 UTC m=+43.108887016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls") pod "dns-default-v6hjx" (UID: "01961575-7bdf-417c-b10d-a616700d00df") : secret "dns-default-metrics-tls" not found Jun 03 16:16:51.667577 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:51.667308 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:16:51.667577 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:51.667476 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert podName:939c43c6-27ae-4969-8eaa-756896d744cd nodeName:}" failed. No retries permitted until 2026-06-03 16:16:55.667455653 +0000 UTC m=+43.108976057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert") pod "ingress-canary-2ps88" (UID: "939c43c6-27ae-4969-8eaa-756896d744cd") : secret "canary-serving-cert" not found Jun 03 16:16:54.370134 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:54.370083 2569 generic.go:358] "Generic (PLEG): container finished" podID="2ce280fa-ee1d-46d1-b433-f490213e54c7" containerID="3eaef8fc37dda30e562dfe08ec9eeb73fefa23fefcb5b054219ee8b78c09a298" exitCode=0 Jun 03 16:16:54.370481 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:54.370155 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" event={"ID":"2ce280fa-ee1d-46d1-b433-f490213e54c7","Type":"ContainerDied","Data":"3eaef8fc37dda30e562dfe08ec9eeb73fefa23fefcb5b054219ee8b78c09a298"} Jun 03 16:16:55.374945 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:55.374907 2569 generic.go:358] "Generic (PLEG): container finished" podID="2ce280fa-ee1d-46d1-b433-f490213e54c7" containerID="42c3fc896989c0065cc0a8d07d241e982aa148a912d6eeb8733492fb8595a280" exitCode=0 Jun 03 16:16:55.374945 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:55.374949 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" event={"ID":"2ce280fa-ee1d-46d1-b433-f490213e54c7","Type":"ContainerDied","Data":"42c3fc896989c0065cc0a8d07d241e982aa148a912d6eeb8733492fb8595a280"} Jun 03 16:16:55.699658 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:55.699625 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:16:55.699860 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:55.699682 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:16:55.699860 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:55.699804 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:16:55.699960 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:55.699881 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert podName:939c43c6-27ae-4969-8eaa-756896d744cd nodeName:}" failed. No retries permitted until 2026-06-03 16:17:03.699861255 +0000 UTC m=+51.141381651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert") pod "ingress-canary-2ps88" (UID: "939c43c6-27ae-4969-8eaa-756896d744cd") : secret "canary-serving-cert" not found Jun 03 16:16:55.699960 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:55.699897 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:16:55.699960 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:16:55.699955 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls podName:01961575-7bdf-417c-b10d-a616700d00df nodeName:}" failed. No retries permitted until 2026-06-03 16:17:03.699939925 +0000 UTC m=+51.141460319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls") pod "dns-default-v6hjx" (UID: "01961575-7bdf-417c-b10d-a616700d00df") : secret "dns-default-metrics-tls" not found Jun 03 16:16:56.379553 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:56.379521 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" event={"ID":"2ce280fa-ee1d-46d1-b433-f490213e54c7","Type":"ContainerStarted","Data":"1ba65a84a37590daa4ef7b83fa810a4dda032fa8d91ef5f6efcb31183f320cdd"} Jun 03 16:16:56.409983 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:56.409935 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cxfnf" podStartSLOduration=5.87019167 podStartE2EDuration="43.409920944s" podCreationTimestamp="2026-06-03 16:16:13 +0000 UTC" firstStartedPulling="2026-06-03 16:16:15.923578912 +0000 UTC m=+3.365099331" lastFinishedPulling="2026-06-03 16:16:53.463308209 +0000 UTC m=+40.904828605" observedRunningTime="2026-06-03 16:16:56.408282362 +0000 UTC m=+43.849802777" watchObservedRunningTime="2026-06-03 16:16:56.409920944 +0000 UTC m=+43.851441358" Jun 03 16:16:58.773592 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.773556 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24"] Jun 03 16:16:58.786725 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.786699 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" Jun 03 16:16:58.805752 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.805721 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 16:16:58.805752 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.805744 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qvs79\"" Jun 03 16:16:58.812257 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.812226 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 16:16:58.812866 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.812849 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 16:16:58.821131 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.821082 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 16:16:58.825303 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.825281 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24"] Jun 03 16:16:58.880607 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.880569 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv"] Jun 03 16:16:58.896604 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.896575 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:58.902278 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.902187 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 16:16:58.902585 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.902564 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 16:16:58.902859 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.902839 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 16:16:58.903537 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.903520 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 16:16:58.921941 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.921907 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5q27\" (UniqueName: \"kubernetes.io/projected/826241e7-3931-4769-bdba-0e53c7373bea-kube-api-access-h5q27\") pod \"managed-serviceaccount-addon-agent-f5fc8547d-gww24\" (UID: \"826241e7-3931-4769-bdba-0e53c7373bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" Jun 03 16:16:58.922076 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:58.922054 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/826241e7-3931-4769-bdba-0e53c7373bea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f5fc8547d-gww24\" (UID: \"826241e7-3931-4769-bdba-0e53c7373bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" Jun 03 16:16:59.014136 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.014082 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv"] Jun 03 16:16:59.022526 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.022495 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-hub\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.022660 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.022543 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.022660 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.022575 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/826241e7-3931-4769-bdba-0e53c7373bea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f5fc8547d-gww24\" (UID: \"826241e7-3931-4769-bdba-0e53c7373bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" Jun 03 16:16:59.022660 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.022594 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5q27\" (UniqueName: \"kubernetes.io/projected/826241e7-3931-4769-bdba-0e53c7373bea-kube-api-access-h5q27\") pod \"managed-serviceaccount-addon-agent-f5fc8547d-gww24\" (UID: \"826241e7-3931-4769-bdba-0e53c7373bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" Jun 03 16:16:59.022660 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.022613 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8e319069-2670-415d-8b73-125d3f89cc1a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.022660 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.022636 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2ptn\" (UniqueName: \"kubernetes.io/projected/8e319069-2670-415d-8b73-125d3f89cc1a-kube-api-access-v2ptn\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.022901 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.022709 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.022901 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.022803 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-ca\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.025866 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.025808 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/826241e7-3931-4769-bdba-0e53c7373bea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f5fc8547d-gww24\" (UID: \"826241e7-3931-4769-bdba-0e53c7373bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" Jun 03 16:16:59.039433 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.039406 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5q27\" (UniqueName: \"kubernetes.io/projected/826241e7-3931-4769-bdba-0e53c7373bea-kube-api-access-h5q27\") pod \"managed-serviceaccount-addon-agent-f5fc8547d-gww24\" (UID: \"826241e7-3931-4769-bdba-0e53c7373bea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" Jun 03 16:16:59.105830 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.105789 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" Jun 03 16:16:59.123930 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.123899 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-ca\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.123930 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.123936 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-hub\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.124172 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.124070 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.124172 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.124136 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8e319069-2670-415d-8b73-125d3f89cc1a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.124172 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.124156 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2ptn\" (UniqueName: \"kubernetes.io/projected/8e319069-2670-415d-8b73-125d3f89cc1a-kube-api-access-v2ptn\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.124326 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.124192 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.125079 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.125049 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8e319069-2670-415d-8b73-125d3f89cc1a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.126747 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.126720 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.126885 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.126868 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.126961 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.126881 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-hub\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.126961 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.126902 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8e319069-2670-415d-8b73-125d3f89cc1a-ca\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.139055 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.139025 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2ptn\" (UniqueName: \"kubernetes.io/projected/8e319069-2670-415d-8b73-125d3f89cc1a-kube-api-access-v2ptn\") pod \"cluster-proxy-proxy-agent-78d455f4bd-zcmlv\" (UID: \"8e319069-2670-415d-8b73-125d3f89cc1a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.205310 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.205277 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:16:59.289428 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.289400 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24"] Jun 03 16:16:59.292170 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:59.292139 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod826241e7_3931_4769_bdba_0e53c7373bea.slice/crio-e1e2ae332bb7aa06cb004b68d75d2e0b3d10ba3045037f9216c0f8c04ae37157 WatchSource:0}: Error finding container e1e2ae332bb7aa06cb004b68d75d2e0b3d10ba3045037f9216c0f8c04ae37157: Status 404 returned error can't find the container with id e1e2ae332bb7aa06cb004b68d75d2e0b3d10ba3045037f9216c0f8c04ae37157 Jun 03 16:16:59.354899 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.354863 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv"] Jun 03 16:16:59.357383 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:16:59.357359 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e319069_2670_415d_8b73_125d3f89cc1a.slice/crio-f1dc419b0fa3b17ec472c674a85fa17a833cb62398a45483ef405f0b4c1377a7 WatchSource:0}: Error finding container f1dc419b0fa3b17ec472c674a85fa17a833cb62398a45483ef405f0b4c1377a7: Status 404 returned error can't find the container with id f1dc419b0fa3b17ec472c674a85fa17a833cb62398a45483ef405f0b4c1377a7 Jun 03 16:16:59.385986 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.385940 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" event={"ID":"8e319069-2670-415d-8b73-125d3f89cc1a","Type":"ContainerStarted","Data":"f1dc419b0fa3b17ec472c674a85fa17a833cb62398a45483ef405f0b4c1377a7"} Jun 03 16:16:59.386839 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:16:59.386818 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" event={"ID":"826241e7-3931-4769-bdba-0e53c7373bea","Type":"ContainerStarted","Data":"e1e2ae332bb7aa06cb004b68d75d2e0b3d10ba3045037f9216c0f8c04ae37157"} Jun 03 16:17:00.132013 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:00.131971 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:17:00.135043 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:00.135008 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9ba7a73-fe61-4452-b668-b08d885130ea-original-pull-secret\") pod \"global-pull-secret-syncer-tw5kk\" (UID: \"a9ba7a73-fe61-4452-b668-b08d885130ea\") " pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:17:00.216931 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:00.216546 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tw5kk" Jun 03 16:17:00.407702 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:00.407641 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tw5kk"] Jun 03 16:17:00.413267 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:17:00.413220 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ba7a73_fe61_4452_b668_b08d885130ea.slice/crio-133d02af719daab0f9cb072ca39076031300adc4d330c98fecfb8d17813ae5fd WatchSource:0}: Error finding container 133d02af719daab0f9cb072ca39076031300adc4d330c98fecfb8d17813ae5fd: Status 404 returned error can't find the container with id 133d02af719daab0f9cb072ca39076031300adc4d330c98fecfb8d17813ae5fd Jun 03 16:17:01.393280 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:01.393236 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tw5kk" event={"ID":"a9ba7a73-fe61-4452-b668-b08d885130ea","Type":"ContainerStarted","Data":"133d02af719daab0f9cb072ca39076031300adc4d330c98fecfb8d17813ae5fd"} Jun 03 16:17:03.762859 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:03.762814 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:17:03.763404 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:03.762913 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:17:03.763404 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:03.762992 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:17:03.763404 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:03.763007 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:17:03.763404 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:03.763080 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert podName:939c43c6-27ae-4969-8eaa-756896d744cd nodeName:}" failed. No retries permitted until 2026-06-03 16:17:19.763059133 +0000 UTC m=+67.204579537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert") pod "ingress-canary-2ps88" (UID: "939c43c6-27ae-4969-8eaa-756896d744cd") : secret "canary-serving-cert" not found Jun 03 16:17:03.763404 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:03.763112 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls podName:01961575-7bdf-417c-b10d-a616700d00df nodeName:}" failed. No retries permitted until 2026-06-03 16:17:19.763089774 +0000 UTC m=+67.204610166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls") pod "dns-default-v6hjx" (UID: "01961575-7bdf-417c-b10d-a616700d00df") : secret "dns-default-metrics-tls" not found Jun 03 16:17:06.404265 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:06.404227 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" event={"ID":"8e319069-2670-415d-8b73-125d3f89cc1a","Type":"ContainerStarted","Data":"07ad99b8f581996adc062d994e6bd315c6e0068f0eb8c6ab56733dd44a8ab6cd"} Jun 03 16:17:06.405406 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:06.405370 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" event={"ID":"826241e7-3931-4769-bdba-0e53c7373bea","Type":"ContainerStarted","Data":"3688d7274b2b83b1df6e4f4168b5c8149387f262fd0b05642c91f4bf99a4456b"} Jun 03 16:17:06.406568 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:06.406543 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tw5kk" event={"ID":"a9ba7a73-fe61-4452-b668-b08d885130ea","Type":"ContainerStarted","Data":"d7a4758c68f47e08102bd5061374fbdd46ae8111ff1944cb176462d42260a66b"} Jun 03 16:17:06.427293 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:06.427242 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" podStartSLOduration=1.9021680189999999 podStartE2EDuration="8.427230863s" podCreationTimestamp="2026-06-03 16:16:58 +0000 UTC" firstStartedPulling="2026-06-03 16:16:59.29451962 +0000 UTC m=+46.736040013" lastFinishedPulling="2026-06-03 16:17:05.819582453 +0000 UTC m=+53.261102857" observedRunningTime="2026-06-03 16:17:06.42684986 +0000 UTC m=+53.868370274" watchObservedRunningTime="2026-06-03 16:17:06.427230863 +0000 UTC m=+53.868751277" Jun 03 16:17:06.445840 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:06.445788 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tw5kk" podStartSLOduration=32.997342989 podStartE2EDuration="38.44577277s" podCreationTimestamp="2026-06-03 16:16:28 +0000 UTC" firstStartedPulling="2026-06-03 16:17:00.416383744 +0000 UTC m=+47.857904151" lastFinishedPulling="2026-06-03 16:17:05.864813534 +0000 UTC m=+53.306333932" observedRunningTime="2026-06-03 16:17:06.445234187 +0000 UTC m=+53.886754602" watchObservedRunningTime="2026-06-03 16:17:06.44577277 +0000 UTC m=+53.887293185" Jun 03 16:17:09.414955 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:09.414915 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" event={"ID":"8e319069-2670-415d-8b73-125d3f89cc1a","Type":"ContainerStarted","Data":"f94bf030cce0463e5c6e5cc861d6512e2e9951782f0a1ea1d85c4ec2adeb148c"} Jun 03 16:17:09.414955 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:09.414951 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" event={"ID":"8e319069-2670-415d-8b73-125d3f89cc1a","Type":"ContainerStarted","Data":"e4c16e067c9fa896a3f04b5ab77b941acfa69e5447b847e2bf33e166e5659d1a"} Jun 03 16:17:09.442531 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:09.442467 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" podStartSLOduration=1.5638117519999999 podStartE2EDuration="11.44245027s" podCreationTimestamp="2026-06-03 16:16:58 +0000 UTC" firstStartedPulling="2026-06-03 16:16:59.359082366 +0000 UTC m=+46.800602762" lastFinishedPulling="2026-06-03 16:17:09.237720887 +0000 UTC m=+56.679241280" observedRunningTime="2026-06-03 16:17:09.442250998 +0000 UTC m=+56.883771414" watchObservedRunningTime="2026-06-03 16:17:09.44245027 +0000 UTC m=+56.883970699" Jun 03 16:17:12.352077 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:12.352046 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gmxxc" Jun 03 16:17:18.874108 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:18.874056 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:17:18.877443 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:18.877425 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 16:17:18.885069 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:18.885053 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 16:17:18.885140 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:18.885126 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs podName:26aa42e6-df1e-4d38-abee-815e1408b049 nodeName:}" failed. No retries permitted until 2026-06-03 16:18:22.885107688 +0000 UTC m=+130.326628094 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs") pod "network-metrics-daemon-hbskv" (UID: "26aa42e6-df1e-4d38-abee-815e1408b049") : secret "metrics-daemon-secret" not found Jun 03 16:17:18.974811 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:18.974761 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7p7r\" (UniqueName: \"kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r\") pod \"network-check-target-csjz9\" (UID: \"63aed83b-71b8-4721-b0b4-f36beef888a6\") " pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:17:18.978134 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:18.978117 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 16:17:18.988305 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:18.988279 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 16:17:18.999319 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:18.999289 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7p7r\" (UniqueName: \"kubernetes.io/projected/63aed83b-71b8-4721-b0b4-f36beef888a6-kube-api-access-c7p7r\") pod \"network-check-target-csjz9\" (UID: \"63aed83b-71b8-4721-b0b4-f36beef888a6\") " pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:17:19.125047 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:19.124966 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fp5cx\"" Jun 03 16:17:19.131887 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:19.131869 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:17:19.252799 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:19.252768 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-csjz9"] Jun 03 16:17:19.255872 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:17:19.255846 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63aed83b_71b8_4721_b0b4_f36beef888a6.slice/crio-2b34f68bd99239bac5673767802798c170026a91e54bbdcc01bdde076f59b773 WatchSource:0}: Error finding container 2b34f68bd99239bac5673767802798c170026a91e54bbdcc01bdde076f59b773: Status 404 returned error can't find the container with id 2b34f68bd99239bac5673767802798c170026a91e54bbdcc01bdde076f59b773 Jun 03 16:17:19.434845 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:19.434806 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-csjz9" event={"ID":"63aed83b-71b8-4721-b0b4-f36beef888a6","Type":"ContainerStarted","Data":"2b34f68bd99239bac5673767802798c170026a91e54bbdcc01bdde076f59b773"} Jun 03 16:17:19.780453 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:19.780365 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:17:19.780453 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:19.780425 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:17:19.780691 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:19.780542 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:17:19.780691 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:19.780546 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:17:19.780691 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:19.780605 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls podName:01961575-7bdf-417c-b10d-a616700d00df nodeName:}" failed. No retries permitted until 2026-06-03 16:17:51.780588014 +0000 UTC m=+99.222108440 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls") pod "dns-default-v6hjx" (UID: "01961575-7bdf-417c-b10d-a616700d00df") : secret "dns-default-metrics-tls" not found Jun 03 16:17:19.780691 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:19.780619 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert podName:939c43c6-27ae-4969-8eaa-756896d744cd nodeName:}" failed. No retries permitted until 2026-06-03 16:17:51.780613219 +0000 UTC m=+99.222133613 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert") pod "ingress-canary-2ps88" (UID: "939c43c6-27ae-4969-8eaa-756896d744cd") : secret "canary-serving-cert" not found Jun 03 16:17:23.443227 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:23.443190 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-csjz9" event={"ID":"63aed83b-71b8-4721-b0b4-f36beef888a6","Type":"ContainerStarted","Data":"60af2e28f016e376aa7ffefffcbe730f177b1ffea75b6ed5ef4f0a3944e18e8c"} Jun 03 16:17:23.443653 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:23.443329 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:17:23.467045 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:23.467004 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-csjz9" podStartSLOduration=67.254555155 podStartE2EDuration="1m10.466991673s" podCreationTimestamp="2026-06-03 16:16:13 +0000 UTC" firstStartedPulling="2026-06-03 16:17:19.257711484 +0000 UTC m=+66.699231876" lastFinishedPulling="2026-06-03 16:17:22.470148001 +0000 UTC m=+69.911668394" observedRunningTime="2026-06-03 16:17:23.466353324 +0000 UTC m=+70.907873739" watchObservedRunningTime="2026-06-03 16:17:23.466991673 +0000 UTC m=+70.908512084" Jun 03 16:17:51.804051 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:51.804015 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:17:51.804506 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:51.804065 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:17:51.804506 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:51.804197 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:17:51.804506 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:51.804287 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls podName:01961575-7bdf-417c-b10d-a616700d00df nodeName:}" failed. No retries permitted until 2026-06-03 16:18:55.804269699 +0000 UTC m=+163.245790092 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls") pod "dns-default-v6hjx" (UID: "01961575-7bdf-417c-b10d-a616700d00df") : secret "dns-default-metrics-tls" not found Jun 03 16:17:51.804506 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:51.804196 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:17:51.804506 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:17:51.804348 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert podName:939c43c6-27ae-4969-8eaa-756896d744cd nodeName:}" failed. No retries permitted until 2026-06-03 16:18:55.804337523 +0000 UTC m=+163.245857932 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert") pod "ingress-canary-2ps88" (UID: "939c43c6-27ae-4969-8eaa-756896d744cd") : secret "canary-serving-cert" not found Jun 03 16:17:54.448786 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:17:54.448755 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-csjz9" Jun 03 16:18:22.913461 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:18:22.913420 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:18:22.913935 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:18:22.913549 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 16:18:22.913935 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:18:22.913610 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs podName:26aa42e6-df1e-4d38-abee-815e1408b049 nodeName:}" failed. No retries permitted until 2026-06-03 16:20:24.913596278 +0000 UTC m=+252.355116671 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs") pod "network-metrics-daemon-hbskv" (UID: "26aa42e6-df1e-4d38-abee-815e1408b049") : secret "metrics-daemon-secret" not found Jun 03 16:18:50.968462 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:18:50.968421 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v6hjx" podUID="01961575-7bdf-417c-b10d-a616700d00df" Jun 03 16:18:50.974599 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:18:50.974568 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-2ps88" podUID="939c43c6-27ae-4969-8eaa-756896d744cd" Jun 03 16:18:51.590039 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:18:51.590012 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qjc7p_62d94987-c995-4436-a994-94fbbd06166d/dns-node-resolver/0.log" Jun 03 16:18:51.650253 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:18:51.650220 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:18:51.650413 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:18:51.650220 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v6hjx" Jun 03 16:18:52.215409 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:18:52.215357 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hbskv" podUID="26aa42e6-df1e-4d38-abee-815e1408b049" Jun 03 16:18:52.582951 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:18:52.582872 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qg52k_153ff263-c2c3-45a0-901a-a616452d6a1f/node-ca/0.log" Jun 03 16:18:55.840234 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:18:55.840187 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:18:55.840234 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:18:55.840243 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:18:55.840681 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:18:55.840331 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:18:55.840681 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:18:55.840389 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls podName:01961575-7bdf-417c-b10d-a616700d00df nodeName:}" failed. No retries permitted until 2026-06-03 16:20:57.840375266 +0000 UTC m=+285.281895658 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls") pod "dns-default-v6hjx" (UID: "01961575-7bdf-417c-b10d-a616700d00df") : secret "dns-default-metrics-tls" not found Jun 03 16:18:55.840681 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:18:55.840333 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:18:55.840681 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:18:55.840418 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert podName:939c43c6-27ae-4969-8eaa-756896d744cd nodeName:}" failed. No retries permitted until 2026-06-03 16:20:57.84041118 +0000 UTC m=+285.281931572 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert") pod "ingress-canary-2ps88" (UID: "939c43c6-27ae-4969-8eaa-756896d744cd") : secret "canary-serving-cert" not found Jun 03 16:19:03.208337 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:03.208240 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:19:06.689897 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:06.689862 2569 generic.go:358] "Generic (PLEG): container finished" podID="826241e7-3931-4769-bdba-0e53c7373bea" containerID="3688d7274b2b83b1df6e4f4168b5c8149387f262fd0b05642c91f4bf99a4456b" exitCode=255 Jun 03 16:19:06.690291 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:06.689929 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" event={"ID":"826241e7-3931-4769-bdba-0e53c7373bea","Type":"ContainerDied","Data":"3688d7274b2b83b1df6e4f4168b5c8149387f262fd0b05642c91f4bf99a4456b"} Jun 03 16:19:06.690291 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:06.690238 2569 scope.go:117] "RemoveContainer" containerID="3688d7274b2b83b1df6e4f4168b5c8149387f262fd0b05642c91f4bf99a4456b" Jun 03 16:19:07.693410 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:07.693372 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5fc8547d-gww24" event={"ID":"826241e7-3931-4769-bdba-0e53c7373bea","Type":"ContainerStarted","Data":"3e19641c529b7fc1aeeeeb8d43110107fb02bce4af0031effa7cae7ad9096956"} Jun 03 16:19:14.128338 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.128299 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bpdpj"] Jun 03 16:19:14.131395 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.131379 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.140301 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.140276 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9spkz\"" Jun 03 16:19:14.140423 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.140277 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 16:19:14.140423 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.140277 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 16:19:14.140423 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.140277 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 16:19:14.140587 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.140277 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 16:19:14.151804 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.151777 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bpdpj"] Jun 03 16:19:14.176234 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.176200 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27eed75d-ab8c-4f87-8fb9-ace3986958d9-crio-socket\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.176234 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.176233 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27eed75d-ab8c-4f87-8fb9-ace3986958d9-data-volume\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.176428 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.176262 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmlmk\" (UniqueName: \"kubernetes.io/projected/27eed75d-ab8c-4f87-8fb9-ace3986958d9-kube-api-access-hmlmk\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.176428 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.176302 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27eed75d-ab8c-4f87-8fb9-ace3986958d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.176428 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.176321 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27eed75d-ab8c-4f87-8fb9-ace3986958d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.235625 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.235594 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b6fd766df-rgxsd"] Jun 03 16:19:14.238314 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.238298 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.243027 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.243006 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 16:19:14.243168 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.243029 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xs4qn\"" Jun 03 16:19:14.243168 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.243068 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 16:19:14.243168 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.243120 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 16:19:14.257157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.257132 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 16:19:14.262534 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.262506 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b6fd766df-rgxsd"] Jun 03 16:19:14.276826 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.276798 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5df0594-d8c7-4c46-9082-6ff481c8d85a-bound-sa-token\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.276959 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.276835 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27eed75d-ab8c-4f87-8fb9-ace3986958d9-crio-socket\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.276959 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.276915 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27eed75d-ab8c-4f87-8fb9-ace3986958d9-crio-socket\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.277032 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.276957 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5df0594-d8c7-4c46-9082-6ff481c8d85a-installation-pull-secrets\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.277032 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.276993 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5df0594-d8c7-4c46-9082-6ff481c8d85a-trusted-ca\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.277032 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.277024 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5df0594-d8c7-4c46-9082-6ff481c8d85a-image-registry-private-configuration\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.277143 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.277057 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27eed75d-ab8c-4f87-8fb9-ace3986958d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.277143 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.277101 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27eed75d-ab8c-4f87-8fb9-ace3986958d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.277234 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.277211 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5df0594-d8c7-4c46-9082-6ff481c8d85a-registry-certificates\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.277275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.277262 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5df0594-d8c7-4c46-9082-6ff481c8d85a-ca-trust-extracted\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.277320 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.277289 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5df0594-d8c7-4c46-9082-6ff481c8d85a-registry-tls\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.277398 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.277379 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27eed75d-ab8c-4f87-8fb9-ace3986958d9-data-volume\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.277457 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.277437 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmlmk\" (UniqueName: \"kubernetes.io/projected/27eed75d-ab8c-4f87-8fb9-ace3986958d9-kube-api-access-hmlmk\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.277506 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.277491 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8skl\" (UniqueName: \"kubernetes.io/projected/f5df0594-d8c7-4c46-9082-6ff481c8d85a-kube-api-access-z8skl\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.277659 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.277641 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27eed75d-ab8c-4f87-8fb9-ace3986958d9-data-volume\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.277710 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.277655 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27eed75d-ab8c-4f87-8fb9-ace3986958d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.279449 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.279427 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27eed75d-ab8c-4f87-8fb9-ace3986958d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.309112 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.309059 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmlmk\" (UniqueName: \"kubernetes.io/projected/27eed75d-ab8c-4f87-8fb9-ace3986958d9-kube-api-access-hmlmk\") pod \"insights-runtime-extractor-bpdpj\" (UID: \"27eed75d-ab8c-4f87-8fb9-ace3986958d9\") " pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.378310 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.378272 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8skl\" (UniqueName: \"kubernetes.io/projected/f5df0594-d8c7-4c46-9082-6ff481c8d85a-kube-api-access-z8skl\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.378511 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.378316 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5df0594-d8c7-4c46-9082-6ff481c8d85a-bound-sa-token\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.378511 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.378348 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5df0594-d8c7-4c46-9082-6ff481c8d85a-installation-pull-secrets\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.378511 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.378376 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5df0594-d8c7-4c46-9082-6ff481c8d85a-trusted-ca\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.378511 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.378412 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5df0594-d8c7-4c46-9082-6ff481c8d85a-image-registry-private-configuration\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.378511 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.378466 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5df0594-d8c7-4c46-9082-6ff481c8d85a-registry-certificates\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.378511 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.378498 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5df0594-d8c7-4c46-9082-6ff481c8d85a-ca-trust-extracted\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.378796 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.378523 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5df0594-d8c7-4c46-9082-6ff481c8d85a-registry-tls\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.378995 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.378972 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5df0594-d8c7-4c46-9082-6ff481c8d85a-ca-trust-extracted\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.379416 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.379395 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5df0594-d8c7-4c46-9082-6ff481c8d85a-registry-certificates\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.379742 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.379720 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5df0594-d8c7-4c46-9082-6ff481c8d85a-trusted-ca\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.380791 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.380771 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5df0594-d8c7-4c46-9082-6ff481c8d85a-installation-pull-secrets\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.380870 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.380851 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5df0594-d8c7-4c46-9082-6ff481c8d85a-registry-tls\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.381020 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.381000 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5df0594-d8c7-4c46-9082-6ff481c8d85a-image-registry-private-configuration\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.395382 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.395355 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5df0594-d8c7-4c46-9082-6ff481c8d85a-bound-sa-token\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.395515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.395427 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8skl\" (UniqueName: \"kubernetes.io/projected/f5df0594-d8c7-4c46-9082-6ff481c8d85a-kube-api-access-z8skl\") pod \"image-registry-b6fd766df-rgxsd\" (UID: \"f5df0594-d8c7-4c46-9082-6ff481c8d85a\") " pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.439812 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.439774 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bpdpj" Jun 03 16:19:14.547355 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.547325 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:14.571639 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.571606 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bpdpj"] Jun 03 16:19:14.575168 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:19:14.575133 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27eed75d_ab8c_4f87_8fb9_ace3986958d9.slice/crio-fae7a43b0c35d97b7dcd3b5a33da7529f51110483ddcc6b70a585454c2c8a238 WatchSource:0}: Error finding container fae7a43b0c35d97b7dcd3b5a33da7529f51110483ddcc6b70a585454c2c8a238: Status 404 returned error can't find the container with id fae7a43b0c35d97b7dcd3b5a33da7529f51110483ddcc6b70a585454c2c8a238 Jun 03 16:19:14.696475 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.696443 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b6fd766df-rgxsd"] Jun 03 16:19:14.699285 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:19:14.699257 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5df0594_d8c7_4c46_9082_6ff481c8d85a.slice/crio-5281ca775a3ba3ae72a8c3f329af7864f92ee386976287149552c746405c9582 WatchSource:0}: Error finding container 5281ca775a3ba3ae72a8c3f329af7864f92ee386976287149552c746405c9582: Status 404 returned error can't find the container with id 5281ca775a3ba3ae72a8c3f329af7864f92ee386976287149552c746405c9582 Jun 03 16:19:14.711130 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.711076 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bpdpj" event={"ID":"27eed75d-ab8c-4f87-8fb9-ace3986958d9","Type":"ContainerStarted","Data":"608b9d13b4cf2db29b4cc309c9cd5c0398bb01f285b6464bce52f8f4f9d500e9"} Jun 03 16:19:14.711224 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.711138 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bpdpj" event={"ID":"27eed75d-ab8c-4f87-8fb9-ace3986958d9","Type":"ContainerStarted","Data":"fae7a43b0c35d97b7dcd3b5a33da7529f51110483ddcc6b70a585454c2c8a238"} Jun 03 16:19:14.711979 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:14.711960 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" event={"ID":"f5df0594-d8c7-4c46-9082-6ff481c8d85a","Type":"ContainerStarted","Data":"5281ca775a3ba3ae72a8c3f329af7864f92ee386976287149552c746405c9582"} Jun 03 16:19:15.715804 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:15.715773 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bpdpj" event={"ID":"27eed75d-ab8c-4f87-8fb9-ace3986958d9","Type":"ContainerStarted","Data":"300d8463a1952cf4623ffa79ebd3b77c7fa29525cfcfe8a1a176c1074d6cca30"} Jun 03 16:19:15.717398 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:15.717370 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" event={"ID":"f5df0594-d8c7-4c46-9082-6ff481c8d85a","Type":"ContainerStarted","Data":"f9b150995ad9c46e19f48726f17c64911ba5f55451bfd3e047cd6357c5d67894"} Jun 03 16:19:15.717523 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:15.717504 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:15.741958 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:15.741912 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" podStartSLOduration=1.7418995659999998 podStartE2EDuration="1.741899566s" podCreationTimestamp="2026-06-03 16:19:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:19:15.740937622 +0000 UTC m=+183.182458037" watchObservedRunningTime="2026-06-03 16:19:15.741899566 +0000 UTC m=+183.183419980" Jun 03 16:19:17.723933 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:17.723890 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bpdpj" event={"ID":"27eed75d-ab8c-4f87-8fb9-ace3986958d9","Type":"ContainerStarted","Data":"37e1d94cb5b49e00343214e86c8503e90b568fb23fea233d6ff3f2297625d6a5"} Jun 03 16:19:17.753078 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:17.753028 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bpdpj" podStartSLOduration=1.475897138 podStartE2EDuration="3.753014885s" podCreationTimestamp="2026-06-03 16:19:14 +0000 UTC" firstStartedPulling="2026-06-03 16:19:14.649166356 +0000 UTC m=+182.090686757" lastFinishedPulling="2026-06-03 16:19:16.926284103 +0000 UTC m=+184.367804504" observedRunningTime="2026-06-03 16:19:17.751808308 +0000 UTC m=+185.193328723" watchObservedRunningTime="2026-06-03 16:19:17.753014885 +0000 UTC m=+185.194535329" Jun 03 16:19:28.304405 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.304367 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-87cdn"] Jun 03 16:19:28.307279 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.307261 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.310032 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.310007 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lbsld\"" Jun 03 16:19:28.310164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.310046 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 16:19:28.310164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.310121 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 16:19:28.310164 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.310157 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 16:19:28.310324 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.310191 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 16:19:28.310324 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.310007 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 16:19:28.311255 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.311234 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 16:19:28.388334 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.388287 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-sys\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.388537 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.388384 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.388537 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.388422 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-accelerators-collector-config\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.388537 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.388450 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-metrics-client-ca\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.388537 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.388480 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-root\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.388537 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.388502 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfpqq\" (UniqueName: \"kubernetes.io/projected/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-kube-api-access-xfpqq\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.388715 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.388598 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-textfile\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.388715 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.388642 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-tls\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.388715 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.388663 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-wtmp\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.489797 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.489741 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-textfile\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.489797 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.489802 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-tls\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490041 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.489819 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-wtmp\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490041 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.489838 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-sys\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490041 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.489876 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490041 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.489901 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-accelerators-collector-config\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490041 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:19:28.489915 2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 16:19:28.490041 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.489964 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-sys\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490041 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.489925 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-metrics-client-ca\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490041 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:19:28.490005 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-tls podName:2c4b3ad6-ecc7-4319-ba3a-f0e91326772b nodeName:}" failed. No retries permitted until 2026-06-03 16:19:28.989983553 +0000 UTC m=+196.431503964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-tls") pod "node-exporter-87cdn" (UID: "2c4b3ad6-ecc7-4319-ba3a-f0e91326772b") : secret "node-exporter-tls" not found Jun 03 16:19:28.490041 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.490026 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-wtmp\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490527 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.490052 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-root\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490527 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.490079 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfpqq\" (UniqueName: \"kubernetes.io/projected/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-kube-api-access-xfpqq\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490527 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.490085 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-root\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490527 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.490151 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-textfile\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490527 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.490521 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-accelerators-collector-config\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.490731 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.490607 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-metrics-client-ca\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.492307 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.492285 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.507465 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.507440 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfpqq\" (UniqueName: \"kubernetes.io/projected/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-kube-api-access-xfpqq\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.994198 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:28.994133 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-tls\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:28.994398 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:19:28.994300 2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 16:19:28.994398 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:19:28.994392 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-tls podName:2c4b3ad6-ecc7-4319-ba3a-f0e91326772b nodeName:}" failed. No retries permitted until 2026-06-03 16:19:29.994366521 +0000 UTC m=+197.435886915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-tls") pod "node-exporter-87cdn" (UID: "2c4b3ad6-ecc7-4319-ba3a-f0e91326772b") : secret "node-exporter-tls" not found Jun 03 16:19:30.002263 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:30.002217 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-tls\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:30.004468 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:30.004449 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c4b3ad6-ecc7-4319-ba3a-f0e91326772b-node-exporter-tls\") pod \"node-exporter-87cdn\" (UID: \"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b\") " pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:30.116064 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:30.116013 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-87cdn" Jun 03 16:19:30.123523 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:19:30.123501 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4b3ad6_ecc7_4319_ba3a_f0e91326772b.slice/crio-302483e8ae4c1bcd955a4107a8ac78d2c17e050000d55ef82c3821137ecc069b WatchSource:0}: Error finding container 302483e8ae4c1bcd955a4107a8ac78d2c17e050000d55ef82c3821137ecc069b: Status 404 returned error can't find the container with id 302483e8ae4c1bcd955a4107a8ac78d2c17e050000d55ef82c3821137ecc069b Jun 03 16:19:30.757163 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:30.757125 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-87cdn" event={"ID":"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b","Type":"ContainerStarted","Data":"302483e8ae4c1bcd955a4107a8ac78d2c17e050000d55ef82c3821137ecc069b"} Jun 03 16:19:31.760653 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:31.760622 2569 generic.go:358] "Generic (PLEG): container finished" podID="2c4b3ad6-ecc7-4319-ba3a-f0e91326772b" containerID="e98b94c8ea5ace04b783293a322c98d9ecc56804ad1b48e8f97033c8d32c6228" exitCode=0 Jun 03 16:19:31.761025 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:31.760682 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-87cdn" event={"ID":"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b","Type":"ContainerDied","Data":"e98b94c8ea5ace04b783293a322c98d9ecc56804ad1b48e8f97033c8d32c6228"} Jun 03 16:19:32.765527 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:32.765485 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-87cdn" event={"ID":"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b","Type":"ContainerStarted","Data":"eaf22e5a12d675b19d943edde0b4534ba4a297402df7f5e2c562b5d7fe446f23"} Jun 03 16:19:32.765908 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:32.765534 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-87cdn" event={"ID":"2c4b3ad6-ecc7-4319-ba3a-f0e91326772b","Type":"ContainerStarted","Data":"50e2a4ff971457a7a300bfe26bd3e64cd966027c10bbd3506f69103f9bef9826"} Jun 03 16:19:34.680701 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.680645 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-87cdn" podStartSLOduration=5.586124931 podStartE2EDuration="6.680629279s" podCreationTimestamp="2026-06-03 16:19:28 +0000 UTC" firstStartedPulling="2026-06-03 16:19:30.125320191 +0000 UTC m=+197.566840584" lastFinishedPulling="2026-06-03 16:19:31.219824529 +0000 UTC m=+198.661344932" observedRunningTime="2026-06-03 16:19:32.79947374 +0000 UTC m=+200.240994155" watchObservedRunningTime="2026-06-03 16:19:34.680629279 +0000 UTC m=+202.122149697" Jun 03 16:19:34.681406 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.681386 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:19:34.685075 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.685055 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.688767 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.688746 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 16:19:34.689333 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.689057 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 16:19:34.689333 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.689073 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 16:19:34.689333 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.689081 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 16:19:34.689333 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.689170 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 16:19:34.689333 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.689196 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5r63dhgc87ha6\"" Jun 03 16:19:34.689333 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.689231 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 16:19:34.689333 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.689253 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 16:19:34.690269 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.690244 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xvkx4\"" Jun 03 16:19:34.690269 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.690261 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 16:19:34.690269 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.690272 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 16:19:34.690471 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.690276 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 16:19:34.690471 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.690276 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 16:19:34.690731 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.690715 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 16:19:34.692353 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.692333 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 16:19:34.702150 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.702128 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:19:34.741706 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.741667 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.741884 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.741727 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.741884 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.741798 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.741884 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.741828 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.741884 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.741852 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742018 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.741902 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-config\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742018 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.741935 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742018 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.742012 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742132 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.742045 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742132 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.742072 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742213 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.742141 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-config-out\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742213 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.742182 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-web-config\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.742212 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742275 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.742227 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742332 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.742273 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742332 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.742296 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742398 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.742332 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8mdd\" (UniqueName: \"kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-kube-api-access-g8mdd\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.742398 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.742361 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.843331 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.843283 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.843331 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.843325 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-config-out\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.843582 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.843456 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-web-config\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.843582 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.843510 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.843582 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.843540 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.843582 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.843569 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.843770 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.843592 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.843770 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.843631 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8mdd\" (UniqueName: \"kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-kube-api-access-g8mdd\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.844080 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.844054 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.844301 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.844261 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.844371 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.844322 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.844483 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.844464 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.844546 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.844527 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.844605 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.844556 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.844655 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.844612 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-config\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.844706 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.844668 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.844706 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.844682 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.844808 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.844707 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.844808 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.844750 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.846509 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.845412 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.846509 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.845448 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.846509 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.846337 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.846509 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.846384 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.846885 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.846810 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.848113 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.847299 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-config-out\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.848113 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.847606 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-web-config\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.848113 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.847993 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.848310 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.848182 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.848767 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.848741 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.848930 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.848906 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.849154 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.849133 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.849291 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.849277 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-config\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.849332 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.849317 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.849385 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.849164 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.849447 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.849432 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.858733 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.858714 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8mdd\" (UniqueName: \"kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-kube-api-access-g8mdd\") pod \"prometheus-k8s-0\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:34.994691 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:34.994594 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:19:35.125222 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:35.125195 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:19:35.126966 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:19:35.126938 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717fe563_91b6_4b83_b763_2f322a4ba676.slice/crio-bb7d62b3501aa12e9f318d42a87e7aca68c652291a715e1635e6cf574b2036cc WatchSource:0}: Error finding container bb7d62b3501aa12e9f318d42a87e7aca68c652291a715e1635e6cf574b2036cc: Status 404 returned error can't find the container with id bb7d62b3501aa12e9f318d42a87e7aca68c652291a715e1635e6cf574b2036cc Jun 03 16:19:35.773612 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:35.773575 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerStarted","Data":"bb7d62b3501aa12e9f318d42a87e7aca68c652291a715e1635e6cf574b2036cc"} Jun 03 16:19:36.724046 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:36.724016 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b6fd766df-rgxsd" Jun 03 16:19:36.777643 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:36.777608 2569 generic.go:358] "Generic (PLEG): container finished" podID="717fe563-91b6-4b83-b763-2f322a4ba676" containerID="0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84" exitCode=0 Jun 03 16:19:36.777990 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:36.777661 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerDied","Data":"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84"} Jun 03 16:19:39.793057 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:39.793023 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerStarted","Data":"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef"} Jun 03 16:19:39.793057 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:39.793061 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerStarted","Data":"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231"} Jun 03 16:19:41.799850 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:41.799815 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerStarted","Data":"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f"} Jun 03 16:19:41.799850 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:41.799853 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerStarted","Data":"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f"} Jun 03 16:19:41.800272 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:41.799863 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerStarted","Data":"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66"} Jun 03 16:19:41.800272 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:41.799872 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerStarted","Data":"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5"} Jun 03 16:19:41.838713 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:41.838659 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.597024665 podStartE2EDuration="7.838645411s" podCreationTimestamp="2026-06-03 16:19:34 +0000 UTC" firstStartedPulling="2026-06-03 16:19:35.12883357 +0000 UTC m=+202.570353966" lastFinishedPulling="2026-06-03 16:19:41.370454309 +0000 UTC m=+208.811974712" observedRunningTime="2026-06-03 16:19:41.838444033 +0000 UTC m=+209.279964447" watchObservedRunningTime="2026-06-03 16:19:41.838645411 +0000 UTC m=+209.280165825" Jun 03 16:19:44.995076 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:19:44.995020 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:09.206979 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:09.206931 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" podUID="8e319069-2670-415d-8b73-125d3f89cc1a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 16:20:19.206872 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:19.206827 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" podUID="8e319069-2670-415d-8b73-125d3f89cc1a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 16:20:24.954196 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:24.954140 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:20:24.956426 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:24.956405 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26aa42e6-df1e-4d38-abee-815e1408b049-metrics-certs\") pod \"network-metrics-daemon-hbskv\" (UID: \"26aa42e6-df1e-4d38-abee-815e1408b049\") " pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:20:25.112770 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:25.112737 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fw46v\"" Jun 03 16:20:25.119659 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:25.119639 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbskv" Jun 03 16:20:25.257683 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:25.257600 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hbskv"] Jun 03 16:20:25.260826 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:20:25.260800 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26aa42e6_df1e_4d38_abee_815e1408b049.slice/crio-987cde0652463847fe74bdb0edb33683e8aa7b9e551a3c711f01aa8bc030e885 WatchSource:0}: Error finding container 987cde0652463847fe74bdb0edb33683e8aa7b9e551a3c711f01aa8bc030e885: Status 404 returned error can't find the container with id 987cde0652463847fe74bdb0edb33683e8aa7b9e551a3c711f01aa8bc030e885 Jun 03 16:20:25.910779 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:25.910742 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbskv" event={"ID":"26aa42e6-df1e-4d38-abee-815e1408b049","Type":"ContainerStarted","Data":"987cde0652463847fe74bdb0edb33683e8aa7b9e551a3c711f01aa8bc030e885"} Jun 03 16:20:26.916587 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:26.916542 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbskv" event={"ID":"26aa42e6-df1e-4d38-abee-815e1408b049","Type":"ContainerStarted","Data":"3e5d344d8eea5bdc9fcf550b6c27573e85229244b0b40902d1eb266fd6d785d1"} Jun 03 16:20:26.916587 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:26.916587 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbskv" event={"ID":"26aa42e6-df1e-4d38-abee-815e1408b049","Type":"ContainerStarted","Data":"614d210a5dc1492a5b9da5648ffa8c1f8f61123b55866f8e2617866ebf744a15"} Jun 03 16:20:26.940356 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:26.940303 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hbskv" podStartSLOduration=253.090735287 podStartE2EDuration="4m13.940288623s" podCreationTimestamp="2026-06-03 16:16:13 +0000 UTC" firstStartedPulling="2026-06-03 16:20:25.26289885 +0000 UTC m=+252.704419246" lastFinishedPulling="2026-06-03 16:20:26.112452176 +0000 UTC m=+253.553972582" observedRunningTime="2026-06-03 16:20:26.939551881 +0000 UTC m=+254.381072296" watchObservedRunningTime="2026-06-03 16:20:26.940288623 +0000 UTC m=+254.381809037" Jun 03 16:20:29.207375 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:29.207328 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" podUID="8e319069-2670-415d-8b73-125d3f89cc1a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 16:20:29.210030 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:29.210004 2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" Jun 03 16:20:29.210483 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:29.210453 2569 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f94bf030cce0463e5c6e5cc861d6512e2e9951782f0a1ea1d85c4ec2adeb148c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 16:20:29.210536 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:29.210525 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" podUID="8e319069-2670-415d-8b73-125d3f89cc1a" containerName="service-proxy" containerID="cri-o://f94bf030cce0463e5c6e5cc861d6512e2e9951782f0a1ea1d85c4ec2adeb148c" gracePeriod=30 Jun 03 16:20:29.926823 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:29.926742 2569 generic.go:358] "Generic (PLEG): container finished" podID="8e319069-2670-415d-8b73-125d3f89cc1a" containerID="f94bf030cce0463e5c6e5cc861d6512e2e9951782f0a1ea1d85c4ec2adeb148c" exitCode=2 Jun 03 16:20:29.926823 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:29.926805 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" event={"ID":"8e319069-2670-415d-8b73-125d3f89cc1a","Type":"ContainerDied","Data":"f94bf030cce0463e5c6e5cc861d6512e2e9951782f0a1ea1d85c4ec2adeb148c"} Jun 03 16:20:29.927011 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:29.926849 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78d455f4bd-zcmlv" event={"ID":"8e319069-2670-415d-8b73-125d3f89cc1a","Type":"ContainerStarted","Data":"848878a6321133dee3cdbe9a30bdbe7d410bc93708c158f0816a86ae7f8463bd"} Jun 03 16:20:34.995777 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:34.995735 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:35.016596 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:35.016571 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:35.958683 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:35.958650 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:53.093213 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.093174 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:20:53.093693 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.093628 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="prometheus" containerID="cri-o://f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231" gracePeriod=600 Jun 03 16:20:53.093693 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.093653 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy" containerID="cri-o://ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f" gracePeriod=600 Jun 03 16:20:53.093814 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.093690 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="thanos-sidecar" containerID="cri-o://f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5" gracePeriod=600 Jun 03 16:20:53.093814 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.093709 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy-web" containerID="cri-o://97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66" gracePeriod=600 Jun 03 16:20:53.093814 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.093757 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f" gracePeriod=600 Jun 03 16:20:53.093814 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.093709 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="config-reloader" containerID="cri-o://70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef" gracePeriod=600 Jun 03 16:20:53.332128 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.332103 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:53.493702 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.493660 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-kubelet-serving-ca-bundle\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.493702 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.493707 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-serving-certs-ca-bundle\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.493915 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.493740 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8mdd\" (UniqueName: \"kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-kube-api-access-g8mdd\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.493915 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.493761 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-db\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.493915 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.493877 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-grpc-tls\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.493915 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.493911 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-trusted-ca-bundle\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494137 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.493958 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494137 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.493990 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-web-config\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494137 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494024 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-metrics-client-certs\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494137 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494048 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-metrics-client-ca\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494137 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494076 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-tls-assets\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494137 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494133 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-kube-rbac-proxy\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494452 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494168 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494452 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494191 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-config\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494452 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494218 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-thanos-prometheus-http-client-file\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494452 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494259 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-config-out\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494452 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494290 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-rulefiles-0\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494452 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494290 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:20:53.494452 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494319 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-tls\") pod \"717fe563-91b6-4b83-b763-2f322a4ba676\" (UID: \"717fe563-91b6-4b83-b763-2f322a4ba676\") " Jun 03 16:20:53.494807 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494455 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:20:53.494807 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494498 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:20:53.494807 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494616 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.494807 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494637 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.494807 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494653 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.494807 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.494795 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:20:53.496931 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.496468 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:20:53.496931 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.496787 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:20:53.496931 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.496831 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:20:53.497199 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.496966 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-kube-api-access-g8mdd" (OuterVolumeSpecName: "kube-api-access-g8mdd") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "kube-api-access-g8mdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:20:53.497199 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.496993 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:20:53.497199 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.497045 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:20:53.498396 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.498365 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:20:53.498897 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.498783 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:20:53.498897 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.498853 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:20:53.498897 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.498866 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-config" (OuterVolumeSpecName: "config") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:20:53.499045 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.498938 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:20:53.499082 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.499061 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-config-out" (OuterVolumeSpecName: "config-out") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:20:53.499199 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.499180 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:20:53.506493 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.506473 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-web-config" (OuterVolumeSpecName: "web-config") pod "717fe563-91b6-4b83-b763-2f322a4ba676" (UID: "717fe563-91b6-4b83-b763-2f322a4ba676"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:20:53.595243 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595191 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-configmap-metrics-client-ca\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595243 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595237 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-tls-assets\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595243 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595252 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-kube-rbac-proxy\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595269 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595282 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595296 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595307 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-config-out\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595319 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595335 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595348 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8mdd\" (UniqueName: \"kubernetes.io/projected/717fe563-91b6-4b83-b763-2f322a4ba676-kube-api-access-g8mdd\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595360 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/717fe563-91b6-4b83-b763-2f322a4ba676-prometheus-k8s-db\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595373 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-grpc-tls\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595387 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595398 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-web-config\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.595515 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.595412 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/717fe563-91b6-4b83-b763-2f322a4ba676-secret-metrics-client-certs\") on node \"ip-10-0-129-211.ec2.internal\" DevicePath \"\"" Jun 03 16:20:53.993801 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993759 2569 generic.go:358] "Generic (PLEG): container finished" podID="717fe563-91b6-4b83-b763-2f322a4ba676" containerID="e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f" exitCode=0 Jun 03 16:20:53.993801 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993788 2569 generic.go:358] "Generic (PLEG): container finished" podID="717fe563-91b6-4b83-b763-2f322a4ba676" containerID="ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f" exitCode=0 Jun 03 16:20:53.993801 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993797 2569 generic.go:358] "Generic (PLEG): container finished" podID="717fe563-91b6-4b83-b763-2f322a4ba676" containerID="97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66" exitCode=0 Jun 03 16:20:53.993801 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993805 2569 generic.go:358] "Generic (PLEG): container finished" podID="717fe563-91b6-4b83-b763-2f322a4ba676" containerID="f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5" exitCode=0 Jun 03 16:20:53.993801 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993812 2569 generic.go:358] "Generic (PLEG): container finished" podID="717fe563-91b6-4b83-b763-2f322a4ba676" containerID="70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef" exitCode=0 Jun 03 16:20:53.994140 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993819 2569 generic.go:358] "Generic (PLEG): container finished" podID="717fe563-91b6-4b83-b763-2f322a4ba676" containerID="f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231" exitCode=0 Jun 03 16:20:53.994140 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993819 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerDied","Data":"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f"} Jun 03 16:20:53.994140 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993858 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerDied","Data":"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f"} Jun 03 16:20:53.994140 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993862 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:53.994140 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993869 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerDied","Data":"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66"} Jun 03 16:20:53.994140 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993879 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerDied","Data":"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5"} Jun 03 16:20:53.994140 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993888 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerDied","Data":"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef"} Jun 03 16:20:53.994140 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993898 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerDied","Data":"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231"} Jun 03 16:20:53.994140 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993906 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"717fe563-91b6-4b83-b763-2f322a4ba676","Type":"ContainerDied","Data":"bb7d62b3501aa12e9f318d42a87e7aca68c652291a715e1635e6cf574b2036cc"} Jun 03 16:20:53.994140 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:53.993919 2569 scope.go:117] "RemoveContainer" containerID="e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f" Jun 03 16:20:54.001239 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.001196 2569 scope.go:117] "RemoveContainer" containerID="ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f" Jun 03 16:20:54.007549 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.007531 2569 scope.go:117] "RemoveContainer" containerID="97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66" Jun 03 16:20:54.013483 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.013461 2569 scope.go:117] "RemoveContainer" containerID="f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5" Jun 03 16:20:54.019730 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.019713 2569 scope.go:117] "RemoveContainer" containerID="70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef" Jun 03 16:20:54.021905 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.021489 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:20:54.027587 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.027565 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:20:54.028305 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.028292 2569 scope.go:117] "RemoveContainer" containerID="f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231" Jun 03 16:20:54.034855 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.034835 2569 scope.go:117] "RemoveContainer" containerID="0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84" Jun 03 16:20:54.040771 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.040752 2569 scope.go:117] "RemoveContainer" containerID="e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f" Jun 03 16:20:54.041010 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:20:54.040988 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": container with ID starting with e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f not found: ID does not exist" containerID="e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f" Jun 03 16:20:54.041087 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.041023 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f"} err="failed to get container status \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": rpc error: code = NotFound desc = could not find container \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": container with ID starting with e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f not found: ID does not exist" Jun 03 16:20:54.041087 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.041051 2569 scope.go:117] "RemoveContainer" containerID="ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f" Jun 03 16:20:54.041332 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:20:54.041312 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": container with ID starting with ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f not found: ID does not exist" containerID="ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f" Jun 03 16:20:54.041422 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.041336 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f"} err="failed to get container status \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": rpc error: code = NotFound desc = could not find container \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": container with ID starting with ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f not found: ID does not exist" Jun 03 16:20:54.041422 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.041361 2569 scope.go:117] "RemoveContainer" containerID="97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66" Jun 03 16:20:54.041589 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:20:54.041574 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": container with ID starting with 97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66 not found: ID does not exist" containerID="97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66" Jun 03 16:20:54.041636 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.041592 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66"} err="failed to get container status \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": rpc error: code = NotFound desc = could not find container \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": container with ID starting with 97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66 not found: ID does not exist" Jun 03 16:20:54.041636 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.041613 2569 scope.go:117] "RemoveContainer" containerID="f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5" Jun 03 16:20:54.041821 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:20:54.041801 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": container with ID starting with f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5 not found: ID does not exist" containerID="f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5" Jun 03 16:20:54.041904 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.041823 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5"} err="failed to get container status \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": rpc error: code = NotFound desc = could not find container \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": container with ID starting with f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5 not found: ID does not exist" Jun 03 16:20:54.041904 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.041837 2569 scope.go:117] "RemoveContainer" containerID="70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef" Jun 03 16:20:54.042032 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:20:54.042015 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": container with ID starting with 70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef not found: ID does not exist" containerID="70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef" Jun 03 16:20:54.042076 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042034 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef"} err="failed to get container status \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": rpc error: code = NotFound desc = could not find container \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": container with ID starting with 70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef not found: ID does not exist" Jun 03 16:20:54.042076 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042046 2569 scope.go:117] "RemoveContainer" containerID="f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231" Jun 03 16:20:54.042251 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:20:54.042232 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": container with ID starting with f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231 not found: ID does not exist" containerID="f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231" Jun 03 16:20:54.042286 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042257 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231"} err="failed to get container status \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": rpc error: code = NotFound desc = could not find container \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": container with ID starting with f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231 not found: ID does not exist" Jun 03 16:20:54.042286 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042273 2569 scope.go:117] "RemoveContainer" containerID="0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84" Jun 03 16:20:54.042478 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:20:54.042461 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": container with ID starting with 0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84 not found: ID does not exist" containerID="0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84" Jun 03 16:20:54.042517 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042482 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84"} err="failed to get container status \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": rpc error: code = NotFound desc = could not find container \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": container with ID starting with 0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84 not found: ID does not exist" Jun 03 16:20:54.042517 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042494 2569 scope.go:117] "RemoveContainer" containerID="e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f" Jun 03 16:20:54.042665 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042648 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f"} err="failed to get container status \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": rpc error: code = NotFound desc = could not find container \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": container with ID starting with e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f not found: ID does not exist" Jun 03 16:20:54.042709 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042665 2569 scope.go:117] "RemoveContainer" containerID="ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f" Jun 03 16:20:54.042828 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042812 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f"} err="failed to get container status \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": rpc error: code = NotFound desc = could not find container \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": container with ID starting with ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f not found: ID does not exist" Jun 03 16:20:54.042868 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042829 2569 scope.go:117] "RemoveContainer" containerID="97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66" Jun 03 16:20:54.042996 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042980 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66"} err="failed to get container status \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": rpc error: code = NotFound desc = could not find container \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": container with ID starting with 97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66 not found: ID does not exist" Jun 03 16:20:54.043037 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.042996 2569 scope.go:117] "RemoveContainer" containerID="f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5" Jun 03 16:20:54.043202 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.043179 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5"} err="failed to get container status \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": rpc error: code = NotFound desc = could not find container \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": container with ID starting with f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5 not found: ID does not exist" Jun 03 16:20:54.043202 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.043199 2569 scope.go:117] "RemoveContainer" containerID="70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef" Jun 03 16:20:54.043366 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.043348 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef"} err="failed to get container status \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": rpc error: code = NotFound desc = could not find container \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": container with ID starting with 70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef not found: ID does not exist" Jun 03 16:20:54.043410 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.043366 2569 scope.go:117] "RemoveContainer" containerID="f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231" Jun 03 16:20:54.043599 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.043582 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231"} err="failed to get container status \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": rpc error: code = NotFound desc = could not find container \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": container with ID starting with f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231 not found: ID does not exist" Jun 03 16:20:54.043653 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.043600 2569 scope.go:117] "RemoveContainer" containerID="0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84" Jun 03 16:20:54.043760 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.043744 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84"} err="failed to get container status \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": rpc error: code = NotFound desc = could not find container \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": container with ID starting with 0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84 not found: ID does not exist" Jun 03 16:20:54.043808 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.043762 2569 scope.go:117] "RemoveContainer" containerID="e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f" Jun 03 16:20:54.043930 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.043914 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f"} err="failed to get container status \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": rpc error: code = NotFound desc = could not find container \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": container with ID starting with e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f not found: ID does not exist" Jun 03 16:20:54.043975 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.043931 2569 scope.go:117] "RemoveContainer" containerID="ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f" Jun 03 16:20:54.044146 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.044131 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f"} err="failed to get container status \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": rpc error: code = NotFound desc = could not find container \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": container with ID starting with ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f not found: ID does not exist" Jun 03 16:20:54.044196 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.044145 2569 scope.go:117] "RemoveContainer" containerID="97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66" Jun 03 16:20:54.044339 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.044324 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66"} err="failed to get container status \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": rpc error: code = NotFound desc = could not find container \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": container with ID starting with 97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66 not found: ID does not exist" Jun 03 16:20:54.044339 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.044339 2569 scope.go:117] "RemoveContainer" containerID="f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5" Jun 03 16:20:54.044531 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.044510 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5"} err="failed to get container status \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": rpc error: code = NotFound desc = could not find container \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": container with ID starting with f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5 not found: ID does not exist" Jun 03 16:20:54.044531 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.044528 2569 scope.go:117] "RemoveContainer" containerID="70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef" Jun 03 16:20:54.044776 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.044749 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef"} err="failed to get container status \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": rpc error: code = NotFound desc = could not find container \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": container with ID starting with 70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef not found: ID does not exist" Jun 03 16:20:54.044862 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.044777 2569 scope.go:117] "RemoveContainer" containerID="f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231" Jun 03 16:20:54.045013 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.044980 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231"} err="failed to get container status \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": rpc error: code = NotFound desc = could not find container \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": container with ID starting with f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231 not found: ID does not exist" Jun 03 16:20:54.045071 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.045016 2569 scope.go:117] "RemoveContainer" containerID="0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84" Jun 03 16:20:54.045262 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.045241 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84"} err="failed to get container status \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": rpc error: code = NotFound desc = could not find container \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": container with ID starting with 0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84 not found: ID does not exist" Jun 03 16:20:54.045329 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.045263 2569 scope.go:117] "RemoveContainer" containerID="e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f" Jun 03 16:20:54.045527 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.045452 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f"} err="failed to get container status \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": rpc error: code = NotFound desc = could not find container \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": container with ID starting with e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f not found: ID does not exist" Jun 03 16:20:54.045527 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.045476 2569 scope.go:117] "RemoveContainer" containerID="ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f" Jun 03 16:20:54.045681 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.045664 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f"} err="failed to get container status \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": rpc error: code = NotFound desc = could not find container \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": container with ID starting with ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f not found: ID does not exist" Jun 03 16:20:54.045732 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.045681 2569 scope.go:117] "RemoveContainer" containerID="97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66" Jun 03 16:20:54.045884 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.045869 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66"} err="failed to get container status \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": rpc error: code = NotFound desc = could not find container \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": container with ID starting with 97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66 not found: ID does not exist" Jun 03 16:20:54.045927 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.045883 2569 scope.go:117] "RemoveContainer" containerID="f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5" Jun 03 16:20:54.046062 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.046046 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5"} err="failed to get container status \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": rpc error: code = NotFound desc = could not find container \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": container with ID starting with f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5 not found: ID does not exist" Jun 03 16:20:54.046127 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.046061 2569 scope.go:117] "RemoveContainer" containerID="70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef" Jun 03 16:20:54.046261 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.046241 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef"} err="failed to get container status \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": rpc error: code = NotFound desc = could not find container \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": container with ID starting with 70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef not found: ID does not exist" Jun 03 16:20:54.046340 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.046263 2569 scope.go:117] "RemoveContainer" containerID="f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231" Jun 03 16:20:54.046508 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.046491 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231"} err="failed to get container status \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": rpc error: code = NotFound desc = could not find container \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": container with ID starting with f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231 not found: ID does not exist" Jun 03 16:20:54.046553 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.046509 2569 scope.go:117] "RemoveContainer" containerID="0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84" Jun 03 16:20:54.046697 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.046679 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84"} err="failed to get container status \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": rpc error: code = NotFound desc = could not find container \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": container with ID starting with 0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84 not found: ID does not exist" Jun 03 16:20:54.046755 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.046698 2569 scope.go:117] "RemoveContainer" containerID="e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f" Jun 03 16:20:54.046913 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.046896 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f"} err="failed to get container status \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": rpc error: code = NotFound desc = could not find container \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": container with ID starting with e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f not found: ID does not exist" Jun 03 16:20:54.046955 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.046914 2569 scope.go:117] "RemoveContainer" containerID="ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f" Jun 03 16:20:54.047204 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047116 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f"} err="failed to get container status \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": rpc error: code = NotFound desc = could not find container \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": container with ID starting with ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f not found: ID does not exist" Jun 03 16:20:54.047204 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047140 2569 scope.go:117] "RemoveContainer" containerID="97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66" Jun 03 16:20:54.047324 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047309 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66"} err="failed to get container status \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": rpc error: code = NotFound desc = could not find container \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": container with ID starting with 97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66 not found: ID does not exist" Jun 03 16:20:54.047368 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047324 2569 scope.go:117] "RemoveContainer" containerID="f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5" Jun 03 16:20:54.047496 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047479 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5"} err="failed to get container status \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": rpc error: code = NotFound desc = could not find container \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": container with ID starting with f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5 not found: ID does not exist" Jun 03 16:20:54.047562 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047498 2569 scope.go:117] "RemoveContainer" containerID="70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef" Jun 03 16:20:54.047665 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047649 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef"} err="failed to get container status \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": rpc error: code = NotFound desc = could not find container \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": container with ID starting with 70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef not found: ID does not exist" Jun 03 16:20:54.047712 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047665 2569 scope.go:117] "RemoveContainer" containerID="f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231" Jun 03 16:20:54.047818 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047805 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231"} err="failed to get container status \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": rpc error: code = NotFound desc = could not find container \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": container with ID starting with f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231 not found: ID does not exist" Jun 03 16:20:54.047865 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047817 2569 scope.go:117] "RemoveContainer" containerID="0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84" Jun 03 16:20:54.047978 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047961 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84"} err="failed to get container status \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": rpc error: code = NotFound desc = could not find container \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": container with ID starting with 0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84 not found: ID does not exist" Jun 03 16:20:54.048042 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.047979 2569 scope.go:117] "RemoveContainer" containerID="e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f" Jun 03 16:20:54.048186 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.048168 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f"} err="failed to get container status \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": rpc error: code = NotFound desc = could not find container \"e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f\": container with ID starting with e56f16bb4c7eda13f28ea70af6a64dc6c972a9793c1255bda781c504ee03de7f not found: ID does not exist" Jun 03 16:20:54.048236 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.048187 2569 scope.go:117] "RemoveContainer" containerID="ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f" Jun 03 16:20:54.048353 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.048335 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f"} err="failed to get container status \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": rpc error: code = NotFound desc = could not find container \"ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f\": container with ID starting with ce5f2a97010efd491f5b71e9fcd458742d341e597701bd1fca1da2440f75377f not found: ID does not exist" Jun 03 16:20:54.048401 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.048355 2569 scope.go:117] "RemoveContainer" containerID="97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66" Jun 03 16:20:54.048560 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.048543 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66"} err="failed to get container status \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": rpc error: code = NotFound desc = could not find container \"97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66\": container with ID starting with 97655c2c636db4612ca66cafb419692c2e827c158697957a62be5a27da505d66 not found: ID does not exist" Jun 03 16:20:54.048625 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.048561 2569 scope.go:117] "RemoveContainer" containerID="f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5" Jun 03 16:20:54.048783 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.048765 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5"} err="failed to get container status \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": rpc error: code = NotFound desc = could not find container \"f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5\": container with ID starting with f3950604d28d0c875d821b6bce930cf42c273bd44ec5a21a3df62f43f5736cd5 not found: ID does not exist" Jun 03 16:20:54.048830 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.048783 2569 scope.go:117] "RemoveContainer" containerID="70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef" Jun 03 16:20:54.048958 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.048945 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef"} err="failed to get container status \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": rpc error: code = NotFound desc = could not find container \"70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef\": container with ID starting with 70ebc035b063d553692767d3b39668800382b39f4e00bda17a727ad6cd29b5ef not found: ID does not exist" Jun 03 16:20:54.049007 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.048958 2569 scope.go:117] "RemoveContainer" containerID="f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231" Jun 03 16:20:54.049156 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.049136 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231"} err="failed to get container status \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": rpc error: code = NotFound desc = could not find container \"f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231\": container with ID starting with f4013396476089e7776f8ac8067e38f8aefa0dcc1578ca44e4a15de073efa231 not found: ID does not exist" Jun 03 16:20:54.049156 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.049156 2569 scope.go:117] "RemoveContainer" containerID="0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84" Jun 03 16:20:54.049368 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.049352 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84"} err="failed to get container status \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": rpc error: code = NotFound desc = could not find container \"0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84\": container with ID starting with 0796bdf565ea7c15d27ee50fd414aba8718251e0d54970748ee65ea7837dac84 not found: ID does not exist" Jun 03 16:20:54.066513 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066487 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:20:54.066704 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066693 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="init-config-reloader" Jun 03 16:20:54.066752 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066706 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="init-config-reloader" Jun 03 16:20:54.066752 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066717 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="thanos-sidecar" Jun 03 16:20:54.066752 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066722 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="thanos-sidecar" Jun 03 16:20:54.066752 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066733 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="config-reloader" Jun 03 16:20:54.066752 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066738 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="config-reloader" Jun 03 16:20:54.066752 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066745 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="prometheus" Jun 03 16:20:54.066752 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066750 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="prometheus" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066755 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy-web" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066760 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy-web" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066766 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy-thanos" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066771 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy-thanos" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066777 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066782 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066818 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="thanos-sidecar" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066825 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066831 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="prometheus" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066837 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy-web" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066843 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="kube-rbac-proxy-thanos" Jun 03 16:20:54.066954 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.066850 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" containerName="config-reloader" Jun 03 16:20:54.072295 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.072280 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.079928 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.079904 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 16:20:54.080344 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.080326 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 16:20:54.080974 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.080957 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 16:20:54.082008 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.081992 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 16:20:54.082108 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.081994 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 16:20:54.083329 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.083312 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 16:20:54.083627 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.083612 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5r63dhgc87ha6\"" Jun 03 16:20:54.084573 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.084557 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 16:20:54.085512 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.085496 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 16:20:54.086246 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.086232 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 16:20:54.086514 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.086496 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 16:20:54.104810 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.104778 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xvkx4\"" Jun 03 16:20:54.104810 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.104786 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 16:20:54.106323 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.106283 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:20:54.108886 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.108865 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 16:20:54.113819 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.112089 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 16:20:54.198338 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198295 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c234dedd-7d83-4f81-b782-05daca1c0c3a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198338 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198347 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-web-config\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198584 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198376 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198584 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198411 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198584 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198437 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198584 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198460 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198584 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198488 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198584 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198508 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198584 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198566 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198829 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198602 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198829 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198621 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198829 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198638 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c234dedd-7d83-4f81-b782-05daca1c0c3a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198829 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198657 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198829 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198674 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198829 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198703 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c234dedd-7d83-4f81-b782-05daca1c0c3a-config-out\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198829 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198742 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-config\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198829 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198791 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.198829 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.198815 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8wnn\" (UniqueName: \"kubernetes.io/projected/c234dedd-7d83-4f81-b782-05daca1c0c3a-kube-api-access-g8wnn\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.299585 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.299502 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c234dedd-7d83-4f81-b782-05daca1c0c3a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.299585 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.299547 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-web-config\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.299585 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.299571 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.299585 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.299589 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.299854 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.299607 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.299854 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.299626 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.300022 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.299848 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300242 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300308 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300346 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300389 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300416 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c234dedd-7d83-4f81-b782-05daca1c0c3a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300444 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300496 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300506 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300535 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c234dedd-7d83-4f81-b782-05daca1c0c3a-config-out\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300416 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300565 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-config\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300619 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300657 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wnn\" (UniqueName: \"kubernetes.io/projected/c234dedd-7d83-4f81-b782-05daca1c0c3a-kube-api-access-g8wnn\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.301358 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.300771 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.302817 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.302785 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c234dedd-7d83-4f81-b782-05daca1c0c3a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.302817 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.302793 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.302971 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.302876 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-web-config\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.303373 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.303348 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.303642 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.303621 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c234dedd-7d83-4f81-b782-05daca1c0c3a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.303726 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.303708 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.303886 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.303812 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.304392 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.304362 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c234dedd-7d83-4f81-b782-05daca1c0c3a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.304493 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.304456 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.304704 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.304674 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.305147 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.305128 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c234dedd-7d83-4f81-b782-05daca1c0c3a-config-out\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.305286 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.305262 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.305445 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.305428 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.305908 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.305885 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c234dedd-7d83-4f81-b782-05daca1c0c3a-config\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.311864 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.311841 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8wnn\" (UniqueName: \"kubernetes.io/projected/c234dedd-7d83-4f81-b782-05daca1c0c3a-kube-api-access-g8wnn\") pod \"prometheus-k8s-0\" (UID: \"c234dedd-7d83-4f81-b782-05daca1c0c3a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.380849 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.380809 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:20:54.520444 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.520269 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:20:54.522380 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:20:54.522353 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc234dedd_7d83_4f81_b782_05daca1c0c3a.slice/crio-266bad7ee61875dbff9dc84e2d981fb5ebb801ba8c4de5811ec20fcd99f83745 WatchSource:0}: Error finding container 266bad7ee61875dbff9dc84e2d981fb5ebb801ba8c4de5811ec20fcd99f83745: Status 404 returned error can't find the container with id 266bad7ee61875dbff9dc84e2d981fb5ebb801ba8c4de5811ec20fcd99f83745 Jun 03 16:20:54.651580 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:20:54.651537 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-2ps88" podUID="939c43c6-27ae-4969-8eaa-756896d744cd" Jun 03 16:20:54.651713 ip-10-0-129-211 kubenswrapper[2569]: E0603 16:20:54.651537 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v6hjx" podUID="01961575-7bdf-417c-b10d-a616700d00df" Jun 03 16:20:54.998173 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.998133 2569 generic.go:358] "Generic (PLEG): container finished" podID="c234dedd-7d83-4f81-b782-05daca1c0c3a" containerID="2d91f48606d3f61e8d76f65be0746926ff7ee34bafad04e6cfcbd76a626752f1" exitCode=0 Jun 03 16:20:54.998344 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.998167 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c234dedd-7d83-4f81-b782-05daca1c0c3a","Type":"ContainerDied","Data":"2d91f48606d3f61e8d76f65be0746926ff7ee34bafad04e6cfcbd76a626752f1"} Jun 03 16:20:54.998344 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.998206 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c234dedd-7d83-4f81-b782-05daca1c0c3a","Type":"ContainerStarted","Data":"266bad7ee61875dbff9dc84e2d981fb5ebb801ba8c4de5811ec20fcd99f83745"} Jun 03 16:20:54.998344 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.998237 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v6hjx" Jun 03 16:20:54.998539 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:54.998525 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:20:55.212153 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:55.212049 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="717fe563-91b6-4b83-b763-2f322a4ba676" path="/var/lib/kubelet/pods/717fe563-91b6-4b83-b763-2f322a4ba676/volumes" Jun 03 16:20:56.004018 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:56.003979 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c234dedd-7d83-4f81-b782-05daca1c0c3a","Type":"ContainerStarted","Data":"d8dfbf2498d9b4b25235ee7a2a6ca7f88157418fd4e89046b857455fd129ce34"} Jun 03 16:20:56.004018 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:56.004021 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c234dedd-7d83-4f81-b782-05daca1c0c3a","Type":"ContainerStarted","Data":"2411c2a415289e05f63d02ccd8131f9728444a1180537f9bc7edf68ab8e783b1"} Jun 03 16:20:56.004246 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:56.004038 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c234dedd-7d83-4f81-b782-05daca1c0c3a","Type":"ContainerStarted","Data":"20360c6718b46ed265f8091b8955dcb2a132ef03d10e681d11ad8086d0a449a8"} Jun 03 16:20:56.004246 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:56.004051 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c234dedd-7d83-4f81-b782-05daca1c0c3a","Type":"ContainerStarted","Data":"1d039d2fe16b5943fa7fde958260a956139a971b793475bd493649c6d937d783"} Jun 03 16:20:56.004246 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:56.004063 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c234dedd-7d83-4f81-b782-05daca1c0c3a","Type":"ContainerStarted","Data":"f6447eeb38f8c05a3c3c2d291a3a461b4cee9c8065f123f78ca85d10e2f51fef"} Jun 03 16:20:56.004246 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:56.004075 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c234dedd-7d83-4f81-b782-05daca1c0c3a","Type":"ContainerStarted","Data":"141ffa19288a6848f4d86dabeb36dc0b9ddf421ba84f5cd471415a0ad051907f"} Jun 03 16:20:56.037196 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:56.037143 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.037126762 podStartE2EDuration="2.037126762s" podCreationTimestamp="2026-06-03 16:20:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:20:56.035315755 +0000 UTC m=+283.476836170" watchObservedRunningTime="2026-06-03 16:20:56.037126762 +0000 UTC m=+283.478647188" Jun 03 16:20:57.932300 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:57.932255 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:20:57.932784 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:57.932351 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:20:57.934725 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:57.934701 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01961575-7bdf-417c-b10d-a616700d00df-metrics-tls\") pod \"dns-default-v6hjx\" (UID: \"01961575-7bdf-417c-b10d-a616700d00df\") " pod="openshift-dns/dns-default-v6hjx" Jun 03 16:20:57.934807 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:57.934764 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/939c43c6-27ae-4969-8eaa-756896d744cd-cert\") pod \"ingress-canary-2ps88\" (UID: \"939c43c6-27ae-4969-8eaa-756896d744cd\") " pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:20:58.002084 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:58.002051 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cxft7\"" Jun 03 16:20:58.003125 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:58.003108 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p9nrq\"" Jun 03 16:20:58.009898 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:58.009876 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2ps88" Jun 03 16:20:58.010034 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:58.009978 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v6hjx" Jun 03 16:20:58.147371 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:58.147331 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v6hjx"] Jun 03 16:20:58.150362 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:20:58.150314 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01961575_7bdf_417c_b10d_a616700d00df.slice/crio-ff90ef8748e04b731e0d3720fdd11f65224faae9bdf36aaba05daf059d533dcc WatchSource:0}: Error finding container ff90ef8748e04b731e0d3720fdd11f65224faae9bdf36aaba05daf059d533dcc: Status 404 returned error can't find the container with id ff90ef8748e04b731e0d3720fdd11f65224faae9bdf36aaba05daf059d533dcc Jun 03 16:20:58.166352 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:58.166319 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2ps88"] Jun 03 16:20:58.169423 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:20:58.169394 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939c43c6_27ae_4969_8eaa_756896d744cd.slice/crio-a5b1bc78b5201298ed3f23d377800c2423ba011b0b6569e6c957604295dd8ba8 WatchSource:0}: Error finding container a5b1bc78b5201298ed3f23d377800c2423ba011b0b6569e6c957604295dd8ba8: Status 404 returned error can't find the container with id a5b1bc78b5201298ed3f23d377800c2423ba011b0b6569e6c957604295dd8ba8 Jun 03 16:20:59.012543 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:59.012501 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v6hjx" event={"ID":"01961575-7bdf-417c-b10d-a616700d00df","Type":"ContainerStarted","Data":"ff90ef8748e04b731e0d3720fdd11f65224faae9bdf36aaba05daf059d533dcc"} Jun 03 16:20:59.013620 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:59.013590 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2ps88" event={"ID":"939c43c6-27ae-4969-8eaa-756896d744cd","Type":"ContainerStarted","Data":"a5b1bc78b5201298ed3f23d377800c2423ba011b0b6569e6c957604295dd8ba8"} Jun 03 16:20:59.381609 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:20:59.381518 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:21:00.019421 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:00.019376 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2ps88" event={"ID":"939c43c6-27ae-4969-8eaa-756896d744cd","Type":"ContainerStarted","Data":"0b119760935f2d3f982414ce740b64ece3b0519e636593d109cb483ab4d1acf1"} Jun 03 16:21:00.021848 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:00.021811 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v6hjx" event={"ID":"01961575-7bdf-417c-b10d-a616700d00df","Type":"ContainerStarted","Data":"9e5eb7dd3551339f987dc23736d4921a39dd4ecd61f10ae8f93df1d8945283d6"} Jun 03 16:21:00.041472 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:00.041360 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2ps88" podStartSLOduration=251.296463365 podStartE2EDuration="4m13.041341695s" podCreationTimestamp="2026-06-03 16:16:47 +0000 UTC" firstStartedPulling="2026-06-03 16:20:58.171173863 +0000 UTC m=+285.612694256" lastFinishedPulling="2026-06-03 16:20:59.916052177 +0000 UTC m=+287.357572586" observedRunningTime="2026-06-03 16:21:00.040915074 +0000 UTC m=+287.482435504" watchObservedRunningTime="2026-06-03 16:21:00.041341695 +0000 UTC m=+287.482862110" Jun 03 16:21:01.026754 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:01.026721 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v6hjx" event={"ID":"01961575-7bdf-417c-b10d-a616700d00df","Type":"ContainerStarted","Data":"6f39094fd9d7c7af15ae3a5a6f1b718917c21399cf293ed675ed6e1a5b8cebc9"} Jun 03 16:21:01.047928 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:01.047872 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-v6hjx" podStartSLOduration=252.288641258 podStartE2EDuration="4m14.047855676s" podCreationTimestamp="2026-06-03 16:16:47 +0000 UTC" firstStartedPulling="2026-06-03 16:20:58.152643669 +0000 UTC m=+285.594164078" lastFinishedPulling="2026-06-03 16:20:59.911858098 +0000 UTC m=+287.353378496" observedRunningTime="2026-06-03 16:21:01.046572967 +0000 UTC m=+288.488093394" watchObservedRunningTime="2026-06-03 16:21:01.047855676 +0000 UTC m=+288.489376099" Jun 03 16:21:02.029137 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:02.029085 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v6hjx" Jun 03 16:21:09.034075 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:09.034039 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v6hjx" Jun 03 16:21:13.084208 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:13.084175 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/ovn-acl-logging/0.log" Jun 03 16:21:13.085412 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:13.085385 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/ovn-acl-logging/0.log" Jun 03 16:21:13.090885 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:13.090867 2569 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 16:21:54.380980 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:54.380934 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:21:54.396049 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:54.396022 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:21:55.193989 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:21:55.193960 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:23:13.536646 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:13.536612 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tw5kk_a9ba7a73-fe61-4452-b668-b08d885130ea/global-pull-secret-syncer/0.log" Jun 03 16:23:13.652695 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:13.652666 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vdkm8_433c1936-2255-45ef-b882-7c6c347b9e49/konnectivity-agent/0.log" Jun 03 16:23:13.677303 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:13.677272 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-211.ec2.internal_99943b78259665c5d1ab9b3113dfe749/haproxy/0.log" Jun 03 16:23:17.477843 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:17.477806 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-87cdn_2c4b3ad6-ecc7-4319-ba3a-f0e91326772b/node-exporter/0.log" Jun 03 16:23:17.501989 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:17.501951 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-87cdn_2c4b3ad6-ecc7-4319-ba3a-f0e91326772b/kube-rbac-proxy/0.log" Jun 03 16:23:17.528929 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:17.528899 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-87cdn_2c4b3ad6-ecc7-4319-ba3a-f0e91326772b/init-textfile/0.log" Jun 03 16:23:17.911618 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:17.911592 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c234dedd-7d83-4f81-b782-05daca1c0c3a/prometheus/0.log" Jun 03 16:23:17.938034 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:17.938005 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c234dedd-7d83-4f81-b782-05daca1c0c3a/config-reloader/0.log" Jun 03 16:23:17.963328 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:17.963298 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c234dedd-7d83-4f81-b782-05daca1c0c3a/thanos-sidecar/0.log" Jun 03 16:23:17.990836 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:17.990809 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c234dedd-7d83-4f81-b782-05daca1c0c3a/kube-rbac-proxy-web/0.log" Jun 03 16:23:18.015105 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:18.015073 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c234dedd-7d83-4f81-b782-05daca1c0c3a/kube-rbac-proxy/0.log" Jun 03 16:23:18.039703 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:18.039677 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c234dedd-7d83-4f81-b782-05daca1c0c3a/kube-rbac-proxy-thanos/0.log" Jun 03 16:23:18.068300 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:18.068274 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c234dedd-7d83-4f81-b782-05daca1c0c3a/init-config-reloader/0.log" Jun 03 16:23:19.815252 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:19.815219 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4"] Jun 03 16:23:19.817271 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:19.817242 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:19.819798 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:19.819774 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9s6gx\"/\"default-dockercfg-tbzfj\"" Jun 03 16:23:19.821039 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:19.821025 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9s6gx\"/\"kube-root-ca.crt\"" Jun 03 16:23:19.821149 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:19.821131 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9s6gx\"/\"openshift-service-ca.crt\"" Jun 03 16:23:19.825324 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:19.825297 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4"] Jun 03 16:23:19.918104 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:19.918063 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-proc\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:19.918276 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:19.918131 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-sys\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:19.918276 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:19.918175 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-podres\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:19.918276 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:19.918194 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-lib-modules\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:19.918276 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:19.918213 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rkzh\" (UniqueName: \"kubernetes.io/projected/6514ea46-68fd-4491-abb3-736104dc9754-kube-api-access-5rkzh\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.019620 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.019568 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-proc\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.019620 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.019622 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-sys\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.019822 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.019696 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-sys\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.019822 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.019707 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-proc\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.019822 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.019740 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-podres\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.019822 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.019772 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-lib-modules\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.019822 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.019790 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rkzh\" (UniqueName: \"kubernetes.io/projected/6514ea46-68fd-4491-abb3-736104dc9754-kube-api-access-5rkzh\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.019995 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.019881 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-podres\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.019995 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.019905 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6514ea46-68fd-4491-abb3-736104dc9754-lib-modules\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.029476 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.029439 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rkzh\" (UniqueName: \"kubernetes.io/projected/6514ea46-68fd-4491-abb3-736104dc9754-kube-api-access-5rkzh\") pod \"perf-node-gather-daemonset-6fjc4\" (UID: \"6514ea46-68fd-4491-abb3-736104dc9754\") " pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.127357 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.127267 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.254173 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.254148 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4"] Jun 03 16:23:20.256760 ip-10-0-129-211 kubenswrapper[2569]: W0603 16:23:20.256735 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6514ea46_68fd_4491_abb3_736104dc9754.slice/crio-c9287a8ffe3f3b0ddab6d291c1ac38a245424c5cbc81153ae976c2e2e6734e3c WatchSource:0}: Error finding container c9287a8ffe3f3b0ddab6d291c1ac38a245424c5cbc81153ae976c2e2e6734e3c: Status 404 returned error can't find the container with id c9287a8ffe3f3b0ddab6d291c1ac38a245424c5cbc81153ae976c2e2e6734e3c Jun 03 16:23:20.258305 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.258287 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:23:20.409054 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.409026 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" event={"ID":"6514ea46-68fd-4491-abb3-736104dc9754","Type":"ContainerStarted","Data":"c6f4c0ac0a24b81a81a7ef9c9cfd6abf6a955952f7e7c6c7907c9cae28e70fb3"} Jun 03 16:23:20.409054 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.409058 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" event={"ID":"6514ea46-68fd-4491-abb3-736104dc9754","Type":"ContainerStarted","Data":"c9287a8ffe3f3b0ddab6d291c1ac38a245424c5cbc81153ae976c2e2e6734e3c"} Jun 03 16:23:20.409324 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.409136 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:20.428819 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:20.428770 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" podStartSLOduration=1.428755676 podStartE2EDuration="1.428755676s" podCreationTimestamp="2026-06-03 16:23:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:23:20.427779206 +0000 UTC m=+427.869299617" watchObservedRunningTime="2026-06-03 16:23:20.428755676 +0000 UTC m=+427.870276099" Jun 03 16:23:21.493554 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:21.493525 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v6hjx_01961575-7bdf-417c-b10d-a616700d00df/dns/0.log" Jun 03 16:23:21.518998 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:21.518965 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v6hjx_01961575-7bdf-417c-b10d-a616700d00df/kube-rbac-proxy/0.log" Jun 03 16:23:21.602157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:21.602123 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qjc7p_62d94987-c995-4436-a994-94fbbd06166d/dns-node-resolver/0.log" Jun 03 16:23:22.026647 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:22.026612 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b6fd766df-rgxsd_f5df0594-d8c7-4c46-9082-6ff481c8d85a/registry/0.log" Jun 03 16:23:22.118201 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:22.118172 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qg52k_153ff263-c2c3-45a0-901a-a616452d6a1f/node-ca/0.log" Jun 03 16:23:23.376457 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:23.376428 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2ps88_939c43c6-27ae-4969-8eaa-756896d744cd/serve-healthcheck-canary/0.log" Jun 03 16:23:23.952360 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:23.952327 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bpdpj_27eed75d-ab8c-4f87-8fb9-ace3986958d9/kube-rbac-proxy/0.log" Jun 03 16:23:23.977934 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:23.977905 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bpdpj_27eed75d-ab8c-4f87-8fb9-ace3986958d9/exporter/0.log" Jun 03 16:23:24.003730 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:24.003696 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bpdpj_27eed75d-ab8c-4f87-8fb9-ace3986958d9/extractor/0.log" Jun 03 16:23:26.420114 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:26.420071 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9s6gx/perf-node-gather-daemonset-6fjc4" Jun 03 16:23:30.243307 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:30.243278 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxfnf_2ce280fa-ee1d-46d1-b433-f490213e54c7/kube-multus-additional-cni-plugins/0.log" Jun 03 16:23:30.273817 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:30.273786 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxfnf_2ce280fa-ee1d-46d1-b433-f490213e54c7/egress-router-binary-copy/0.log" Jun 03 16:23:30.324963 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:30.324883 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxfnf_2ce280fa-ee1d-46d1-b433-f490213e54c7/cni-plugins/0.log" Jun 03 16:23:30.358770 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:30.358744 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxfnf_2ce280fa-ee1d-46d1-b433-f490213e54c7/bond-cni-plugin/0.log" Jun 03 16:23:30.389207 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:30.389176 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxfnf_2ce280fa-ee1d-46d1-b433-f490213e54c7/routeoverride-cni/0.log" Jun 03 16:23:30.419509 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:30.419483 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxfnf_2ce280fa-ee1d-46d1-b433-f490213e54c7/whereabouts-cni-bincopy/0.log" Jun 03 16:23:30.463137 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:30.463085 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxfnf_2ce280fa-ee1d-46d1-b433-f490213e54c7/whereabouts-cni/0.log" Jun 03 16:23:30.709168 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:30.709142 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k48r5_6b70d1f9-8487-4928-900b-356cf62370a1/kube-multus/0.log" Jun 03 16:23:30.801671 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:30.801641 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hbskv_26aa42e6-df1e-4d38-abee-815e1408b049/network-metrics-daemon/0.log" Jun 03 16:23:30.829427 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:30.829399 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hbskv_26aa42e6-df1e-4d38-abee-815e1408b049/kube-rbac-proxy/0.log" Jun 03 16:23:32.033688 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:32.033663 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/ovn-controller/0.log" Jun 03 16:23:32.061477 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:32.061447 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/ovn-acl-logging/0.log" Jun 03 16:23:32.063212 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:32.063195 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/ovn-acl-logging/1.log" Jun 03 16:23:32.087681 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:32.087656 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/kube-rbac-proxy-node/0.log" Jun 03 16:23:32.114339 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:32.114308 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 16:23:32.140937 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:32.140913 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/northd/0.log" Jun 03 16:23:32.166782 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:32.166752 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/nbdb/0.log" Jun 03 16:23:32.194215 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:32.194189 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/sbdb/0.log" Jun 03 16:23:32.293157 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:32.293065 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gmxxc_bf0eca9f-d9e5-4f6a-8cee-0c8bcabb9a2b/ovnkube-controller/0.log" Jun 03 16:23:33.686778 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:33.686749 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-csjz9_63aed83b-71b8-4721-b0b4-f36beef888a6/network-check-target-container/0.log" Jun 03 16:23:34.704850 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:34.704817 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-m9g4n_2cc17c88-db37-4569-a7aa-707bc78cc228/iptables-alerter/0.log" Jun 03 16:23:35.423647 ip-10-0-129-211 kubenswrapper[2569]: I0603 16:23:35.423616 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-56pcr_f236ff1b-16dd-4cd6-a8b4-9a788fdfad91/tuned/0.log"