Jun 03 08:48:41.784208 ip-10-0-143-104 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 08:48:41.784219 ip-10-0-143-104 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 08:48:41.784237 ip-10-0-143-104 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 08:48:41.784474 ip-10-0-143-104 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 08:48:52.987021 ip-10-0-143-104 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 08:48:52.987035 ip-10-0-143-104 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d436be95e7154c49b1e45733b9a013ec -- Jun 03 08:51:22.371551 ip-10-0-143-104 systemd[1]: Starting Kubernetes Kubelet... Jun 03 08:51:22.737554 ip-10-0-143-104 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 08:51:22.737554 ip-10-0-143-104 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 08:51:22.737554 ip-10-0-143-104 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 08:51:22.737554 ip-10-0-143-104 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 08:51:22.737554 ip-10-0-143-104 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 08:51:22.738826 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.738745 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 08:51:22.743270 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743254 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 08:51:22.743270 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743269 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743273 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743276 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743280 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743296 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743299 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743303 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743306 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743309 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743312 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743314 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743318 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743320 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743323 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743326 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743328 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743331 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743333 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743336 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 08:51:22.743345 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743338 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743343 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743354 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743357 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743360 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743363 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743366 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743369 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743372 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743374 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743377 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743380 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743382 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743385 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743388 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743390 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743392 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743395 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743403 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743405 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 08:51:22.743796 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743408 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743410 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743413 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743415 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743418 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743420 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743423 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743425 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743428 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743431 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743433 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743436 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743438 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743441 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743444 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743447 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743449 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743452 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743454 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743457 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 08:51:22.744325 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743460 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743462 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743465 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743467 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743470 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743472 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743475 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743477 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743480 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743482 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743486 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743489 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743493 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743495 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743504 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743507 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743510 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743512 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743515 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743518 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 08:51:22.744808 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743520 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743522 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743525 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743528 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743530 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743533 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743929 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743933 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743936 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743939 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743942 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743944 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743947 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743950 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743952 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743955 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743958 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743960 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743963 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743965 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 08:51:22.745295 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743968 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743972 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743976 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743979 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743981 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743984 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743993 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743996 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.743998 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744001 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744003 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744006 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744008 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744010 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744013 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744015 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744018 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744021 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744024 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744027 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 08:51:22.745777 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744030 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744032 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744035 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744037 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744040 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744042 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744044 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744047 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744049 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744052 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744054 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744057 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744059 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744062 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744064 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744067 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744069 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744073 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744075 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744083 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 08:51:22.746275 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744085 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744088 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744091 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744093 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744095 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744098 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744100 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744103 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744105 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744108 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744111 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744113 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744116 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744119 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744121 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744124 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744126 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744128 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744131 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744133 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 08:51:22.746803 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744136 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744138 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744142 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744146 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744148 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744152 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744161 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744173 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744176 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744179 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744182 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.744184 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744752 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744765 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744774 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744778 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744783 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744786 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744790 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744794 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744797 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 08:51:22.747278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744801 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744805 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744808 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744812 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744815 2559 flags.go:64] FLAG: --cgroup-root="" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744818 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744821 2559 flags.go:64] FLAG: --client-ca-file="" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744824 2559 flags.go:64] FLAG: --cloud-config="" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744827 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744829 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744836 2559 flags.go:64] FLAG: --cluster-domain="" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744839 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744842 2559 flags.go:64] FLAG: --config-dir="" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744844 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744848 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744851 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744854 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744857 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744861 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744864 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744867 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744870 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744873 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744876 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744887 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 08:51:22.747786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744890 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744893 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744896 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744899 2559 flags.go:64] FLAG: --enable-server="true" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744902 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744907 2559 flags.go:64] FLAG: --event-burst="100" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744910 2559 flags.go:64] FLAG: --event-qps="50" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744913 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744917 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744920 2559 flags.go:64] FLAG: --eviction-hard="" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744924 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744927 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744929 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744932 2559 flags.go:64] FLAG: --eviction-soft="" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744935 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744938 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744941 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744944 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744946 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744949 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744952 2559 flags.go:64] FLAG: --feature-gates="" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744956 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744959 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744962 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744965 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744968 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 03 08:51:22.748413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744971 2559 flags.go:64] FLAG: --help="false" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744973 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-143-104.ec2.internal" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744976 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744979 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744982 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744986 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744990 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744993 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744996 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.744999 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745001 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745004 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745008 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745010 2559 flags.go:64] FLAG: --kube-reserved="" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745013 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745016 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745019 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745022 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745024 2559 flags.go:64] FLAG: --lock-file="" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745027 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745030 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745033 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745038 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 08:51:22.749021 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745040 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745043 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745046 2559 flags.go:64] FLAG: --logging-format="text" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745049 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745052 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745054 2559 flags.go:64] FLAG: --manifest-url="" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745057 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745062 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745065 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745068 2559 flags.go:64] FLAG: --max-pods="110" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745071 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745074 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745077 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745080 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745083 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745086 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745089 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745096 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745099 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745102 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745105 2559 flags.go:64] FLAG: --pod-cidr="" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745108 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745113 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745116 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 08:51:22.749593 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745119 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745122 2559 flags.go:64] FLAG: --port="10250" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745125 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745128 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05346a2a1b73a5a1c" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745131 2559 flags.go:64] FLAG: --qos-reserved="" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745134 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745137 2559 flags.go:64] FLAG: --register-node="true" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745139 2559 flags.go:64] FLAG: --register-schedulable="true" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745142 2559 flags.go:64] FLAG: --register-with-taints="" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745145 2559 flags.go:64] FLAG: --registry-burst="10" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745148 2559 flags.go:64] FLAG: --registry-qps="5" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745151 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745154 2559 flags.go:64] FLAG: --reserved-memory="" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745157 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745160 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745163 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745166 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745169 2559 flags.go:64] FLAG: --runonce="false" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745171 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745174 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745177 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745180 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745183 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745186 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745189 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745192 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 08:51:22.750163 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745195 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745197 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745200 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745203 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745206 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745209 2559 flags.go:64] FLAG: --system-cgroups="" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745212 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745217 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745220 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745222 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745225 2559 flags.go:64] FLAG: --tls-min-version="" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745228 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745231 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745233 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745236 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745239 2559 flags.go:64] FLAG: --v="2" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745243 2559 flags.go:64] FLAG: --version="false" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745249 2559 flags.go:64] FLAG: --vmodule="" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745253 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745270 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745380 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745384 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745387 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745390 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 08:51:22.750814 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745393 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745396 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745398 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745401 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745404 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745407 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745409 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745412 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745416 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745418 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745421 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745423 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745426 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745428 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745431 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745433 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745436 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745438 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745440 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745443 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 08:51:22.751400 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745445 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745448 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745451 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745453 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745455 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745459 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745463 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745466 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745468 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745471 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745473 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745476 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745479 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745481 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745484 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745492 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745494 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745497 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745500 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 08:51:22.751929 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745502 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745505 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745508 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745511 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745513 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745516 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745519 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745521 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745523 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745526 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745529 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745533 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745536 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745539 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745542 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745545 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745548 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745550 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745553 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 08:51:22.752409 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745556 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745559 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745562 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745564 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745567 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745570 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745573 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745576 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745578 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745583 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745586 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745588 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745591 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745594 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745597 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745599 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745602 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745605 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745607 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745610 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745613 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 08:51:22.752870 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745615 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745618 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.745620 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.745626 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.752592 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.752608 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752655 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752660 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752664 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752667 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752670 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752673 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752676 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752679 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752682 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752684 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 08:51:22.753384 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752687 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752690 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752693 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752695 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752698 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752701 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752703 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752705 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752708 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752712 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752717 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752720 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752723 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752726 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752728 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752731 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752734 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752736 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752739 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 08:51:22.753772 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752741 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752744 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752748 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752751 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752753 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752756 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752758 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752761 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752764 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752766 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752768 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752771 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752774 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752776 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752779 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752781 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752783 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752786 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752788 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752792 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 08:51:22.754248 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752796 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752798 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752801 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752804 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752806 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752809 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752811 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752814 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752816 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752818 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752821 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752823 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752826 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752828 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752831 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752834 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752836 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752839 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752842 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752844 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 08:51:22.754746 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752847 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752849 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752851 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752854 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752856 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752859 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752861 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752863 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752866 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752868 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752871 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752873 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752876 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752878 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752881 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752884 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 08:51:22.755307 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.752886 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.752891 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753000 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753005 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753008 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753011 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753014 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753017 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753019 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753022 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753025 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753027 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753031 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753034 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753036 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 08:51:22.755731 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753039 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753041 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753044 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753046 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753048 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753051 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753055 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753059 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753061 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753064 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753066 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753068 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753071 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753073 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753076 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753078 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753081 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753085 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753087 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753090 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 08:51:22.756099 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753092 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753095 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753097 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753100 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753102 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753104 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753107 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753109 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753112 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753114 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753117 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753120 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753122 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753125 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753127 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753130 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753132 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753135 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753139 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753142 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 08:51:22.756615 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753145 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753147 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753150 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753153 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753155 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753158 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753160 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753163 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753165 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753168 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753170 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753173 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753175 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753178 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753180 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753183 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753185 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753188 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753190 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753192 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 08:51:22.757094 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753195 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753198 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753200 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753203 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753206 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753208 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753211 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753213 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753216 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753218 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753220 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753223 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:22.753225 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.753230 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.753907 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 08:51:22.757632 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.757303 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 08:51:22.758363 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.758325 2559 server.go:1019] "Starting client certificate rotation" Jun 03 08:51:22.758452 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.758436 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 08:51:22.758485 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.758478 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 08:51:22.777951 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.777935 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 08:51:22.780623 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.780600 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 08:51:22.791724 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.791708 2559 log.go:25] "Validated CRI v1 runtime API" Jun 03 08:51:22.796739 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.796724 2559 log.go:25] "Validated CRI v1 image API" Jun 03 08:51:22.798323 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.798305 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 08:51:22.801119 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.801101 2559 fs.go:135] Filesystem UUIDs: map[4fe1d74c-56f2-459a-9d28-121e034b6030:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ebd8c8a0-e553-414b-8c5f-ecdcb5cb972f:/dev/nvme0n1p4] Jun 03 08:51:22.801188 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.801118 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 08:51:22.805190 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.805090 2559 manager.go:217] Machine: {Timestamp:2026-06-03 08:51:22.80461314 +0000 UTC m=+0.335877439 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099452 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e822d177e95113496f51e773fc72f SystemUUID:ec2e822d-177e-9511-3496-f51e773fc72f BootID:d436be95-e715-4c49-b1e4-5733b9a013ec Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cf:6c:84:ac:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cf:6c:84:ac:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:7d:fb:24:6e:5c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 08:51:22.805843 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.805832 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 08:51:22.805918 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.805906 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 08:51:22.808824 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.808798 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 08:51:22.808961 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.808826 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-104.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 08:51:22.809011 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.808970 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 08:51:22.809011 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.808978 2559 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 08:51:22.809011 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.808985 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 08:51:22.809480 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.809470 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 08:51:22.810917 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.810904 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 03 08:51:22.811022 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.811014 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 08:51:22.812799 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.812789 2559 kubelet.go:491] "Attempting to sync node with API server" Jun 03 08:51:22.812850 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.812803 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 08:51:22.812850 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.812814 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 08:51:22.812850 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.812826 2559 kubelet.go:397] "Adding apiserver pod source" Jun 03 08:51:22.812850 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.812839 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 08:51:22.813641 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.813626 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 08:51:22.813723 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.813700 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 08:51:22.813843 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.813731 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 08:51:22.817037 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.817017 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 08:51:22.819055 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.819042 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 08:51:22.821701 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821686 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 08:51:22.821767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821704 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 08:51:22.821767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821711 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 08:51:22.821767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821716 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 08:51:22.821767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821725 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 08:51:22.821767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821731 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 08:51:22.821767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821736 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 08:51:22.821767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821741 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 08:51:22.821767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821749 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 08:51:22.821767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821755 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 08:51:22.821767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821768 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 08:51:22.822012 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.821774 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 08:51:22.822485 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.822475 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 08:51:22.822519 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.822485 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 08:51:22.825857 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.825829 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 08:51:22.825928 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.825901 2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 08:51:22.825928 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.825916 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 08:51:22.826130 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.826117 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 08:51:22.826174 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.826165 2559 server.go:1295] "Started kubelet" Jun 03 08:51:22.826348 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.826228 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 08:51:22.826348 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.826281 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 08:51:22.826442 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.826385 2559 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 08:51:22.826901 ip-10-0-143-104 systemd[1]: Started Kubernetes Kubelet. Jun 03 08:51:22.827564 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.827549 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 08:51:22.828357 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.828345 2559 server.go:317] "Adding debug handlers to kubelet server" Jun 03 08:51:22.831600 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.830752 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-104.ec2.internal.18b5861c12b7a340 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-104.ec2.internal,UID:ip-10-0-143-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-104.ec2.internal,},FirstTimestamp:2026-06-03 08:51:22.82613024 +0000 UTC m=+0.357394540,LastTimestamp:2026-06-03 08:51:22.82613024 +0000 UTC m=+0.357394540,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-104.ec2.internal,}" Jun 03 08:51:22.832338 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.832324 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 08:51:22.832338 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.832332 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 08:51:22.832452 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.832386 2559 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 08:51:22.832452 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.832396 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 08:51:22.832577 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.832488 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 08:51:22.832577 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.832550 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 03 08:51:22.832577 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.832557 2559 reconciler.go:26] "Reconciler: start to sync state" Jun 03 08:51:22.834030 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.833982 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:22.834675 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.834659 2559 factory.go:55] Registering systemd factory Jun 03 08:51:22.834675 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.834677 2559 factory.go:223] Registration of the systemd container factory successfully Jun 03 08:51:22.834958 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.834944 2559 factory.go:153] Registering CRI-O factory Jun 03 08:51:22.835028 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.835000 2559 factory.go:223] Registration of the crio container factory successfully Jun 03 08:51:22.835079 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.835014 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 08:51:22.835079 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.835076 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 08:51:22.835177 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.835100 2559 factory.go:103] Registering Raw factory Jun 03 08:51:22.835177 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.835122 2559 manager.go:1196] Started watching for new ooms in manager Jun 03 08:51:22.835447 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.835422 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 08:51:22.835447 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.835425 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 08:51:22.835661 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.835649 2559 manager.go:319] Starting recovery of all containers Jun 03 08:51:22.841175 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.841134 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 08:51:22.845322 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.845147 2559 manager.go:324] Recovery completed Jun 03 08:51:22.850945 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.850926 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:51:22.852755 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.852738 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:51:22.852851 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.852769 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:51:22.852851 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.852785 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:51:22.853350 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.853334 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 08:51:22.853392 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.853351 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 08:51:22.853392 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.853370 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 03 08:51:22.855203 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.855124 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-104.ec2.internal.18b5861c144de0ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-104.ec2.internal,UID:ip-10-0-143-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-104.ec2.internal,},FirstTimestamp:2026-06-03 08:51:22.85275358 +0000 UTC m=+0.384017882,LastTimestamp:2026-06-03 08:51:22.85275358 +0000 UTC m=+0.384017882,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-104.ec2.internal,}" Jun 03 08:51:22.856440 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.856427 2559 policy_none.go:49] "None policy: Start" Jun 03 08:51:22.856488 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.856445 2559 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 08:51:22.856488 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.856456 2559 state_mem.go:35] "Initializing new in-memory state store" Jun 03 08:51:22.863533 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.863474 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-104.ec2.internal.18b5861c144e37f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-104.ec2.internal,UID:ip-10-0-143-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-104.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-104.ec2.internal,},FirstTimestamp:2026-06-03 08:51:22.852775929 +0000 UTC m=+0.384040229,LastTimestamp:2026-06-03 08:51:22.852775929 +0000 UTC m=+0.384040229,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-104.ec2.internal,}" Jun 03 08:51:22.872966 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.872950 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6qd6q" Jun 03 08:51:22.874191 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.874138 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-104.ec2.internal.18b5861c144e7338 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-104.ec2.internal,UID:ip-10-0-143-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-104.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-104.ec2.internal,},FirstTimestamp:2026-06-03 08:51:22.852791096 +0000 UTC m=+0.384055397,LastTimestamp:2026-06-03 08:51:22.852791096 +0000 UTC m=+0.384055397,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-104.ec2.internal,}" Jun 03 08:51:22.883462 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.883446 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6qd6q" Jun 03 08:51:22.903532 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.901643 2559 manager.go:341] "Starting Device Plugin manager" Jun 03 08:51:22.903532 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.901668 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 08:51:22.903532 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.901677 2559 server.go:85] "Starting device plugin registration server" Jun 03 08:51:22.903532 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.901919 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 08:51:22.903532 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.901931 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 08:51:22.903532 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.902036 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 08:51:22.903532 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.902112 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 08:51:22.903532 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.902121 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 08:51:22.903532 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.902646 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 08:51:22.903532 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.902683 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:22.935485 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.935466 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 08:51:22.935569 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.935491 2559 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 08:51:22.935569 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.935509 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 08:51:22.935569 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.935516 2559 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 08:51:22.935569 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:22.935552 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 08:51:22.938132 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:22.938115 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 08:51:23.002466 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.002378 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:51:23.003415 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.003398 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:51:23.003491 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.003429 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:51:23.003491 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.003440 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:51:23.003491 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.003466 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.013604 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.013585 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.013661 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.013609 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-104.ec2.internal\": node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:23.031494 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.031475 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:23.035812 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.035793 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-104.ec2.internal"] Jun 03 08:51:23.035872 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.035857 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:51:23.036735 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.036720 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:51:23.036807 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.036750 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:51:23.036807 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.036762 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:51:23.037918 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.037907 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:51:23.038081 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.038065 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.038119 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.038098 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:51:23.038591 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.038576 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:51:23.038634 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.038588 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:51:23.038634 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.038605 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:51:23.038634 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.038609 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:51:23.038634 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.038616 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:51:23.038634 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.038622 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:51:23.039691 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.039678 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.039755 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.039699 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:51:23.040343 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.040328 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:51:23.040397 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.040356 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:51:23.040397 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.040368 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:51:23.062845 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.062825 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-104.ec2.internal\" not found" node="ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.067021 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.067005 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-104.ec2.internal\" not found" node="ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.131541 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.131518 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:23.133762 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.133741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/196131d32b8800ac6cdd27b418514c90-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal\" (UID: \"196131d32b8800ac6cdd27b418514c90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.133762 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.133767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7421be42ddd759e44d9f8c88d591ebb2-config\") pod \"kube-apiserver-proxy-ip-10-0-143-104.ec2.internal\" (UID: \"7421be42ddd759e44d9f8c88d591ebb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.133890 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.133784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/196131d32b8800ac6cdd27b418514c90-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal\" (UID: \"196131d32b8800ac6cdd27b418514c90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.232490 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.232457 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:23.234659 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.234640 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/196131d32b8800ac6cdd27b418514c90-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal\" (UID: \"196131d32b8800ac6cdd27b418514c90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.234737 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.234674 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/196131d32b8800ac6cdd27b418514c90-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal\" (UID: \"196131d32b8800ac6cdd27b418514c90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.234737 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.234697 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7421be42ddd759e44d9f8c88d591ebb2-config\") pod \"kube-apiserver-proxy-ip-10-0-143-104.ec2.internal\" (UID: \"7421be42ddd759e44d9f8c88d591ebb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.234814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.234739 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/196131d32b8800ac6cdd27b418514c90-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal\" (UID: \"196131d32b8800ac6cdd27b418514c90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.234814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.234743 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7421be42ddd759e44d9f8c88d591ebb2-config\") pod \"kube-apiserver-proxy-ip-10-0-143-104.ec2.internal\" (UID: \"7421be42ddd759e44d9f8c88d591ebb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.234814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.234760 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/196131d32b8800ac6cdd27b418514c90-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal\" (UID: \"196131d32b8800ac6cdd27b418514c90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.333136 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.333072 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:23.365376 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.365347 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.370862 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.370847 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-104.ec2.internal" Jun 03 08:51:23.433506 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.433481 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:23.533901 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.533880 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:23.634317 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.634260 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:23.734716 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.734698 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:23.757997 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.757973 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 08:51:23.758367 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.758106 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 08:51:23.833103 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.833078 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 08:51:23.835084 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.835059 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:23.867645 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.867622 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 08:51:23.885108 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.885041 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 08:46:22 +0000 UTC" deadline="2027-11-29 06:12:35.569586521 +0000 UTC" Jun 03 08:51:23.885108 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.885069 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13053h21m11.684521925s" Jun 03 08:51:23.891570 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.891552 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c7wf9" Jun 03 08:51:23.896631 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:23.896608 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7421be42ddd759e44d9f8c88d591ebb2.slice/crio-b8bb8b2bd6a8ee827a42254cfb79e750298528bc214d5c7d8bd584f45b22c37c WatchSource:0}: Error finding container b8bb8b2bd6a8ee827a42254cfb79e750298528bc214d5c7d8bd584f45b22c37c: Status 404 returned error can't find the container with id b8bb8b2bd6a8ee827a42254cfb79e750298528bc214d5c7d8bd584f45b22c37c Jun 03 08:51:23.896830 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:23.896811 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196131d32b8800ac6cdd27b418514c90.slice/crio-e259c66dff890aa6ca21e8319c5def59abf6a46747b6f5a44a5dd69878a833f1 WatchSource:0}: Error finding container e259c66dff890aa6ca21e8319c5def59abf6a46747b6f5a44a5dd69878a833f1: Status 404 returned error can't find the container with id e259c66dff890aa6ca21e8319c5def59abf6a46747b6f5a44a5dd69878a833f1 Jun 03 08:51:23.903144 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.903129 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 08:51:23.905480 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.905458 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c7wf9" Jun 03 08:51:23.935713 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:23.935694 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:23.938273 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.938236 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-104.ec2.internal" event={"ID":"7421be42ddd759e44d9f8c88d591ebb2","Type":"ContainerStarted","Data":"b8bb8b2bd6a8ee827a42254cfb79e750298528bc214d5c7d8bd584f45b22c37c"} Jun 03 08:51:23.939100 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.939078 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" event={"ID":"196131d32b8800ac6cdd27b418514c90","Type":"ContainerStarted","Data":"e259c66dff890aa6ca21e8319c5def59abf6a46747b6f5a44a5dd69878a833f1"} Jun 03 08:51:23.967088 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:23.967070 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 08:51:24.036435 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.036407 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:24.136868 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.136805 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:24.237210 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.237182 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:24.337845 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.337818 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-104.ec2.internal\" not found" Jun 03 08:51:24.347595 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.347574 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 08:51:24.394488 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.394438 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 08:51:24.432607 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.432579 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" Jun 03 08:51:24.463324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.463303 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 08:51:24.464116 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.464097 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-104.ec2.internal" Jun 03 08:51:24.482298 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.482272 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 08:51:24.701415 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.701337 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 08:51:24.813574 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.813539 2559 apiserver.go:52] "Watching apiserver" Jun 03 08:51:24.821786 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.821757 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 08:51:24.822171 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.822135 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hssgq","kube-system/konnectivity-agent-jdntd","openshift-image-registry/node-ca-rrl7z","openshift-multus/multus-additional-cni-plugins-kdcjd","openshift-multus/network-metrics-daemon-2sx6r","openshift-network-diagnostics/network-check-target-hkt2l","openshift-network-operator/iptables-alerter-cd2df","openshift-ovn-kubernetes/ovnkube-node-kg4nm","kube-system/kube-apiserver-proxy-ip-10-0-143-104.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp","openshift-cluster-node-tuning-operator/tuned-h82q6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal","openshift-multus/multus-9zq8h"] Jun 03 08:51:24.824645 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.824601 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:24.826093 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.826072 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cd2df" Jun 03 08:51:24.826192 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.826139 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rrl7z" Jun 03 08:51:24.827213 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.827192 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 08:51:24.827323 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.827262 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jv8h8\"" Jun 03 08:51:24.827377 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.827326 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 08:51:24.828361 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.828187 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 08:51:24.828467 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.828413 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.829313 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.829084 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 08:51:24.829313 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.829236 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:51:24.829467 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.829319 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 08:51:24.829871 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.829607 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:24.829871 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.829643 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 08:51:24.829871 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.829673 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:24.829871 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.829754 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-985s4\"" Jun 03 08:51:24.830096 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.829974 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7cs66\"" Jun 03 08:51:24.830096 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.830028 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 08:51:24.831007 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.830988 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:24.831096 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.831020 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 08:51:24.831096 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.831045 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:24.831213 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.831198 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 08:51:24.831423 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.831406 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8pjdc\"" Jun 03 08:51:24.831495 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.831428 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 08:51:24.831800 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.831649 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 08:51:24.831800 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.831717 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 08:51:24.832648 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.832223 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:24.832648 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.832322 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:24.834370 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.833534 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.834845 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.834828 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.836843 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.836060 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.836843 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.836069 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.836843 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.836192 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 08:51:24.836843 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.836638 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 08:51:24.837624 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.837354 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 08:51:24.837624 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.837367 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j9qh7\"" Jun 03 08:51:24.837624 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.837394 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 08:51:24.837624 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.837475 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 08:51:24.837624 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.837589 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 08:51:24.838453 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.838435 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 08:51:24.839767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.839744 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 08:51:24.839856 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.839799 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 08:51:24.840017 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840001 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 08:51:24.840171 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840146 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zthc6\"" Jun 03 08:51:24.840241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840214 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:51:24.840311 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840254 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 08:51:24.840542 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840522 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5hr9k\"" Jun 03 08:51:24.840648 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840586 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kn66w\"" Jun 03 08:51:24.840809 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840705 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b3b98fd-e96e-40e1-a238-f11c00121ebc-ovnkube-script-lib\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.840809 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-device-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.840809 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840758 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-os-release\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.840809 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.840809 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b3b98fd-e96e-40e1-a238-f11c00121ebc-ovnkube-config\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.841057 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-sys-fs\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.841057 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840850 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba9932da-6f52-401b-a573-e160a5424714-serviceca\") pod \"node-ca-rrl7z\" (UID: \"ba9932da-6f52-401b-a573-e160a5424714\") " pod="openshift-image-registry/node-ca-rrl7z" Jun 03 08:51:24.841057 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-run-netns\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.841057 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840894 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7khf\" (UniqueName: \"kubernetes.io/projected/4b3b98fd-e96e-40e1-a238-f11c00121ebc-kube-api-access-l7khf\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.841057 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.840989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80a34e60-bdea-48dc-9d97-2a044d2faf19-cni-binary-copy\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.841057 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6fxf\" (UniqueName: \"kubernetes.io/projected/84be9f15-fa8a-4426-825c-be4d3c9fcf1c-kube-api-access-h6fxf\") pod \"iptables-alerter-cd2df\" (UID: \"84be9f15-fa8a-4426-825c-be4d3c9fcf1c\") " pod="openshift-network-operator/iptables-alerter-cd2df" Jun 03 08:51:24.841057 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b3b98fd-e96e-40e1-a238-f11c00121ebc-env-overrides\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.841057 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b3b98fd-e96e-40e1-a238-f11c00121ebc-ovn-node-metrics-cert\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.841438 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-slash\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.841438 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-run-systemd\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.841438 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-var-lib-openvswitch\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.841438 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841153 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-cnibin\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.841438 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:24.841438 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-kubelet\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.841438 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-cni-bin\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.841724 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-registration-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.841724 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-etc-selinux\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.841789 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2hmb\" (UniqueName: \"kubernetes.io/projected/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-kube-api-access-b2hmb\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.841789 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-system-cni-dir\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.841849 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841789 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84be9f15-fa8a-4426-825c-be4d3c9fcf1c-iptables-alerter-script\") pod \"iptables-alerter-cd2df\" (UID: \"84be9f15-fa8a-4426-825c-be4d3c9fcf1c\") " pod="openshift-network-operator/iptables-alerter-cd2df" Jun 03 08:51:24.841849 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jsqc\" (UniqueName: \"kubernetes.io/projected/ba9932da-6f52-401b-a573-e160a5424714-kube-api-access-6jsqc\") pod \"node-ca-rrl7z\" (UID: \"ba9932da-6f52-401b-a573-e160a5424714\") " pod="openshift-image-registry/node-ca-rrl7z" Jun 03 08:51:24.841849 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9p7c\" (UniqueName: \"kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c\") pod \"network-check-target-hkt2l\" (UID: \"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3\") " pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:24.841849 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-dbus\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:24.841997 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.841997 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841885 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80a34e60-bdea-48dc-9d97-2a044d2faf19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.841997 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/300c606c-8fd5-4de2-87ff-cad17d01162f-agent-certs\") pod \"konnectivity-agent-jdntd\" (UID: \"300c606c-8fd5-4de2-87ff-cad17d01162f\") " pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:24.841997 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/300c606c-8fd5-4de2-87ff-cad17d01162f-konnectivity-ca\") pod \"konnectivity-agent-jdntd\" (UID: \"300c606c-8fd5-4de2-87ff-cad17d01162f\") " pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:24.841997 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba9932da-6f52-401b-a573-e160a5424714-host\") pod \"node-ca-rrl7z\" (UID: \"ba9932da-6f52-401b-a573-e160a5424714\") " pod="openshift-image-registry/node-ca-rrl7z" Jun 03 08:51:24.841997 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.841979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-kubelet-config\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:24.842190 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.842004 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-etc-openvswitch\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.842190 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.842052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80a34e60-bdea-48dc-9d97-2a044d2faf19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.842190 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.842076 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mw7x\" (UniqueName: \"kubernetes.io/projected/80a34e60-bdea-48dc-9d97-2a044d2faf19-kube-api-access-9mw7x\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.842190 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.842100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phxzh\" (UniqueName: \"kubernetes.io/projected/30768073-4636-4456-aa24-a47199e99a4d-kube-api-access-phxzh\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:24.842190 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.842127 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-systemd-units\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.842884 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.842165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-run-ovn\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.843428 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.842919 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-log-socket\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.843428 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.843078 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-cni-netd\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.843428 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.843117 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.843428 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.843233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-socket-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.843428 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.843270 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.843428 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.843351 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84be9f15-fa8a-4426-825c-be4d3c9fcf1c-host-slash\") pod \"iptables-alerter-cd2df\" (UID: \"84be9f15-fa8a-4426-825c-be4d3c9fcf1c\") " pod="openshift-network-operator/iptables-alerter-cd2df" Jun 03 08:51:24.843757 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.843516 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:24.843757 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.843588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-run-openvswitch\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.843757 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.843665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-node-log\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.906903 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.906850 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 08:46:23 +0000 UTC" deadline="2028-01-07 08:03:56.038898404 +0000 UTC" Jun 03 08:51:24.907018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.906906 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13991h12m31.131999835s" Jun 03 08:51:24.933277 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.933242 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 08:51:24.944653 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944632 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-kubelet-config\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:24.944741 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944658 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-etc-openvswitch\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.944741 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944676 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mw7x\" (UniqueName: \"kubernetes.io/projected/80a34e60-bdea-48dc-9d97-2a044d2faf19-kube-api-access-9mw7x\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.944741 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944698 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phxzh\" (UniqueName: \"kubernetes.io/projected/30768073-4636-4456-aa24-a47199e99a4d-kube-api-access-phxzh\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:24.944741 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-systemd\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.944950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-sys\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.944950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944759 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-etc-openvswitch\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.944950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944761 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-kubelet-config\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:24.944950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944808 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-systemd-units\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.944950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944863 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-systemd-units\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.944950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944907 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-run-ovn\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.944950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944934 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-log-socket\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.944959 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84be9f15-fa8a-4426-825c-be4d3c9fcf1c-host-slash\") pod \"iptables-alerter-cd2df\" (UID: \"84be9f15-fa8a-4426-825c-be4d3c9fcf1c\") " pod="openshift-network-operator/iptables-alerter-cd2df" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945001 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-run-ovn\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945004 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-log-socket\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945034 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84be9f15-fa8a-4426-825c-be4d3c9fcf1c-host-slash\") pod \"iptables-alerter-cd2df\" (UID: \"84be9f15-fa8a-4426-825c-be4d3c9fcf1c\") " pod="openshift-network-operator/iptables-alerter-cd2df" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-system-cni-dir\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-multus-cni-dir\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-run-multus-certs\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945131 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945164 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-run-openvswitch\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945204 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b3b98fd-e96e-40e1-a238-f11c00121ebc-ovnkube-script-lib\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-run-openvswitch\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.945241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945232 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-device-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.945270 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945257 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107776cd-7780-45a3-bcba-7016788a3afe-cni-binary-copy\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945321 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b3b98fd-e96e-40e1-a238-f11c00121ebc-ovnkube-config\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.945356 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret podName:ed0f87f6-b558-43fd-bf3a-67c9c21049c1 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:25.445335177 +0000 UTC m=+2.976599474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret") pod "global-pull-secret-syncer-hssgq" (UID: "ed0f87f6-b558-43fd-bf3a-67c9c21049c1") : object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945362 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-device-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945372 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-host\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945391 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba9932da-6f52-401b-a573-e160a5424714-serviceca\") pod \"node-ca-rrl7z\" (UID: \"ba9932da-6f52-401b-a573-e160a5424714\") " pod="openshift-image-registry/node-ca-rrl7z" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945412 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80a34e60-bdea-48dc-9d97-2a044d2faf19-cni-binary-copy\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945439 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6fxf\" (UniqueName: \"kubernetes.io/projected/84be9f15-fa8a-4426-825c-be4d3c9fcf1c-kube-api-access-h6fxf\") pod \"iptables-alerter-cd2df\" (UID: \"84be9f15-fa8a-4426-825c-be4d3c9fcf1c\") " pod="openshift-network-operator/iptables-alerter-cd2df" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945480 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-modprobe-d\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-lib-modules\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945527 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b3b98fd-e96e-40e1-a238-f11c00121ebc-ovn-node-metrics-cert\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945565 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-slash\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945605 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945635 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-kubernetes\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-sysctl-conf\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.945748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945685 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-cni-bin\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945711 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hmb\" (UniqueName: \"kubernetes.io/projected/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-kube-api-access-b2hmb\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945736 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-system-cni-dir\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-var-lib-kubelet\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945813 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54b10fc1-f115-45ba-8967-7e75ea61f7f1-tmp\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945793 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba9932da-6f52-401b-a573-e160a5424714-serviceca\") pod \"node-ca-rrl7z\" (UID: \"ba9932da-6f52-401b-a573-e160a5424714\") " pod="openshift-image-registry/node-ca-rrl7z" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945822 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gl28\" (UniqueName: \"kubernetes.io/projected/54b10fc1-f115-45ba-8967-7e75ea61f7f1-kube-api-access-7gl28\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945897 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b3b98fd-e96e-40e1-a238-f11c00121ebc-ovnkube-script-lib\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945906 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jsqc\" (UniqueName: \"kubernetes.io/projected/ba9932da-6f52-401b-a573-e160a5424714-kube-api-access-6jsqc\") pod \"node-ca-rrl7z\" (UID: \"ba9932da-6f52-401b-a573-e160a5424714\") " pod="openshift-image-registry/node-ca-rrl7z" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945906 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-cni-bin\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80a34e60-bdea-48dc-9d97-2a044d2faf19-cni-binary-copy\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-system-cni-dir\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.945945 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-dbus\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946055 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.946082 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk72c\" (UniqueName: \"kubernetes.io/projected/107776cd-7780-45a3-bcba-7016788a3afe-kube-api-access-lk72c\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946129 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba9932da-6f52-401b-a573-e160a5424714-host\") pod \"node-ca-rrl7z\" (UID: \"ba9932da-6f52-401b-a573-e160a5424714\") " pod="openshift-image-registry/node-ca-rrl7z" Jun 03 08:51:24.946543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946171 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-dbus\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.946179 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs podName:30768073-4636-4456-aa24-a47199e99a4d nodeName:}" failed. No retries permitted until 2026-06-03 08:51:25.446148845 +0000 UTC m=+2.977413143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs") pod "network-metrics-daemon-2sx6r" (UID: "30768073-4636-4456-aa24-a47199e99a4d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946176 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba9932da-6f52-401b-a573-e160a5424714-host\") pod \"node-ca-rrl7z\" (UID: \"ba9932da-6f52-401b-a573-e160a5424714\") " pod="openshift-image-registry/node-ca-rrl7z" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946203 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-slash\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946219 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80a34e60-bdea-48dc-9d97-2a044d2faf19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946232 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-sysconfig\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946365 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/107776cd-7780-45a3-bcba-7016788a3afe-multus-daemon-config\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946419 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-cni-netd\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946471 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946498 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946541 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-cni-netd\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946560 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-socket-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946588 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-os-release\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946641 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-multus-socket-dir-parent\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.947324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946664 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-node-log\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946688 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-os-release\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946711 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-run\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946715 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946724 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80a34e60-bdea-48dc-9d97-2a044d2faf19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-tuned\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946720 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-socket-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946753 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-node-log\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946805 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b3b98fd-e96e-40e1-a238-f11c00121ebc-ovnkube-config\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946815 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-os-release\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-multus-conf-dir\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946888 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946915 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-sys-fs\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946925 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-cnibin\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946968 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-run-netns\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.946990 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-sys-fs\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.948014 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947008 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7khf\" (UniqueName: \"kubernetes.io/projected/4b3b98fd-e96e-40e1-a238-f11c00121ebc-kube-api-access-l7khf\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947015 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-run-netns\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-run-netns\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947090 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-var-lib-cni-multus\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947109 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b3b98fd-e96e-40e1-a238-f11c00121ebc-env-overrides\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947126 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-run-systemd\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947147 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-var-lib-openvswitch\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947164 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-cnibin\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947197 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-var-lib-openvswitch\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947203 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-run-systemd\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-run-k8s-cni-cncf-io\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947200 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80a34e60-bdea-48dc-9d97-2a044d2faf19-cnibin\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-var-lib-kubelet\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-hostroot\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947317 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-etc-kubernetes\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947343 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-kubelet\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947372 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-registration-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.948806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947412 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b3b98fd-e96e-40e1-a238-f11c00121ebc-host-kubelet\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-registration-dir\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947455 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-etc-selinux\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947512 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84be9f15-fa8a-4426-825c-be4d3c9fcf1c-iptables-alerter-script\") pod \"iptables-alerter-cd2df\" (UID: \"84be9f15-fa8a-4426-825c-be4d3c9fcf1c\") " pod="openshift-network-operator/iptables-alerter-cd2df" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947539 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b3b98fd-e96e-40e1-a238-f11c00121ebc-env-overrides\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-var-lib-cni-bin\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947592 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9p7c\" (UniqueName: \"kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c\") pod \"network-check-target-hkt2l\" (UID: \"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3\") " pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947604 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-etc-selinux\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947619 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80a34e60-bdea-48dc-9d97-2a044d2faf19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947645 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/300c606c-8fd5-4de2-87ff-cad17d01162f-agent-certs\") pod \"konnectivity-agent-jdntd\" (UID: \"300c606c-8fd5-4de2-87ff-cad17d01162f\") " pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947668 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/300c606c-8fd5-4de2-87ff-cad17d01162f-konnectivity-ca\") pod \"konnectivity-agent-jdntd\" (UID: \"300c606c-8fd5-4de2-87ff-cad17d01162f\") " pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.947699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-sysctl-d\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.948061 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84be9f15-fa8a-4426-825c-be4d3c9fcf1c-iptables-alerter-script\") pod \"iptables-alerter-cd2df\" (UID: \"84be9f15-fa8a-4426-825c-be4d3c9fcf1c\") " pod="openshift-network-operator/iptables-alerter-cd2df" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.948076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80a34e60-bdea-48dc-9d97-2a044d2faf19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.948389 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/300c606c-8fd5-4de2-87ff-cad17d01162f-konnectivity-ca\") pod \"konnectivity-agent-jdntd\" (UID: \"300c606c-8fd5-4de2-87ff-cad17d01162f\") " pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:24.949618 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.949390 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b3b98fd-e96e-40e1-a238-f11c00121ebc-ovn-node-metrics-cert\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.950273 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.950257 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/300c606c-8fd5-4de2-87ff-cad17d01162f-agent-certs\") pod \"konnectivity-agent-jdntd\" (UID: \"300c606c-8fd5-4de2-87ff-cad17d01162f\") " pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:24.957129 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.957077 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phxzh\" (UniqueName: \"kubernetes.io/projected/30768073-4636-4456-aa24-a47199e99a4d-kube-api-access-phxzh\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:24.959946 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.959924 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6fxf\" (UniqueName: \"kubernetes.io/projected/84be9f15-fa8a-4426-825c-be4d3c9fcf1c-kube-api-access-h6fxf\") pod \"iptables-alerter-cd2df\" (UID: \"84be9f15-fa8a-4426-825c-be4d3c9fcf1c\") " pod="openshift-network-operator/iptables-alerter-cd2df" Jun 03 08:51:24.960272 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.960252 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mw7x\" (UniqueName: \"kubernetes.io/projected/80a34e60-bdea-48dc-9d97-2a044d2faf19-kube-api-access-9mw7x\") pod \"multus-additional-cni-plugins-kdcjd\" (UID: \"80a34e60-bdea-48dc-9d97-2a044d2faf19\") " pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:24.960375 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.960355 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jsqc\" (UniqueName: \"kubernetes.io/projected/ba9932da-6f52-401b-a573-e160a5424714-kube-api-access-6jsqc\") pod \"node-ca-rrl7z\" (UID: \"ba9932da-6f52-401b-a573-e160a5424714\") " pod="openshift-image-registry/node-ca-rrl7z" Jun 03 08:51:24.960441 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.960375 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:51:24.960441 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.960394 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:51:24.960441 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.960406 2559 projected.go:194] Error preparing data for projected volume kube-api-access-x9p7c for pod openshift-network-diagnostics/network-check-target-hkt2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:24.960572 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:24.960455 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c podName:f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:25.460439383 +0000 UTC m=+2.991703672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x9p7c" (UniqueName: "kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c") pod "network-check-target-hkt2l" (UID: "f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:24.961639 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.961616 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7khf\" (UniqueName: \"kubernetes.io/projected/4b3b98fd-e96e-40e1-a238-f11c00121ebc-kube-api-access-l7khf\") pod \"ovnkube-node-kg4nm\" (UID: \"4b3b98fd-e96e-40e1-a238-f11c00121ebc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:24.962255 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:24.962240 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2hmb\" (UniqueName: \"kubernetes.io/projected/71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb-kube-api-access-b2hmb\") pod \"aws-ebs-csi-driver-node-vw7fp\" (UID: \"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:25.048023 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.047979 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-system-cni-dir\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048023 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048028 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-multus-cni-dir\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048258 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048045 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-run-multus-certs\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048258 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-system-cni-dir\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048258 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048080 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107776cd-7780-45a3-bcba-7016788a3afe-cni-binary-copy\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048258 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048121 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-run-multus-certs\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048258 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048125 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-host\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048258 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-host\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048258 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048180 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-modprobe-d\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048258 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048186 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-multus-cni-dir\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048205 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-lib-modules\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048326 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-kubernetes\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048338 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-modprobe-d\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048353 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-sysctl-conf\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-lib-modules\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048397 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-var-lib-kubelet\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048411 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-kubernetes\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048422 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54b10fc1-f115-45ba-8967-7e75ea61f7f1-tmp\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048447 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gl28\" (UniqueName: \"kubernetes.io/projected/54b10fc1-f115-45ba-8967-7e75ea61f7f1-kube-api-access-7gl28\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-var-lib-kubelet\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048473 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lk72c\" (UniqueName: \"kubernetes.io/projected/107776cd-7780-45a3-bcba-7016788a3afe-kube-api-access-lk72c\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048488 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-sysctl-conf\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048498 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-sysconfig\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048521 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/107776cd-7780-45a3-bcba-7016788a3afe-multus-daemon-config\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048547 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-os-release\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048568 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-multus-socket-dir-parent\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048626 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-multus-socket-dir-parent\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.048806 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048629 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-sysconfig\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048672 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-run\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048700 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-tuned\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048725 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-multus-conf-dir\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048750 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-cnibin\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048777 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-run-netns\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048802 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-var-lib-cni-multus\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048836 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-run-k8s-cni-cncf-io\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107776cd-7780-45a3-bcba-7016788a3afe-cni-binary-copy\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048864 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-var-lib-kubelet\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048888 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-hostroot\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048912 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-etc-kubernetes\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048941 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-var-lib-cni-bin\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.048980 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-sysctl-d\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049008 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-systemd\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049032 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-sys\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049060 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-run-k8s-cni-cncf-io\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049069 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/107776cd-7780-45a3-bcba-7016788a3afe-multus-daemon-config\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.049654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049073 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-etc-kubernetes\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049135 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-cnibin\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049153 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-systemd\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-run\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049174 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-multus-conf-dir\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049153 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-os-release\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049197 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-sysctl-d\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049220 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-hostroot\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049223 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-var-lib-cni-multus\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049240 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-var-lib-cni-bin\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049185 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54b10fc1-f115-45ba-8967-7e75ea61f7f1-sys\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049255 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-var-lib-kubelet\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.050324 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.049257 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/107776cd-7780-45a3-bcba-7016788a3afe-host-run-netns\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.051030 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.051006 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54b10fc1-f115-45ba-8967-7e75ea61f7f1-tmp\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.051352 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.051329 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54b10fc1-f115-45ba-8967-7e75ea61f7f1-etc-tuned\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.060832 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.060809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gl28\" (UniqueName: \"kubernetes.io/projected/54b10fc1-f115-45ba-8967-7e75ea61f7f1-kube-api-access-7gl28\") pod \"tuned-h82q6\" (UID: \"54b10fc1-f115-45ba-8967-7e75ea61f7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.063151 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.063127 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk72c\" (UniqueName: \"kubernetes.io/projected/107776cd-7780-45a3-bcba-7016788a3afe-kube-api-access-lk72c\") pod \"multus-9zq8h\" (UID: \"107776cd-7780-45a3-bcba-7016788a3afe\") " pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.138706 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.138666 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:25.148452 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.148426 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cd2df" Jun 03 08:51:25.155019 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.154998 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rrl7z" Jun 03 08:51:25.161559 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.161535 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kdcjd" Jun 03 08:51:25.168184 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.168159 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:25.173709 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.173693 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" Jun 03 08:51:25.180187 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.180170 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h82q6" Jun 03 08:51:25.184715 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.184696 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9zq8h" Jun 03 08:51:25.451486 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.451406 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:25.451486 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.451453 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:25.451686 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:25.451563 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:25.451686 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:25.451618 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs podName:30768073-4636-4456-aa24-a47199e99a4d nodeName:}" failed. No retries permitted until 2026-06-03 08:51:26.451604383 +0000 UTC m=+3.982868668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs") pod "network-metrics-daemon-2sx6r" (UID: "30768073-4636-4456-aa24-a47199e99a4d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:25.451686 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:25.451565 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:25.451879 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:25.451704 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret podName:ed0f87f6-b558-43fd-bf3a-67c9c21049c1 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:26.451686059 +0000 UTC m=+3.982950362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret") pod "global-pull-secret-syncer-hssgq" (UID: "ed0f87f6-b558-43fd-bf3a-67c9c21049c1") : object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:25.552366 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.552329 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9p7c\" (UniqueName: \"kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c\") pod \"network-check-target-hkt2l\" (UID: \"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3\") " pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:25.552546 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:25.552490 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:51:25.552546 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:25.552514 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:51:25.552546 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:25.552528 2559 projected.go:194] Error preparing data for projected volume kube-api-access-x9p7c for pod openshift-network-diagnostics/network-check-target-hkt2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:25.552709 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:25.552582 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c podName:f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:26.552565464 +0000 UTC m=+4.083829769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9p7c" (UniqueName: "kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c") pod "network-check-target-hkt2l" (UID: "f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:25.633152 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:25.633114 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84be9f15_fa8a_4426_825c_be4d3c9fcf1c.slice/crio-77d28a3b306d21e22ade33a8539b7dd95b36dd9e6706fedd23d41cef3ff20645 WatchSource:0}: Error finding container 77d28a3b306d21e22ade33a8539b7dd95b36dd9e6706fedd23d41cef3ff20645: Status 404 returned error can't find the container with id 77d28a3b306d21e22ade33a8539b7dd95b36dd9e6706fedd23d41cef3ff20645 Jun 03 08:51:25.634600 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:25.634570 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9932da_6f52_401b_a573_e160a5424714.slice/crio-3761cd0ef4916a9db8cf8493f14627c2168381ff228511548039bad82d690182 WatchSource:0}: Error finding container 3761cd0ef4916a9db8cf8493f14627c2168381ff228511548039bad82d690182: Status 404 returned error can't find the container with id 3761cd0ef4916a9db8cf8493f14627c2168381ff228511548039bad82d690182 Jun 03 08:51:25.635569 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:25.635405 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3b98fd_e96e_40e1_a238_f11c00121ebc.slice/crio-b1f746164450195b211b3b7a2ffb1fc46dac0c92fb28027c06b3008d07920178 WatchSource:0}: Error finding container b1f746164450195b211b3b7a2ffb1fc46dac0c92fb28027c06b3008d07920178: Status 404 returned error can't find the container with id b1f746164450195b211b3b7a2ffb1fc46dac0c92fb28027c06b3008d07920178 Jun 03 08:51:25.638229 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:25.638176 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b10fc1_f115_45ba_8967_7e75ea61f7f1.slice/crio-b2491ddbb10bfae6fc5501cf46575cd7ef7ce569580491e955bd46339d37bb05 WatchSource:0}: Error finding container b2491ddbb10bfae6fc5501cf46575cd7ef7ce569580491e955bd46339d37bb05: Status 404 returned error can't find the container with id b2491ddbb10bfae6fc5501cf46575cd7ef7ce569580491e955bd46339d37bb05 Jun 03 08:51:25.639440 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:25.639353 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod300c606c_8fd5_4de2_87ff_cad17d01162f.slice/crio-50fa1727471ab63a3574a0c8b8ba2b351fbe31d9a183329090bf4fc1eac45781 WatchSource:0}: Error finding container 50fa1727471ab63a3574a0c8b8ba2b351fbe31d9a183329090bf4fc1eac45781: Status 404 returned error can't find the container with id 50fa1727471ab63a3574a0c8b8ba2b351fbe31d9a183329090bf4fc1eac45781 Jun 03 08:51:25.640201 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:25.640177 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107776cd_7780_45a3_bcba_7016788a3afe.slice/crio-0185d8e04b5707b9dead6334ef81bcd4f62110a68846897e038019b76bb685d7 WatchSource:0}: Error finding container 0185d8e04b5707b9dead6334ef81bcd4f62110a68846897e038019b76bb685d7: Status 404 returned error can't find the container with id 0185d8e04b5707b9dead6334ef81bcd4f62110a68846897e038019b76bb685d7 Jun 03 08:51:25.642481 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:25.642331 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ad0a2b_8327_44fd_a0b4_b3c8ee715ceb.slice/crio-00a52b1ba5f173c3134cd51165a47f59cee5809ff5d41676ac9895094534c38d WatchSource:0}: Error finding container 00a52b1ba5f173c3134cd51165a47f59cee5809ff5d41676ac9895094534c38d: Status 404 returned error can't find the container with id 00a52b1ba5f173c3134cd51165a47f59cee5809ff5d41676ac9895094534c38d Jun 03 08:51:25.642706 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:25.642671 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a34e60_bdea_48dc_9d97_2a044d2faf19.slice/crio-e3d41591fdc1ea0f95d8f8486aa500096e5d72ed59b8ab894c9ef04d56c7ef3c WatchSource:0}: Error finding container e3d41591fdc1ea0f95d8f8486aa500096e5d72ed59b8ab894c9ef04d56c7ef3c: Status 404 returned error can't find the container with id e3d41591fdc1ea0f95d8f8486aa500096e5d72ed59b8ab894c9ef04d56c7ef3c Jun 03 08:51:25.908013 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.907866 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 08:46:23 +0000 UTC" deadline="2028-01-20 17:31:12.837334334 +0000 UTC" Jun 03 08:51:25.908396 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.908014 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14312h39m46.92932314s" Jun 03 08:51:25.942937 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.942909 2559 generic.go:358] "Generic (PLEG): container finished" podID="196131d32b8800ac6cdd27b418514c90" containerID="e18f9f777e29af7c2cd61a2fa5dabb31a9f037cd3452afe51b9057b272ffd827" exitCode=0 Jun 03 08:51:25.943050 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.942983 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" event={"ID":"196131d32b8800ac6cdd27b418514c90","Type":"ContainerDied","Data":"e18f9f777e29af7c2cd61a2fa5dabb31a9f037cd3452afe51b9057b272ffd827"} Jun 03 08:51:25.943954 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.943931 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdcjd" event={"ID":"80a34e60-bdea-48dc-9d97-2a044d2faf19","Type":"ContainerStarted","Data":"e3d41591fdc1ea0f95d8f8486aa500096e5d72ed59b8ab894c9ef04d56c7ef3c"} Jun 03 08:51:25.944866 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.944846 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" event={"ID":"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb","Type":"ContainerStarted","Data":"00a52b1ba5f173c3134cd51165a47f59cee5809ff5d41676ac9895094534c38d"} Jun 03 08:51:25.945715 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.945689 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jdntd" event={"ID":"300c606c-8fd5-4de2-87ff-cad17d01162f","Type":"ContainerStarted","Data":"50fa1727471ab63a3574a0c8b8ba2b351fbe31d9a183329090bf4fc1eac45781"} Jun 03 08:51:25.946590 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.946569 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" event={"ID":"4b3b98fd-e96e-40e1-a238-f11c00121ebc","Type":"ContainerStarted","Data":"b1f746164450195b211b3b7a2ffb1fc46dac0c92fb28027c06b3008d07920178"} Jun 03 08:51:25.947722 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.947701 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-104.ec2.internal" event={"ID":"7421be42ddd759e44d9f8c88d591ebb2","Type":"ContainerStarted","Data":"44d16c563c43ed5794b7affe85cfd7f847741b8e36f9b74901dd0a5ded821381"} Jun 03 08:51:25.948723 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.948705 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9zq8h" event={"ID":"107776cd-7780-45a3-bcba-7016788a3afe","Type":"ContainerStarted","Data":"0185d8e04b5707b9dead6334ef81bcd4f62110a68846897e038019b76bb685d7"} Jun 03 08:51:25.949608 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.949580 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h82q6" event={"ID":"54b10fc1-f115-45ba-8967-7e75ea61f7f1","Type":"ContainerStarted","Data":"b2491ddbb10bfae6fc5501cf46575cd7ef7ce569580491e955bd46339d37bb05"} Jun 03 08:51:25.950508 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.950488 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rrl7z" event={"ID":"ba9932da-6f52-401b-a573-e160a5424714","Type":"ContainerStarted","Data":"3761cd0ef4916a9db8cf8493f14627c2168381ff228511548039bad82d690182"} Jun 03 08:51:25.951344 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.951328 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cd2df" event={"ID":"84be9f15-fa8a-4426-825c-be4d3c9fcf1c","Type":"ContainerStarted","Data":"77d28a3b306d21e22ade33a8539b7dd95b36dd9e6706fedd23d41cef3ff20645"} Jun 03 08:51:25.979523 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:25.979479 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-104.ec2.internal" podStartSLOduration=1.979469297 podStartE2EDuration="1.979469297s" podCreationTimestamp="2026-06-03 08:51:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:51:25.97932197 +0000 UTC m=+3.510586279" watchObservedRunningTime="2026-06-03 08:51:25.979469297 +0000 UTC m=+3.510733604" Jun 03 08:51:26.458490 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:26.458412 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:26.458640 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:26.458508 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:26.458705 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:26.458640 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:26.458705 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:26.458697 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret podName:ed0f87f6-b558-43fd-bf3a-67c9c21049c1 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:28.458679143 +0000 UTC m=+5.989943435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret") pod "global-pull-secret-syncer-hssgq" (UID: "ed0f87f6-b558-43fd-bf3a-67c9c21049c1") : object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:26.459149 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:26.459126 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:26.459240 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:26.459185 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs podName:30768073-4636-4456-aa24-a47199e99a4d nodeName:}" failed. No retries permitted until 2026-06-03 08:51:28.459169274 +0000 UTC m=+5.990433565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs") pod "network-metrics-daemon-2sx6r" (UID: "30768073-4636-4456-aa24-a47199e99a4d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:26.559906 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:26.559867 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9p7c\" (UniqueName: \"kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c\") pod \"network-check-target-hkt2l\" (UID: \"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3\") " pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:26.560081 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:26.560035 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:51:26.560081 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:26.560053 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:51:26.560081 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:26.560066 2559 projected.go:194] Error preparing data for projected volume kube-api-access-x9p7c for pod openshift-network-diagnostics/network-check-target-hkt2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:26.560262 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:26.560125 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c podName:f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:28.560106236 +0000 UTC m=+6.091370537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9p7c" (UniqueName: "kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c") pod "network-check-target-hkt2l" (UID: "f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:26.938719 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:26.938565 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:26.938719 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:26.938689 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:26.939318 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:26.939099 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:26.939318 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:26.939202 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:26.939468 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:26.939338 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:26.939468 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:26.939432 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:26.989949 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:26.989899 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" event={"ID":"196131d32b8800ac6cdd27b418514c90","Type":"ContainerStarted","Data":"f658f66b54d730be5a1966aca22d6dd4e0f8b5c5965cdbb0d2dd59c8a6eda29c"} Jun 03 08:51:27.007431 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:27.006509 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-104.ec2.internal" podStartSLOduration=3.006494728 podStartE2EDuration="3.006494728s" podCreationTimestamp="2026-06-03 08:51:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:51:27.005799824 +0000 UTC m=+4.537064130" watchObservedRunningTime="2026-06-03 08:51:27.006494728 +0000 UTC m=+4.537759037" Jun 03 08:51:28.476580 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:28.476553 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:28.477009 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:28.476596 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:28.477009 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:28.476701 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:28.477009 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:28.476712 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:28.477009 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:28.476755 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret podName:ed0f87f6-b558-43fd-bf3a-67c9c21049c1 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:32.476738002 +0000 UTC m=+10.008002288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret") pod "global-pull-secret-syncer-hssgq" (UID: "ed0f87f6-b558-43fd-bf3a-67c9c21049c1") : object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:28.477009 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:28.476771 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs podName:30768073-4636-4456-aa24-a47199e99a4d nodeName:}" failed. No retries permitted until 2026-06-03 08:51:32.476762609 +0000 UTC m=+10.008026901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs") pod "network-metrics-daemon-2sx6r" (UID: "30768073-4636-4456-aa24-a47199e99a4d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:28.578335 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:28.577697 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9p7c\" (UniqueName: \"kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c\") pod \"network-check-target-hkt2l\" (UID: \"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3\") " pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:28.578335 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:28.577842 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:51:28.578335 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:28.577864 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:51:28.578335 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:28.577876 2559 projected.go:194] Error preparing data for projected volume kube-api-access-x9p7c for pod openshift-network-diagnostics/network-check-target-hkt2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:28.578335 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:28.577929 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c podName:f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:32.577912083 +0000 UTC m=+10.109176374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9p7c" (UniqueName: "kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c") pod "network-check-target-hkt2l" (UID: "f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:28.936640 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:28.936543 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:28.936797 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:28.936673 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:28.936797 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:28.936561 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:28.936797 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:28.936768 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:28.936797 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:28.936551 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:28.936998 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:28.936853 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:30.327351 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.327319 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-qgff7"] Jun 03 08:51:30.335385 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.335360 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qgff7" Jun 03 08:51:30.338069 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.338046 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 08:51:30.338302 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.338269 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 08:51:30.338494 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.338477 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h6jln\"" Jun 03 08:51:30.391076 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.391034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dbc468ac-b2d9-40e6-a60f-a16d79b3720b-hosts-file\") pod \"node-resolver-qgff7\" (UID: \"dbc468ac-b2d9-40e6-a60f-a16d79b3720b\") " pod="openshift-dns/node-resolver-qgff7" Jun 03 08:51:30.391647 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.391129 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmxv8\" (UniqueName: \"kubernetes.io/projected/dbc468ac-b2d9-40e6-a60f-a16d79b3720b-kube-api-access-qmxv8\") pod \"node-resolver-qgff7\" (UID: \"dbc468ac-b2d9-40e6-a60f-a16d79b3720b\") " pod="openshift-dns/node-resolver-qgff7" Jun 03 08:51:30.391740 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.391698 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbc468ac-b2d9-40e6-a60f-a16d79b3720b-tmp-dir\") pod \"node-resolver-qgff7\" (UID: \"dbc468ac-b2d9-40e6-a60f-a16d79b3720b\") " pod="openshift-dns/node-resolver-qgff7" Jun 03 08:51:30.492613 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.492375 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dbc468ac-b2d9-40e6-a60f-a16d79b3720b-hosts-file\") pod \"node-resolver-qgff7\" (UID: \"dbc468ac-b2d9-40e6-a60f-a16d79b3720b\") " pod="openshift-dns/node-resolver-qgff7" Jun 03 08:51:30.492613 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.492466 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmxv8\" (UniqueName: \"kubernetes.io/projected/dbc468ac-b2d9-40e6-a60f-a16d79b3720b-kube-api-access-qmxv8\") pod \"node-resolver-qgff7\" (UID: \"dbc468ac-b2d9-40e6-a60f-a16d79b3720b\") " pod="openshift-dns/node-resolver-qgff7" Jun 03 08:51:30.492613 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.492521 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbc468ac-b2d9-40e6-a60f-a16d79b3720b-tmp-dir\") pod \"node-resolver-qgff7\" (UID: \"dbc468ac-b2d9-40e6-a60f-a16d79b3720b\") " pod="openshift-dns/node-resolver-qgff7" Jun 03 08:51:30.492860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.492644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dbc468ac-b2d9-40e6-a60f-a16d79b3720b-hosts-file\") pod \"node-resolver-qgff7\" (UID: \"dbc468ac-b2d9-40e6-a60f-a16d79b3720b\") " pod="openshift-dns/node-resolver-qgff7" Jun 03 08:51:30.493833 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.493806 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbc468ac-b2d9-40e6-a60f-a16d79b3720b-tmp-dir\") pod \"node-resolver-qgff7\" (UID: \"dbc468ac-b2d9-40e6-a60f-a16d79b3720b\") " pod="openshift-dns/node-resolver-qgff7" Jun 03 08:51:30.504091 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.504030 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmxv8\" (UniqueName: \"kubernetes.io/projected/dbc468ac-b2d9-40e6-a60f-a16d79b3720b-kube-api-access-qmxv8\") pod \"node-resolver-qgff7\" (UID: \"dbc468ac-b2d9-40e6-a60f-a16d79b3720b\") " pod="openshift-dns/node-resolver-qgff7" Jun 03 08:51:30.647971 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.647556 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qgff7" Jun 03 08:51:30.935880 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.935759 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:30.935880 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.935759 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:30.936087 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:30.935882 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:30.936087 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:30.935992 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:30.936087 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:30.935759 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:30.936087 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:30.936082 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:32.506953 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:32.506912 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:32.507434 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:32.506980 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:32.507434 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:32.507072 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:32.507434 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:32.507094 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:32.507434 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:32.507142 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret podName:ed0f87f6-b558-43fd-bf3a-67c9c21049c1 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:40.507123874 +0000 UTC m=+18.038388164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret") pod "global-pull-secret-syncer-hssgq" (UID: "ed0f87f6-b558-43fd-bf3a-67c9c21049c1") : object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:32.507434 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:32.507164 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs podName:30768073-4636-4456-aa24-a47199e99a4d nodeName:}" failed. No retries permitted until 2026-06-03 08:51:40.507152555 +0000 UTC m=+18.038416848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs") pod "network-metrics-daemon-2sx6r" (UID: "30768073-4636-4456-aa24-a47199e99a4d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:32.607344 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:32.607309 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9p7c\" (UniqueName: \"kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c\") pod \"network-check-target-hkt2l\" (UID: \"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3\") " pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:32.607526 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:32.607489 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:51:32.607526 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:32.607512 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:51:32.607526 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:32.607524 2559 projected.go:194] Error preparing data for projected volume kube-api-access-x9p7c for pod openshift-network-diagnostics/network-check-target-hkt2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:32.607669 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:32.607582 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c podName:f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:40.607563243 +0000 UTC m=+18.138827546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9p7c" (UniqueName: "kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c") pod "network-check-target-hkt2l" (UID: "f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:32.937338 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:32.937307 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:32.937525 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:32.937404 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:32.937765 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:32.937744 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:32.937869 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:32.937848 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:32.937928 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:32.937904 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:32.938102 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:32.937979 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:34.935700 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:34.935668 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:34.936173 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:34.935669 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:34.936242 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:34.936204 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:34.936318 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:34.936195 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:34.936381 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:34.936356 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:34.936595 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:34.936575 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:36.938732 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:36.938705 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:36.939301 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:36.938705 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:36.939301 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:36.938820 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:36.939301 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:36.938914 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:36.939301 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:36.938705 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:36.939301 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:36.939039 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:38.936389 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:38.936070 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:38.936389 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:38.936104 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:38.936389 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:38.936122 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:38.936389 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:38.936245 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:38.936389 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:38.936332 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:38.936931 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:38.936422 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:40.571122 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:40.571088 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:40.571608 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:40.571136 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:40.571608 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:40.571247 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:40.571608 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:40.571250 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:40.571608 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:40.571319 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs podName:30768073-4636-4456-aa24-a47199e99a4d nodeName:}" failed. No retries permitted until 2026-06-03 08:51:56.571300435 +0000 UTC m=+34.102564722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs") pod "network-metrics-daemon-2sx6r" (UID: "30768073-4636-4456-aa24-a47199e99a4d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:40.571608 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:40.571333 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret podName:ed0f87f6-b558-43fd-bf3a-67c9c21049c1 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:56.57132762 +0000 UTC m=+34.102591905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret") pod "global-pull-secret-syncer-hssgq" (UID: "ed0f87f6-b558-43fd-bf3a-67c9c21049c1") : object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:40.672390 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:40.672364 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9p7c\" (UniqueName: \"kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c\") pod \"network-check-target-hkt2l\" (UID: \"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3\") " pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:40.672558 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:40.672511 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:51:40.672558 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:40.672528 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:51:40.672558 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:40.672536 2559 projected.go:194] Error preparing data for projected volume kube-api-access-x9p7c for pod openshift-network-diagnostics/network-check-target-hkt2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:40.672713 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:40.672583 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c podName:f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:56.672565774 +0000 UTC m=+34.203830062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9p7c" (UniqueName: "kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c") pod "network-check-target-hkt2l" (UID: "f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:40.935965 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:40.935893 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:40.935965 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:40.935917 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:40.935965 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:40.935935 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:40.936228 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:40.936011 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:40.936228 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:40.936100 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:40.936228 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:40.936195 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:42.937023 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:42.937000 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:42.937396 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:42.937066 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:42.937396 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:42.937143 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:42.937396 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:42.937234 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:42.937396 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:42.937278 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:42.937396 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:42.937361 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:43.283534 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:51:43.283505 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc468ac_b2d9_40e6_a60f_a16d79b3720b.slice/crio-93b454403f105e9d28809e9803a23658741a07a7597d13baac2f6ccdb937c33c WatchSource:0}: Error finding container 93b454403f105e9d28809e9803a23658741a07a7597d13baac2f6ccdb937c33c: Status 404 returned error can't find the container with id 93b454403f105e9d28809e9803a23658741a07a7597d13baac2f6ccdb937c33c Jun 03 08:51:44.018119 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.017906 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9zq8h" event={"ID":"107776cd-7780-45a3-bcba-7016788a3afe","Type":"ContainerStarted","Data":"d2de2f043411ea98e5515042b624beb7ec9f5e24ea96905fc7527ce9247ce748"} Jun 03 08:51:44.022336 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.022305 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h82q6" event={"ID":"54b10fc1-f115-45ba-8967-7e75ea61f7f1","Type":"ContainerStarted","Data":"b0068afc34802af9d08406a88030a498b4713068cae73ec3f51ee2cd1bcf866c"} Jun 03 08:51:44.023576 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.023552 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rrl7z" event={"ID":"ba9932da-6f52-401b-a573-e160a5424714","Type":"ContainerStarted","Data":"69254595b3005be0adb8ca03825f063358e7a17c94ad2eba80c85f90f6539ac5"} Jun 03 08:51:44.024980 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.024953 2559 generic.go:358] "Generic (PLEG): container finished" podID="80a34e60-bdea-48dc-9d97-2a044d2faf19" containerID="849a62f9b919b803f76a73efe693a2259af073fba4ee89358ebfe7186f9caf3e" exitCode=0 Jun 03 08:51:44.025056 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.025025 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdcjd" event={"ID":"80a34e60-bdea-48dc-9d97-2a044d2faf19","Type":"ContainerDied","Data":"849a62f9b919b803f76a73efe693a2259af073fba4ee89358ebfe7186f9caf3e"} Jun 03 08:51:44.026445 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.026424 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" event={"ID":"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb","Type":"ContainerStarted","Data":"ee8cc2d5d92c2bba18148bdb868b9e5d34dcc0469bad6b62398e263e2eb64cb9"} Jun 03 08:51:44.029743 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.029724 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jdntd" event={"ID":"300c606c-8fd5-4de2-87ff-cad17d01162f","Type":"ContainerStarted","Data":"d823f12132c8c782c7a9cafc277e36ab3aea82151fe92a71b6102ae7bc6eb6bd"} Jun 03 08:51:44.032221 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.032204 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/ovn-acl-logging/0.log" Jun 03 08:51:44.032531 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.032515 2559 generic.go:358] "Generic (PLEG): container finished" podID="4b3b98fd-e96e-40e1-a238-f11c00121ebc" containerID="cfabc82359002bf89258ebe5c0382131205d654ef9184d0fa2edb25f7940f0fe" exitCode=1 Jun 03 08:51:44.032620 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.032576 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" event={"ID":"4b3b98fd-e96e-40e1-a238-f11c00121ebc","Type":"ContainerStarted","Data":"7257470ad5c3f772968e42b91bcb15d78c2e1fe0d98f702457a534c6a648d9ff"} Jun 03 08:51:44.032620 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.032603 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" event={"ID":"4b3b98fd-e96e-40e1-a238-f11c00121ebc","Type":"ContainerStarted","Data":"f62c3ae4fb9c7277869c61fad31c6c30b85d19e198131d4adaa781584bf72f2b"} Jun 03 08:51:44.032620 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.032615 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" event={"ID":"4b3b98fd-e96e-40e1-a238-f11c00121ebc","Type":"ContainerStarted","Data":"0d8457bda8f7a459fdee8c4828fc5c0a19f9dd3be19d07ededd02fa22664f2e4"} Jun 03 08:51:44.032739 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.032627 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" event={"ID":"4b3b98fd-e96e-40e1-a238-f11c00121ebc","Type":"ContainerStarted","Data":"a290fe87dfbcdfdc416658b0908aa5f1e8191cc6afea1ad44c8afd8b02173bb6"} Jun 03 08:51:44.032739 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.032641 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" event={"ID":"4b3b98fd-e96e-40e1-a238-f11c00121ebc","Type":"ContainerDied","Data":"cfabc82359002bf89258ebe5c0382131205d654ef9184d0fa2edb25f7940f0fe"} Jun 03 08:51:44.032739 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.032656 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" event={"ID":"4b3b98fd-e96e-40e1-a238-f11c00121ebc","Type":"ContainerStarted","Data":"a810fb47ba73dee93277cc4f7544e6949193c4b1f6319e632bfd80a944390b15"} Jun 03 08:51:44.033937 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.033915 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qgff7" event={"ID":"dbc468ac-b2d9-40e6-a60f-a16d79b3720b","Type":"ContainerStarted","Data":"9060e5e68055a28077b2ecb4710ea4b187d6bcf3e77f7d3d5d902fe16cbb14a9"} Jun 03 08:51:44.034012 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.033935 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qgff7" event={"ID":"dbc468ac-b2d9-40e6-a60f-a16d79b3720b","Type":"ContainerStarted","Data":"93b454403f105e9d28809e9803a23658741a07a7597d13baac2f6ccdb937c33c"} Jun 03 08:51:44.034580 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.034540 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-9zq8h" podStartSLOduration=3.327479275 podStartE2EDuration="21.034528634s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="2026-06-03 08:51:25.644006958 +0000 UTC m=+3.175271248" lastFinishedPulling="2026-06-03 08:51:43.351056317 +0000 UTC m=+20.882320607" observedRunningTime="2026-06-03 08:51:44.034491701 +0000 UTC m=+21.565756010" watchObservedRunningTime="2026-06-03 08:51:44.034528634 +0000 UTC m=+21.565792943" Jun 03 08:51:44.048901 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.048818 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rrl7z" podStartSLOduration=11.70927732 podStartE2EDuration="21.048807964s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="2026-06-03 08:51:25.636923393 +0000 UTC m=+3.168187684" lastFinishedPulling="2026-06-03 08:51:34.976454035 +0000 UTC m=+12.507718328" observedRunningTime="2026-06-03 08:51:44.048651137 +0000 UTC m=+21.579915445" watchObservedRunningTime="2026-06-03 08:51:44.048807964 +0000 UTC m=+21.580072273" Jun 03 08:51:44.063381 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.063347 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h82q6" podStartSLOduration=3.367008231 podStartE2EDuration="21.063337321s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="2026-06-03 08:51:25.641012672 +0000 UTC m=+3.172276958" lastFinishedPulling="2026-06-03 08:51:43.337341757 +0000 UTC m=+20.868606048" observedRunningTime="2026-06-03 08:51:44.06286153 +0000 UTC m=+21.594125839" watchObservedRunningTime="2026-06-03 08:51:44.063337321 +0000 UTC m=+21.594601628" Jun 03 08:51:44.080005 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.079962 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jdntd" podStartSLOduration=3.441220717 podStartE2EDuration="21.079952854s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="2026-06-03 08:51:25.641840665 +0000 UTC m=+3.173104964" lastFinishedPulling="2026-06-03 08:51:43.2805728 +0000 UTC m=+20.811837101" observedRunningTime="2026-06-03 08:51:44.0796462 +0000 UTC m=+21.610910508" watchObservedRunningTime="2026-06-03 08:51:44.079952854 +0000 UTC m=+21.611217161" Jun 03 08:51:44.115627 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.115586 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qgff7" podStartSLOduration=14.115573664 podStartE2EDuration="14.115573664s" podCreationTimestamp="2026-06-03 08:51:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:51:44.115053165 +0000 UTC m=+21.646317472" watchObservedRunningTime="2026-06-03 08:51:44.115573664 +0000 UTC m=+21.646837973" Jun 03 08:51:44.936053 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.936030 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:44.936182 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.936055 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:44.936182 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:44.936030 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:44.936314 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:44.936192 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:44.936314 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:44.936260 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:44.936405 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:44.936354 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:45.037329 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:45.037298 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cd2df" event={"ID":"84be9f15-fa8a-4426-825c-be4d3c9fcf1c","Type":"ContainerStarted","Data":"eb29bf1742aef37db10197d8054e863aa5ffd68d30b134145e8e74ced045fb87"} Jun 03 08:51:45.058016 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:45.057994 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 08:51:45.912992 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:45.912880 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T08:51:45.058010973Z","UUID":"284ddfaf-8005-4643-a9d3-477d69cac9ad","Handler":null,"Name":"","Endpoint":""} Jun 03 08:51:45.914858 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:45.914831 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 08:51:45.914987 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:45.914866 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 08:51:46.040873 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:46.040835 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" event={"ID":"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb","Type":"ContainerStarted","Data":"e977e380e4410b0382088081a029ba1d901b30a929366d6184eb2573345742e3"} Jun 03 08:51:46.369267 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:46.369231 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:46.369923 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:46.369898 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:46.424678 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:46.424626 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cd2df" podStartSLOduration=10.580963317 podStartE2EDuration="23.42461067s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="2026-06-03 08:51:25.635809936 +0000 UTC m=+3.167074222" lastFinishedPulling="2026-06-03 08:51:38.479457283 +0000 UTC m=+16.010721575" observedRunningTime="2026-06-03 08:51:45.055931911 +0000 UTC m=+22.587196220" watchObservedRunningTime="2026-06-03 08:51:46.42461067 +0000 UTC m=+23.955874981" Jun 03 08:51:46.936084 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:46.935885 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:46.936084 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:46.935893 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:46.936334 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:46.936132 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:46.936334 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:46.935893 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:46.936334 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:46.936190 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:46.936334 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:46.936258 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:47.044083 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:47.044050 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" event={"ID":"71ad0a2b-8327-44fd-a0b4-b3c8ee715ceb","Type":"ContainerStarted","Data":"00d3007fdf0c4a7babad471649a20af6471333ce2107b4dd4b1a53b60ce06a0a"} Jun 03 08:51:47.046848 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:47.046825 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/ovn-acl-logging/0.log" Jun 03 08:51:47.047195 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:47.047175 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" event={"ID":"4b3b98fd-e96e-40e1-a238-f11c00121ebc","Type":"ContainerStarted","Data":"784ec3530c4c83090665603e48521ae9fb9626268c05527ae3ce9c168a47859f"} Jun 03 08:51:47.066823 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:47.066776 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vw7fp" podStartSLOduration=3.222249081 podStartE2EDuration="24.0667631s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="2026-06-03 08:51:25.644950863 +0000 UTC m=+3.176215155" lastFinishedPulling="2026-06-03 08:51:46.489464875 +0000 UTC m=+24.020729174" observedRunningTime="2026-06-03 08:51:47.066651427 +0000 UTC m=+24.597915737" watchObservedRunningTime="2026-06-03 08:51:47.0667631 +0000 UTC m=+24.598027410" Jun 03 08:51:48.935798 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:48.935763 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:48.936482 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:48.935771 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:48.936482 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:48.935899 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:48.936482 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:48.935893 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:48.936482 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:48.936035 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:48.936482 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:48.936155 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:50.054031 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:50.053833 2559 generic.go:358] "Generic (PLEG): container finished" podID="80a34e60-bdea-48dc-9d97-2a044d2faf19" containerID="7c809a303f6c70d56318dc4c3edfe1e334a0499e0a5b45edd304352e411edbf1" exitCode=0 Jun 03 08:51:50.054505 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:50.053885 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdcjd" event={"ID":"80a34e60-bdea-48dc-9d97-2a044d2faf19","Type":"ContainerDied","Data":"7c809a303f6c70d56318dc4c3edfe1e334a0499e0a5b45edd304352e411edbf1"} Jun 03 08:51:50.057244 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:50.057230 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/ovn-acl-logging/0.log" Jun 03 08:51:50.057598 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:50.057566 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" event={"ID":"4b3b98fd-e96e-40e1-a238-f11c00121ebc","Type":"ContainerStarted","Data":"378d30f06b9a7ffd5f047bc97cc5f448e834197bc0db981c4656e7aa20016df4"} Jun 03 08:51:50.057847 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:50.057831 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:50.057972 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:50.057959 2559 scope.go:117] "RemoveContainer" containerID="cfabc82359002bf89258ebe5c0382131205d654ef9184d0fa2edb25f7940f0fe" Jun 03 08:51:50.073576 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:50.073560 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:50.936664 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:50.936632 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:50.936824 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:50.936632 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:50.936824 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:50.936752 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:50.936824 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:50.936743 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:50.936824 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:50.936819 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:50.937019 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:50.936866 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:51.071957 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.071933 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/ovn-acl-logging/0.log" Jun 03 08:51:51.072385 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.072189 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" event={"ID":"4b3b98fd-e96e-40e1-a238-f11c00121ebc","Type":"ContainerStarted","Data":"696f85ae8a6a0c65d3f5cf13bebbb9c5d9896d6f90de36cd382db6902545d141"} Jun 03 08:51:51.072457 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.072440 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:51.072525 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.072513 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:51.087474 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.087454 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:51:51.105010 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.104972 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" podStartSLOduration=10.348516471 podStartE2EDuration="28.104961143s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="2026-06-03 08:51:25.637802744 +0000 UTC m=+3.169067046" lastFinishedPulling="2026-06-03 08:51:43.394247418 +0000 UTC m=+20.925511718" observedRunningTime="2026-06-03 08:51:51.104062358 +0000 UTC m=+28.635326665" watchObservedRunningTime="2026-06-03 08:51:51.104961143 +0000 UTC m=+28.636225450" Jun 03 08:51:51.249958 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.249932 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hssgq"] Jun 03 08:51:51.250067 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.250035 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:51.250159 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:51.250138 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:51.253498 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.253474 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hkt2l"] Jun 03 08:51:51.253573 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.253561 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:51.253691 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:51.253669 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:51.256974 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.256952 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2sx6r"] Jun 03 08:51:51.257054 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.257039 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:51.257130 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:51.257114 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:51.411353 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.411322 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:51.411488 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.411463 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 08:51:51.411909 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:51.411895 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jdntd" Jun 03 08:51:52.075672 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:52.075638 2559 generic.go:358] "Generic (PLEG): container finished" podID="80a34e60-bdea-48dc-9d97-2a044d2faf19" containerID="09c1d9b0612862f6a7afbf83f8fd3654a64d9f9e6c2f9ab06bd1ec90dbfe3a4a" exitCode=0 Jun 03 08:51:52.076193 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:52.075723 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdcjd" event={"ID":"80a34e60-bdea-48dc-9d97-2a044d2faf19","Type":"ContainerDied","Data":"09c1d9b0612862f6a7afbf83f8fd3654a64d9f9e6c2f9ab06bd1ec90dbfe3a4a"} Jun 03 08:51:52.936458 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:52.936435 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:52.936554 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:52.936508 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:52.936603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:52.936580 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:52.936743 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:52.936720 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:52.936802 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:52.936783 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:52.936923 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:52.936903 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:53.079230 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:53.079201 2559 generic.go:358] "Generic (PLEG): container finished" podID="80a34e60-bdea-48dc-9d97-2a044d2faf19" containerID="f738b3f42866561e18534b81ec803474a0900b73c23a31213225d9537da2964b" exitCode=0 Jun 03 08:51:53.079705 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:53.079300 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdcjd" event={"ID":"80a34e60-bdea-48dc-9d97-2a044d2faf19","Type":"ContainerDied","Data":"f738b3f42866561e18534b81ec803474a0900b73c23a31213225d9537da2964b"} Jun 03 08:51:54.935842 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:54.935815 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:54.935842 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:54.935831 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:54.936490 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:54.935929 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkt2l" podUID="f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3" Jun 03 08:51:54.936490 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:54.936004 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:54.936490 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:54.936122 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:51:54.936490 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:54.936215 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hssgq" podUID="ed0f87f6-b558-43fd-bf3a-67c9c21049c1" Jun 03 08:51:56.293414 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.293340 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-104.ec2.internal" event="NodeReady" Jun 03 08:51:56.293772 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.293461 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 08:51:56.339955 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.339896 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2"] Jun 03 08:51:56.362891 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.362866 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d7c8999fd-dqqgg"] Jun 03 08:51:56.363039 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.363011 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:51:56.366339 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.366315 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 08:51:56.367015 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.366993 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rcmzp\"" Jun 03 08:51:56.367263 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.367248 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 08:51:56.380807 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.380775 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2"] Jun 03 08:51:56.380807 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.380807 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-plgjm"] Jun 03 08:51:56.380972 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.380819 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.383397 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.383377 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 08:51:56.383591 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.383572 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 08:51:56.383764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.383728 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 08:51:56.383966 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.383936 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6n6ft\"" Jun 03 08:51:56.399731 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.399712 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 08:51:56.411036 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.411017 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d7c8999fd-dqqgg"] Jun 03 08:51:56.411133 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.411045 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-45tmd"] Jun 03 08:51:56.411203 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.411179 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.414299 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.414273 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 08:51:56.414780 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.414761 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 08:51:56.414893 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.414813 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nv5kj\"" Jun 03 08:51:56.435092 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.435072 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-plgjm"] Jun 03 08:51:56.435178 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.435097 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-45tmd"] Jun 03 08:51:56.435223 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.435179 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:51:56.438457 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.438436 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 08:51:56.438735 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.438719 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f4l24\"" Jun 03 08:51:56.438999 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.438984 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 08:51:56.439201 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.439183 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 08:51:56.490789 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.490753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6379b8f-9270-4976-8f9e-1e91d766b9b9-config-volume\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.490789 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.490791 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-bound-sa-token\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.491001 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.490867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.491001 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.490891 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6379b8f-9270-4976-8f9e-1e91d766b9b9-tmp-dir\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.491001 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.490913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-installation-pull-secrets\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.491001 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.490952 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9knz\" (UniqueName: \"kubernetes.io/projected/b6379b8f-9270-4976-8f9e-1e91d766b9b9-kube-api-access-z9knz\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.491001 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.490982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs7f7\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-kube-api-access-hs7f7\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.491247 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.491025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-trusted-ca\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.491247 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.491068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-certificates\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.491247 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.491099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.491247 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.491125 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0cf56bdc-559e-468b-8839-c9fd2a22e247-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:51:56.491247 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.491151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:51:56.491247 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.491177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-image-registry-private-configuration\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.491247 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.491207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-ca-trust-extracted\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.591663 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.591587 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:56.591663 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.591611 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:56.591663 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.591654 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.591931 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.591687 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret podName:ed0f87f6-b558-43fd-bf3a-67c9c21049c1 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:28.5916658 +0000 UTC m=+66.122930085 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret") pod "global-pull-secret-syncer-hssgq" (UID: "ed0f87f6-b558-43fd-bf3a-67c9c21049c1") : object "kube-system"/"original-pull-secret" not registered Jun 03 08:51:56.591931 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.591708 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6379b8f-9270-4976-8f9e-1e91d766b9b9-tmp-dir\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.591931 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.591740 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-installation-pull-secrets\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.591931 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.591751 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:51:56.591931 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.591772 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9knz\" (UniqueName: \"kubernetes.io/projected/b6379b8f-9270-4976-8f9e-1e91d766b9b9-kube-api-access-z9knz\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.591931 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.591798 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hs7f7\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-kube-api-access-hs7f7\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.591931 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.591812 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls podName:b6379b8f-9270-4976-8f9e-1e91d766b9b9 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:57.091796068 +0000 UTC m=+34.623060355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls") pod "dns-default-plgjm" (UID: "b6379b8f-9270-4976-8f9e-1e91d766b9b9") : secret "dns-default-metrics-tls" not found Jun 03 08:51:56.591931 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.591850 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-trusted-ca\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.591931 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.591883 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:56.591931 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.591911 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-certificates\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.592462 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.591945 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.592462 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.591974 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0cf56bdc-559e-468b-8839-c9fd2a22e247-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:51:56.592462 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.592000 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:51:56.592462 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.592023 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-image-registry-private-configuration\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.592462 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.592048 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-ca-trust-extracted\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.592462 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.592074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:51:56.592462 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.592116 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2sxc\" (UniqueName: \"kubernetes.io/projected/3230ad30-2269-4401-bf72-d7ffeeebd823-kube-api-access-g2sxc\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:51:56.592462 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.592118 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6379b8f-9270-4976-8f9e-1e91d766b9b9-tmp-dir\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.592462 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.592167 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6379b8f-9270-4976-8f9e-1e91d766b9b9-config-volume\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.592462 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.592194 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-bound-sa-token\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.592932 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.592491 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 08:51:56.592932 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.592511 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7c8999fd-dqqgg: secret "image-registry-tls" not found Jun 03 08:51:56.592932 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.592573 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls podName:e89c34e5-1069-4ef2-af5f-dd70d0be8c5b nodeName:}" failed. No retries permitted until 2026-06-03 08:51:57.092556527 +0000 UTC m=+34.623820830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls") pod "image-registry-5d7c8999fd-dqqgg" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b") : secret "image-registry-tls" not found Jun 03 08:51:56.592932 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.592614 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-certificates\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.592932 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.592663 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:56.592932 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.592699 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs podName:30768073-4636-4456-aa24-a47199e99a4d nodeName:}" failed. No retries permitted until 2026-06-03 08:52:28.592686679 +0000 UTC m=+66.123950979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs") pod "network-metrics-daemon-2sx6r" (UID: "30768073-4636-4456-aa24-a47199e99a4d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:51:56.592932 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.592756 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 08:51:56.592932 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.592789 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert podName:0cf56bdc-559e-468b-8839-c9fd2a22e247 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:57.092777644 +0000 UTC m=+34.624041939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-bk6b2" (UID: "0cf56bdc-559e-468b-8839-c9fd2a22e247") : secret "networking-console-plugin-cert" not found Jun 03 08:51:56.592932 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.592855 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0cf56bdc-559e-468b-8839-c9fd2a22e247-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:51:56.593379 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.592939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-ca-trust-extracted\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.593452 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.593428 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-trusted-ca\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.596489 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.596462 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-installation-pull-secrets\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.596599 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.596494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-image-registry-private-configuration\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.603665 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.603642 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6379b8f-9270-4976-8f9e-1e91d766b9b9-config-volume\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.606887 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.606863 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9knz\" (UniqueName: \"kubernetes.io/projected/b6379b8f-9270-4976-8f9e-1e91d766b9b9-kube-api-access-z9knz\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:56.607082 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.607059 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs7f7\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-kube-api-access-hs7f7\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.608468 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.608444 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-bound-sa-token\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:56.693360 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.693321 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:51:56.693518 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.693382 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2sxc\" (UniqueName: \"kubernetes.io/projected/3230ad30-2269-4401-bf72-d7ffeeebd823-kube-api-access-g2sxc\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:51:56.693518 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.693422 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9p7c\" (UniqueName: \"kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c\") pod \"network-check-target-hkt2l\" (UID: \"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3\") " pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:56.693518 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.693445 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:51:56.693518 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.693508 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert podName:3230ad30-2269-4401-bf72-d7ffeeebd823 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:57.193493484 +0000 UTC m=+34.724757789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert") pod "ingress-canary-45tmd" (UID: "3230ad30-2269-4401-bf72-d7ffeeebd823") : secret "canary-serving-cert" not found Jun 03 08:51:56.693698 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.693609 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:51:56.693698 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.693633 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:51:56.693698 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.693646 2559 projected.go:194] Error preparing data for projected volume kube-api-access-x9p7c for pod openshift-network-diagnostics/network-check-target-hkt2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:56.693698 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:56.693698 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c podName:f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:28.6936816 +0000 UTC m=+66.224945890 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9p7c" (UniqueName: "kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c") pod "network-check-target-hkt2l" (UID: "f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:51:56.709766 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.709741 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2sxc\" (UniqueName: \"kubernetes.io/projected/3230ad30-2269-4401-bf72-d7ffeeebd823-kube-api-access-g2sxc\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:51:56.936385 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.936312 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:51:56.936569 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.936312 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:51:56.936569 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.936322 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:51:56.940889 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.940865 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 08:51:56.941019 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.941003 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 08:51:56.941091 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.941022 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 08:51:56.941145 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.941127 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-99vdf\"" Jun 03 08:51:56.941355 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.941337 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n9vs5\"" Jun 03 08:51:56.941355 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:56.941351 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 08:51:57.097767 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:57.097734 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:57.097938 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:57.097782 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:51:57.097938 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:57.097896 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 08:51:57.097938 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:57.097916 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7c8999fd-dqqgg: secret "image-registry-tls" not found Jun 03 08:51:57.098096 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:57.097960 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 08:51:57.098096 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:57.097985 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls podName:e89c34e5-1069-4ef2-af5f-dd70d0be8c5b nodeName:}" failed. No retries permitted until 2026-06-03 08:51:58.097963922 +0000 UTC m=+35.629228225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls") pod "image-registry-5d7c8999fd-dqqgg" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b") : secret "image-registry-tls" not found Jun 03 08:51:57.098096 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:57.098030 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:57.098096 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:57.098041 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert podName:0cf56bdc-559e-468b-8839-c9fd2a22e247 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:58.098021859 +0000 UTC m=+35.629286161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-bk6b2" (UID: "0cf56bdc-559e-468b-8839-c9fd2a22e247") : secret "networking-console-plugin-cert" not found Jun 03 08:51:57.098096 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:57.098093 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:51:57.098316 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:57.098129 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls podName:b6379b8f-9270-4976-8f9e-1e91d766b9b9 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:58.09811837 +0000 UTC m=+35.629382657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls") pod "dns-default-plgjm" (UID: "b6379b8f-9270-4976-8f9e-1e91d766b9b9") : secret "dns-default-metrics-tls" not found Jun 03 08:51:57.198420 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:57.198392 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:51:57.198581 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:57.198523 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:51:57.198581 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:57.198575 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert podName:3230ad30-2269-4401-bf72-d7ffeeebd823 nodeName:}" failed. No retries permitted until 2026-06-03 08:51:58.198560814 +0000 UTC m=+35.729825099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert") pod "ingress-canary-45tmd" (UID: "3230ad30-2269-4401-bf72-d7ffeeebd823") : secret "canary-serving-cert" not found Jun 03 08:51:58.106269 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:58.106237 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:51:58.106944 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:58.106298 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:51:58.106944 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:58.106395 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:51:58.106944 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:58.106395 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 08:51:58.106944 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:58.106465 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 08:51:58.106944 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:58.106517 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:51:58.106944 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:58.106532 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert podName:0cf56bdc-559e-468b-8839-c9fd2a22e247 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:00.106510252 +0000 UTC m=+37.637774542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-bk6b2" (UID: "0cf56bdc-559e-468b-8839-c9fd2a22e247") : secret "networking-console-plugin-cert" not found Jun 03 08:51:58.106944 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:58.106468 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7c8999fd-dqqgg: secret "image-registry-tls" not found Jun 03 08:51:58.106944 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:58.106575 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls podName:b6379b8f-9270-4976-8f9e-1e91d766b9b9 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:00.106557046 +0000 UTC m=+37.637821341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls") pod "dns-default-plgjm" (UID: "b6379b8f-9270-4976-8f9e-1e91d766b9b9") : secret "dns-default-metrics-tls" not found Jun 03 08:51:58.106944 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:58.106612 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls podName:e89c34e5-1069-4ef2-af5f-dd70d0be8c5b nodeName:}" failed. No retries permitted until 2026-06-03 08:52:00.106597669 +0000 UTC m=+37.637861975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls") pod "image-registry-5d7c8999fd-dqqgg" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b") : secret "image-registry-tls" not found Jun 03 08:51:58.207294 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:51:58.207246 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:51:58.207430 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:58.207388 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:51:58.207497 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:51:58.207444 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert podName:3230ad30-2269-4401-bf72-d7ffeeebd823 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:00.20742901 +0000 UTC m=+37.738693300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert") pod "ingress-canary-45tmd" (UID: "3230ad30-2269-4401-bf72-d7ffeeebd823") : secret "canary-serving-cert" not found Jun 03 08:52:00.094791 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:00.094610 2559 generic.go:358] "Generic (PLEG): container finished" podID="80a34e60-bdea-48dc-9d97-2a044d2faf19" containerID="b0af1b3b6e9d68906bf157b9af8973f366862e153f580d34783ac66ed46dac4d" exitCode=0 Jun 03 08:52:00.095124 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:00.094652 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdcjd" event={"ID":"80a34e60-bdea-48dc-9d97-2a044d2faf19","Type":"ContainerDied","Data":"b0af1b3b6e9d68906bf157b9af8973f366862e153f580d34783ac66ed46dac4d"} Jun 03 08:52:00.123665 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:00.123615 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:52:00.123782 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:00.123664 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:52:00.123782 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:00.123759 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:52:00.123899 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:00.123788 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 08:52:00.123899 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:00.123805 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7c8999fd-dqqgg: secret "image-registry-tls" not found Jun 03 08:52:00.123899 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:00.123879 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:52:00.124048 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:00.123902 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls podName:e89c34e5-1069-4ef2-af5f-dd70d0be8c5b nodeName:}" failed. No retries permitted until 2026-06-03 08:52:04.123881462 +0000 UTC m=+41.655145759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls") pod "image-registry-5d7c8999fd-dqqgg" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b") : secret "image-registry-tls" not found Jun 03 08:52:00.124048 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:00.123913 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 08:52:00.124048 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:00.123924 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls podName:b6379b8f-9270-4976-8f9e-1e91d766b9b9 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:04.123910103 +0000 UTC m=+41.655174407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls") pod "dns-default-plgjm" (UID: "b6379b8f-9270-4976-8f9e-1e91d766b9b9") : secret "dns-default-metrics-tls" not found Jun 03 08:52:00.124048 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:00.123994 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert podName:0cf56bdc-559e-468b-8839-c9fd2a22e247 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:04.123949386 +0000 UTC m=+41.655213678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-bk6b2" (UID: "0cf56bdc-559e-468b-8839-c9fd2a22e247") : secret "networking-console-plugin-cert" not found Jun 03 08:52:00.224091 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:00.224067 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:52:00.224249 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:00.224230 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:52:00.224330 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:00.224317 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert podName:3230ad30-2269-4401-bf72-d7ffeeebd823 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:04.224277009 +0000 UTC m=+41.755541299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert") pod "ingress-canary-45tmd" (UID: "3230ad30-2269-4401-bf72-d7ffeeebd823") : secret "canary-serving-cert" not found Jun 03 08:52:01.098765 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:01.098734 2559 generic.go:358] "Generic (PLEG): container finished" podID="80a34e60-bdea-48dc-9d97-2a044d2faf19" containerID="4e8862595ef5b74bca9a7b25427c7af09eb1b87cdaff05b2aa58325d18757521" exitCode=0 Jun 03 08:52:01.099107 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:01.098787 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdcjd" event={"ID":"80a34e60-bdea-48dc-9d97-2a044d2faf19","Type":"ContainerDied","Data":"4e8862595ef5b74bca9a7b25427c7af09eb1b87cdaff05b2aa58325d18757521"} Jun 03 08:52:02.108523 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:02.108486 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdcjd" event={"ID":"80a34e60-bdea-48dc-9d97-2a044d2faf19","Type":"ContainerStarted","Data":"f43eb0770efb970926675b21acd06db534f64a6f11969966a32311605604701c"} Jun 03 08:52:02.139863 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:02.139820 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kdcjd" podStartSLOduration=5.741932638 podStartE2EDuration="39.139806452s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="2026-06-03 08:51:25.646232983 +0000 UTC m=+3.177497283" lastFinishedPulling="2026-06-03 08:51:59.044106811 +0000 UTC m=+36.575371097" observedRunningTime="2026-06-03 08:52:02.13927555 +0000 UTC m=+39.670539858" watchObservedRunningTime="2026-06-03 08:52:02.139806452 +0000 UTC m=+39.671070761" Jun 03 08:52:04.153568 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:04.153536 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:52:04.153982 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:04.153581 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:52:04.153982 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:04.153602 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:52:04.153982 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:04.153692 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 08:52:04.153982 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:04.153701 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 08:52:04.153982 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:04.153708 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7c8999fd-dqqgg: secret "image-registry-tls" not found Jun 03 08:52:04.153982 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:04.153746 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert podName:0cf56bdc-559e-468b-8839-c9fd2a22e247 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:12.153733019 +0000 UTC m=+49.684997305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-bk6b2" (UID: "0cf56bdc-559e-468b-8839-c9fd2a22e247") : secret "networking-console-plugin-cert" not found Jun 03 08:52:04.153982 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:04.153762 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls podName:e89c34e5-1069-4ef2-af5f-dd70d0be8c5b nodeName:}" failed. No retries permitted until 2026-06-03 08:52:12.153752974 +0000 UTC m=+49.685017261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls") pod "image-registry-5d7c8999fd-dqqgg" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b") : secret "image-registry-tls" not found Jun 03 08:52:04.153982 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:04.153766 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:52:04.153982 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:04.153796 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls podName:b6379b8f-9270-4976-8f9e-1e91d766b9b9 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:12.153783213 +0000 UTC m=+49.685047498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls") pod "dns-default-plgjm" (UID: "b6379b8f-9270-4976-8f9e-1e91d766b9b9") : secret "dns-default-metrics-tls" not found Jun 03 08:52:04.253905 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:04.253883 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:52:04.254031 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:04.253983 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:52:04.254031 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:04.254021 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert podName:3230ad30-2269-4401-bf72-d7ffeeebd823 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:12.254010542 +0000 UTC m=+49.785274828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert") pod "ingress-canary-45tmd" (UID: "3230ad30-2269-4401-bf72-d7ffeeebd823") : secret "canary-serving-cert" not found Jun 03 08:52:12.216074 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:12.216035 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:52:12.216074 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:12.216079 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:52:12.216632 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:12.216144 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:52:12.216632 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:12.216225 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 08:52:12.216632 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:12.216236 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 08:52:12.216632 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:12.216260 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7c8999fd-dqqgg: secret "image-registry-tls" not found Jun 03 08:52:12.216632 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:12.216307 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert podName:0cf56bdc-559e-468b-8839-c9fd2a22e247 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:28.216273491 +0000 UTC m=+65.747537776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-bk6b2" (UID: "0cf56bdc-559e-468b-8839-c9fd2a22e247") : secret "networking-console-plugin-cert" not found Jun 03 08:52:12.216632 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:12.216333 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:52:12.216632 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:12.216355 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls podName:e89c34e5-1069-4ef2-af5f-dd70d0be8c5b nodeName:}" failed. No retries permitted until 2026-06-03 08:52:28.216335532 +0000 UTC m=+65.747599832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls") pod "image-registry-5d7c8999fd-dqqgg" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b") : secret "image-registry-tls" not found Jun 03 08:52:12.216632 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:12.216447 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls podName:b6379b8f-9270-4976-8f9e-1e91d766b9b9 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:28.216427611 +0000 UTC m=+65.747691897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls") pod "dns-default-plgjm" (UID: "b6379b8f-9270-4976-8f9e-1e91d766b9b9") : secret "dns-default-metrics-tls" not found Jun 03 08:52:12.317203 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:12.317178 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:52:12.317364 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:12.317343 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:52:12.317449 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:12.317439 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert podName:3230ad30-2269-4401-bf72-d7ffeeebd823 nodeName:}" failed. No retries permitted until 2026-06-03 08:52:28.317424484 +0000 UTC m=+65.848688770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert") pod "ingress-canary-45tmd" (UID: "3230ad30-2269-4401-bf72-d7ffeeebd823") : secret "canary-serving-cert" not found Jun 03 08:52:23.089505 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:23.089472 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kg4nm" Jun 03 08:52:28.235524 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.235465 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:52:28.235968 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.235554 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:52:28.235968 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.235584 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:52:28.235968 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:28.235622 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:52:28.235968 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:28.235683 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 08:52:28.235968 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:28.235700 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7c8999fd-dqqgg: secret "image-registry-tls" not found Jun 03 08:52:28.235968 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:28.235716 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 08:52:28.235968 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:28.235719 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls podName:b6379b8f-9270-4976-8f9e-1e91d766b9b9 nodeName:}" failed. No retries permitted until 2026-06-03 08:53:00.235700852 +0000 UTC m=+97.766965138 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls") pod "dns-default-plgjm" (UID: "b6379b8f-9270-4976-8f9e-1e91d766b9b9") : secret "dns-default-metrics-tls" not found Jun 03 08:52:28.235968 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:28.235802 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls podName:e89c34e5-1069-4ef2-af5f-dd70d0be8c5b nodeName:}" failed. No retries permitted until 2026-06-03 08:53:00.235771789 +0000 UTC m=+97.767036078 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls") pod "image-registry-5d7c8999fd-dqqgg" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b") : secret "image-registry-tls" not found Jun 03 08:52:28.235968 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:28.235816 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert podName:0cf56bdc-559e-468b-8839-c9fd2a22e247 nodeName:}" failed. No retries permitted until 2026-06-03 08:53:00.235808916 +0000 UTC m=+97.767073202 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-bk6b2" (UID: "0cf56bdc-559e-468b-8839-c9fd2a22e247") : secret "networking-console-plugin-cert" not found Jun 03 08:52:28.336235 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.336192 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:52:28.336358 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:28.336342 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:52:28.336408 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:28.336399 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert podName:3230ad30-2269-4401-bf72-d7ffeeebd823 nodeName:}" failed. No retries permitted until 2026-06-03 08:53:00.336384493 +0000 UTC m=+97.867648780 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert") pod "ingress-canary-45tmd" (UID: "3230ad30-2269-4401-bf72-d7ffeeebd823") : secret "canary-serving-cert" not found Jun 03 08:52:28.638738 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.638651 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:52:28.638738 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.638700 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:52:28.641591 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.641574 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 08:52:28.641826 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.641811 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 08:52:28.649724 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:28.649691 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 08:52:28.649808 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:52:28.649782 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs podName:30768073-4636-4456-aa24-a47199e99a4d nodeName:}" failed. No retries permitted until 2026-06-03 08:53:32.649759224 +0000 UTC m=+130.181023510 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs") pod "network-metrics-daemon-2sx6r" (UID: "30768073-4636-4456-aa24-a47199e99a4d") : secret "metrics-daemon-secret" not found Jun 03 08:52:28.652515 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.652494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed0f87f6-b558-43fd-bf3a-67c9c21049c1-original-pull-secret\") pod \"global-pull-secret-syncer-hssgq\" (UID: \"ed0f87f6-b558-43fd-bf3a-67c9c21049c1\") " pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:52:28.739468 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.739434 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9p7c\" (UniqueName: \"kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c\") pod \"network-check-target-hkt2l\" (UID: \"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3\") " pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:52:28.742260 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.742241 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 08:52:28.748330 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.748315 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hssgq" Jun 03 08:52:28.752224 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.752204 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 08:52:28.762838 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.762807 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9p7c\" (UniqueName: \"kubernetes.io/projected/f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3-kube-api-access-x9p7c\") pod \"network-check-target-hkt2l\" (UID: \"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3\") " pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:52:28.895084 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:28.895012 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hssgq"] Jun 03 08:52:28.900676 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:52:28.900643 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0f87f6_b558_43fd_bf3a_67c9c21049c1.slice/crio-3bf96a2c6f46847ea2850fc238b5dc09ae62ef986b7491093fcfa6c7ad542034 WatchSource:0}: Error finding container 3bf96a2c6f46847ea2850fc238b5dc09ae62ef986b7491093fcfa6c7ad542034: Status 404 returned error can't find the container with id 3bf96a2c6f46847ea2850fc238b5dc09ae62ef986b7491093fcfa6c7ad542034 Jun 03 08:52:29.057670 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:29.057643 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-99vdf\"" Jun 03 08:52:29.065903 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:29.065882 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:52:29.156904 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:29.156831 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hssgq" event={"ID":"ed0f87f6-b558-43fd-bf3a-67c9c21049c1","Type":"ContainerStarted","Data":"3bf96a2c6f46847ea2850fc238b5dc09ae62ef986b7491093fcfa6c7ad542034"} Jun 03 08:52:29.186138 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:29.186110 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hkt2l"] Jun 03 08:52:29.189375 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:52:29.189348 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d4b63e_7d58_411f_ab3a_1ab5acfce9b3.slice/crio-0dd5d483d518ef14997c24aeb84253b8f8bdf450299db38d68e0cba0d093e09a WatchSource:0}: Error finding container 0dd5d483d518ef14997c24aeb84253b8f8bdf450299db38d68e0cba0d093e09a: Status 404 returned error can't find the container with id 0dd5d483d518ef14997c24aeb84253b8f8bdf450299db38d68e0cba0d093e09a Jun 03 08:52:30.160433 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:30.160394 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hkt2l" event={"ID":"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3","Type":"ContainerStarted","Data":"0dd5d483d518ef14997c24aeb84253b8f8bdf450299db38d68e0cba0d093e09a"} Jun 03 08:52:34.169505 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:34.169467 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hkt2l" event={"ID":"f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3","Type":"ContainerStarted","Data":"09343bd0a2135d85772ccbdfcdc3b607231f77d9b8a18cd1979cbabc30cef211"} Jun 03 08:52:34.169929 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:34.169534 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:52:34.170679 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:34.170658 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hssgq" event={"ID":"ed0f87f6-b558-43fd-bf3a-67c9c21049c1","Type":"ContainerStarted","Data":"d7b2eebc54900921a6b844a7c4101fc88472ce0fa5346552e7290bdd6045247b"} Jun 03 08:52:34.186846 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:34.186799 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hkt2l" podStartSLOduration=66.846825086 podStartE2EDuration="1m11.186785508s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="2026-06-03 08:52:29.191265804 +0000 UTC m=+66.722530091" lastFinishedPulling="2026-06-03 08:52:33.531226223 +0000 UTC m=+71.062490513" observedRunningTime="2026-06-03 08:52:34.186770082 +0000 UTC m=+71.718034391" watchObservedRunningTime="2026-06-03 08:52:34.186785508 +0000 UTC m=+71.718049816" Jun 03 08:52:34.206115 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:52:34.206071 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hssgq" podStartSLOduration=66.577298022 podStartE2EDuration="1m11.206062155s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="2026-06-03 08:52:28.902275712 +0000 UTC m=+66.433539998" lastFinishedPulling="2026-06-03 08:52:33.531039842 +0000 UTC m=+71.062304131" observedRunningTime="2026-06-03 08:52:34.205380136 +0000 UTC m=+71.736644446" watchObservedRunningTime="2026-06-03 08:52:34.206062155 +0000 UTC m=+71.737326462" Jun 03 08:53:00.258394 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:00.258357 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:53:00.258914 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:00.258415 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:53:00.258914 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:00.258446 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:53:00.258914 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:00.258488 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:53:00.258914 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:00.258553 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 08:53:00.258914 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:00.258568 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7c8999fd-dqqgg: secret "image-registry-tls" not found Jun 03 08:53:00.258914 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:00.258587 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 08:53:00.258914 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:00.258556 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls podName:b6379b8f-9270-4976-8f9e-1e91d766b9b9 nodeName:}" failed. No retries permitted until 2026-06-03 08:54:04.258540353 +0000 UTC m=+161.789804639 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls") pod "dns-default-plgjm" (UID: "b6379b8f-9270-4976-8f9e-1e91d766b9b9") : secret "dns-default-metrics-tls" not found Jun 03 08:53:00.258914 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:00.258625 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls podName:e89c34e5-1069-4ef2-af5f-dd70d0be8c5b nodeName:}" failed. No retries permitted until 2026-06-03 08:54:04.258612464 +0000 UTC m=+161.789876750 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls") pod "image-registry-5d7c8999fd-dqqgg" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b") : secret "image-registry-tls" not found Jun 03 08:53:00.258914 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:00.258660 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert podName:0cf56bdc-559e-468b-8839-c9fd2a22e247 nodeName:}" failed. No retries permitted until 2026-06-03 08:54:04.258644958 +0000 UTC m=+161.789909252 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-bk6b2" (UID: "0cf56bdc-559e-468b-8839-c9fd2a22e247") : secret "networking-console-plugin-cert" not found Jun 03 08:53:00.359058 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:00.359026 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:53:00.359193 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:00.359131 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:53:00.359193 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:00.359179 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert podName:3230ad30-2269-4401-bf72-d7ffeeebd823 nodeName:}" failed. No retries permitted until 2026-06-03 08:54:04.359166583 +0000 UTC m=+161.890430868 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert") pod "ingress-canary-45tmd" (UID: "3230ad30-2269-4401-bf72-d7ffeeebd823") : secret "canary-serving-cert" not found Jun 03 08:53:05.174532 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:05.174496 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hkt2l" Jun 03 08:53:32.694346 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:32.694305 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:53:32.694806 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:32.694429 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 08:53:32.694806 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:32.694500 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs podName:30768073-4636-4456-aa24-a47199e99a4d nodeName:}" failed. No retries permitted until 2026-06-03 08:55:34.694484249 +0000 UTC m=+252.225748535 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs") pod "network-metrics-daemon-2sx6r" (UID: "30768073-4636-4456-aa24-a47199e99a4d") : secret "metrics-daemon-secret" not found Jun 03 08:53:48.230321 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.230270 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-tsx44"] Jun 03 08:53:48.233107 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.233084 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.237814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.237794 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 08:53:48.237814 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.237801 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 08:53:48.238428 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.238412 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 08:53:48.244872 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.244850 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 08:53:48.245124 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.245107 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh"] Jun 03 08:53:48.245373 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.245359 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jxgmq\"" Jun 03 08:53:48.246997 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.246976 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 08:53:48.247656 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.247643 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:48.251081 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.251064 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-tsx44"] Jun 03 08:53:48.251938 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.251920 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 08:53:48.252028 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.251980 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 08:53:48.252028 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.252001 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 08:53:48.252886 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.252867 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dzcw2\"" Jun 03 08:53:48.254769 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.254750 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 08:53:48.262773 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.262753 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh"] Jun 03 08:53:48.303018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.302995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:48.303100 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.303034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a3453c0b-9d88-49be-957f-7ecf597f62cf-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:48.303100 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.303058 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsfw5\" (UniqueName: \"kubernetes.io/projected/a3453c0b-9d88-49be-957f-7ecf597f62cf-kube-api-access-dsfw5\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:48.303170 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.303128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.303170 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.303151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf7gs\" (UniqueName: \"kubernetes.io/projected/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-kube-api-access-gf7gs\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.303230 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.303199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-serving-cert\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.303267 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.303236 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-service-ca-bundle\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.303267 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.303252 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-snapshots\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.303359 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.303269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-tmp\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.318301 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.318264 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-mphvt"] Jun 03 08:53:48.320817 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.320803 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5"] Jun 03 08:53:48.320943 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.320930 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.323490 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.323475 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:53:48.323568 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.323554 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-cpvpd\"" Jun 03 08:53:48.324473 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.324447 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 08:53:48.324822 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.324808 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:53:48.324940 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.324925 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 08:53:48.324996 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.324982 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 08:53:48.325695 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.325674 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 08:53:48.325907 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.325889 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-c4p4b\"" Jun 03 08:53:48.325989 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.325922 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 08:53:48.326166 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.326148 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:53:48.330941 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.330924 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 08:53:48.333698 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.333629 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-mphvt"] Jun 03 08:53:48.335878 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.335863 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5"] Jun 03 08:53:48.404169 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecdcef30-d6e6-435e-813c-89f615992151-config\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.404256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404189 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gf7gs\" (UniqueName: \"kubernetes.io/projected/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-kube-api-access-gf7gs\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.404256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404245 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-serving-cert\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.404391 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404277 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfct8\" (UniqueName: \"kubernetes.io/projected/ecdcef30-d6e6-435e-813c-89f615992151-kube-api-access-mfct8\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.404391 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404339 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-service-ca-bundle\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.404391 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404358 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecdcef30-d6e6-435e-813c-89f615992151-trusted-ca\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.404391 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404373 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-tmp\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.404599 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecdcef30-d6e6-435e-813c-89f615992151-serving-cert\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.404599 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404428 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:48.404599 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404479 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a3453c0b-9d88-49be-957f-7ecf597f62cf-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:48.404599 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:48.404495 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:53:48.404599 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404512 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsfw5\" (UniqueName: \"kubernetes.io/projected/a3453c0b-9d88-49be-957f-7ecf597f62cf-kube-api-access-dsfw5\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:48.404599 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:48.404545 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls podName:a3453c0b-9d88-49be-957f-7ecf597f62cf nodeName:}" failed. No retries permitted until 2026-06-03 08:53:48.90452758 +0000 UTC m=+146.435791880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-7qrrh" (UID: "a3453c0b-9d88-49be-957f-7ecf597f62cf") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:53:48.404599 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6rmh5\" (UID: \"04e9d5af-7137-4d15-b021-5d9683bd0c66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:53:48.404907 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404602 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.404907 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-784dz\" (UniqueName: \"kubernetes.io/projected/04e9d5af-7137-4d15-b021-5d9683bd0c66-kube-api-access-784dz\") pod \"cluster-samples-operator-755bbf9bfb-6rmh5\" (UID: \"04e9d5af-7137-4d15-b021-5d9683bd0c66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:53:48.404907 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404672 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-snapshots\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.404907 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404757 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-tmp\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.405049 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.404961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-service-ca-bundle\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.405178 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.405158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a3453c0b-9d88-49be-957f-7ecf597f62cf-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:48.405235 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.405218 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-snapshots\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.405515 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.405481 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.406629 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.406612 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-serving-cert\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.412888 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.412868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf7gs\" (UniqueName: \"kubernetes.io/projected/84e672d7-a248-4b8f-97d4-9f73d91f1bf4-kube-api-access-gf7gs\") pod \"insights-operator-788bf58df5-tsx44\" (UID: \"84e672d7-a248-4b8f-97d4-9f73d91f1bf4\") " pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.412971 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.412928 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsfw5\" (UniqueName: \"kubernetes.io/projected/a3453c0b-9d88-49be-957f-7ecf597f62cf-kube-api-access-dsfw5\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:48.505444 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.505398 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-784dz\" (UniqueName: \"kubernetes.io/projected/04e9d5af-7137-4d15-b021-5d9683bd0c66-kube-api-access-784dz\") pod \"cluster-samples-operator-755bbf9bfb-6rmh5\" (UID: \"04e9d5af-7137-4d15-b021-5d9683bd0c66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:53:48.505444 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.505431 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecdcef30-d6e6-435e-813c-89f615992151-config\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.505608 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.505590 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfct8\" (UniqueName: \"kubernetes.io/projected/ecdcef30-d6e6-435e-813c-89f615992151-kube-api-access-mfct8\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.505664 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.505630 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecdcef30-d6e6-435e-813c-89f615992151-trusted-ca\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.505664 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.505657 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecdcef30-d6e6-435e-813c-89f615992151-serving-cert\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.505762 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.505715 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6rmh5\" (UID: \"04e9d5af-7137-4d15-b021-5d9683bd0c66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:53:48.505832 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:48.505818 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:53:48.505897 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:48.505886 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls podName:04e9d5af-7137-4d15-b021-5d9683bd0c66 nodeName:}" failed. No retries permitted until 2026-06-03 08:53:49.005869756 +0000 UTC m=+146.537134059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6rmh5" (UID: "04e9d5af-7137-4d15-b021-5d9683bd0c66") : secret "samples-operator-tls" not found Jun 03 08:53:48.506001 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.505981 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecdcef30-d6e6-435e-813c-89f615992151-config\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.506205 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.506185 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecdcef30-d6e6-435e-813c-89f615992151-trusted-ca\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.507589 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.507570 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecdcef30-d6e6-435e-813c-89f615992151-serving-cert\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.516503 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.516485 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfct8\" (UniqueName: \"kubernetes.io/projected/ecdcef30-d6e6-435e-813c-89f615992151-kube-api-access-mfct8\") pod \"console-operator-86d7c6cc77-mphvt\" (UID: \"ecdcef30-d6e6-435e-813c-89f615992151\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.516599 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.516580 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-784dz\" (UniqueName: \"kubernetes.io/projected/04e9d5af-7137-4d15-b021-5d9683bd0c66-kube-api-access-784dz\") pod \"cluster-samples-operator-755bbf9bfb-6rmh5\" (UID: \"04e9d5af-7137-4d15-b021-5d9683bd0c66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:53:48.545273 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.545253 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-tsx44" Jun 03 08:53:48.631633 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.631607 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:48.663525 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.663500 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-tsx44"] Jun 03 08:53:48.666435 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:53:48.666405 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e672d7_a248_4b8f_97d4_9f73d91f1bf4.slice/crio-05c37f2fa06acdb4f6629628be81627caf4198ba94929ac48e5e75af1ecea1a9 WatchSource:0}: Error finding container 05c37f2fa06acdb4f6629628be81627caf4198ba94929ac48e5e75af1ecea1a9: Status 404 returned error can't find the container with id 05c37f2fa06acdb4f6629628be81627caf4198ba94929ac48e5e75af1ecea1a9 Jun 03 08:53:48.751412 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.751305 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-mphvt"] Jun 03 08:53:48.754545 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:53:48.754516 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdcef30_d6e6_435e_813c_89f615992151.slice/crio-bd17045b9a2f8246065ace13ba1c62264628ac73ed7479d88b680d25ad772e3d WatchSource:0}: Error finding container bd17045b9a2f8246065ace13ba1c62264628ac73ed7479d88b680d25ad772e3d: Status 404 returned error can't find the container with id bd17045b9a2f8246065ace13ba1c62264628ac73ed7479d88b680d25ad772e3d Jun 03 08:53:48.909355 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:48.909331 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:48.909469 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:48.909445 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:53:48.909513 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:48.909508 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls podName:a3453c0b-9d88-49be-957f-7ecf597f62cf nodeName:}" failed. No retries permitted until 2026-06-03 08:53:49.909492869 +0000 UTC m=+147.440757157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-7qrrh" (UID: "a3453c0b-9d88-49be-957f-7ecf597f62cf") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:53:49.010439 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.010393 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6rmh5\" (UID: \"04e9d5af-7137-4d15-b021-5d9683bd0c66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:53:49.010528 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:49.010501 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:53:49.010582 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:49.010553 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls podName:04e9d5af-7137-4d15-b021-5d9683bd0c66 nodeName:}" failed. No retries permitted until 2026-06-03 08:53:50.010539945 +0000 UTC m=+147.541804232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6rmh5" (UID: "04e9d5af-7137-4d15-b021-5d9683bd0c66") : secret "samples-operator-tls" not found Jun 03 08:53:49.316581 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.316493 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-tsx44" event={"ID":"84e672d7-a248-4b8f-97d4-9f73d91f1bf4","Type":"ContainerStarted","Data":"05c37f2fa06acdb4f6629628be81627caf4198ba94929ac48e5e75af1ecea1a9"} Jun 03 08:53:49.317499 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.317476 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" event={"ID":"ecdcef30-d6e6-435e-813c-89f615992151","Type":"ContainerStarted","Data":"bd17045b9a2f8246065ace13ba1c62264628ac73ed7479d88b680d25ad772e3d"} Jun 03 08:53:49.496901 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.496873 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-nq258"] Jun 03 08:53:49.500085 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.500062 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-nq258" Jun 03 08:53:49.502707 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.502633 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qf74d\"" Jun 03 08:53:49.509874 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.509847 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-nq258"] Jun 03 08:53:49.616451 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.616374 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd7zv\" (UniqueName: \"kubernetes.io/projected/90ec62e8-5a77-410f-8ce2-086394e25eed-kube-api-access-dd7zv\") pod \"network-check-source-56d84b9f44-nq258\" (UID: \"90ec62e8-5a77-410f-8ce2-086394e25eed\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-nq258" Jun 03 08:53:49.717748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.717718 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dd7zv\" (UniqueName: \"kubernetes.io/projected/90ec62e8-5a77-410f-8ce2-086394e25eed-kube-api-access-dd7zv\") pod \"network-check-source-56d84b9f44-nq258\" (UID: \"90ec62e8-5a77-410f-8ce2-086394e25eed\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-nq258" Jun 03 08:53:49.727958 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.727931 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd7zv\" (UniqueName: \"kubernetes.io/projected/90ec62e8-5a77-410f-8ce2-086394e25eed-kube-api-access-dd7zv\") pod \"network-check-source-56d84b9f44-nq258\" (UID: \"90ec62e8-5a77-410f-8ce2-086394e25eed\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-nq258" Jun 03 08:53:49.812142 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.812112 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-nq258" Jun 03 08:53:49.919947 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.919909 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:49.920082 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:49.920047 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:53:49.920146 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:49.920122 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls podName:a3453c0b-9d88-49be-957f-7ecf597f62cf nodeName:}" failed. No retries permitted until 2026-06-03 08:53:51.920102652 +0000 UTC m=+149.451366939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-7qrrh" (UID: "a3453c0b-9d88-49be-957f-7ecf597f62cf") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:53:49.958878 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:49.958838 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-nq258"] Jun 03 08:53:50.021064 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:50.021039 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6rmh5\" (UID: \"04e9d5af-7137-4d15-b021-5d9683bd0c66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:53:50.021221 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:50.021195 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:53:50.021353 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:50.021276 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls podName:04e9d5af-7137-4d15-b021-5d9683bd0c66 nodeName:}" failed. No retries permitted until 2026-06-03 08:53:52.021253355 +0000 UTC m=+149.552517645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6rmh5" (UID: "04e9d5af-7137-4d15-b021-5d9683bd0c66") : secret "samples-operator-tls" not found Jun 03 08:53:50.373798 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:53:50.373761 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ec62e8_5a77_410f_8ce2_086394e25eed.slice/crio-d8be012a7fbddeb93b50607211451e4f1a9139716d501a3e71a561f9c8cbc994 WatchSource:0}: Error finding container d8be012a7fbddeb93b50607211451e4f1a9139716d501a3e71a561f9c8cbc994: Status 404 returned error can't find the container with id d8be012a7fbddeb93b50607211451e4f1a9139716d501a3e71a561f9c8cbc994 Jun 03 08:53:51.324183 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:51.324118 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-nq258" event={"ID":"90ec62e8-5a77-410f-8ce2-086394e25eed","Type":"ContainerStarted","Data":"cae0a32b00953c1891d0650455c062b442fe02f7f7f8755508228963f0152142"} Jun 03 08:53:51.324183 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:51.324160 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-nq258" event={"ID":"90ec62e8-5a77-410f-8ce2-086394e25eed","Type":"ContainerStarted","Data":"d8be012a7fbddeb93b50607211451e4f1a9139716d501a3e71a561f9c8cbc994"} Jun 03 08:53:51.325520 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:51.325498 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-tsx44" event={"ID":"84e672d7-a248-4b8f-97d4-9f73d91f1bf4","Type":"ContainerStarted","Data":"ac7cad39c9035dcd1207c618b8c5b5c06a2d613b1e8c339eb239a5a6e122c312"} Jun 03 08:53:51.326905 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:51.326885 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/0.log" Jun 03 08:53:51.326999 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:51.326926 2559 generic.go:358] "Generic (PLEG): container finished" podID="ecdcef30-d6e6-435e-813c-89f615992151" containerID="4330381997e20a1ed8a5393084620943dc78916bb9be14b2c2efd32d5ad5a980" exitCode=255 Jun 03 08:53:51.326999 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:51.326965 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" event={"ID":"ecdcef30-d6e6-435e-813c-89f615992151","Type":"ContainerDied","Data":"4330381997e20a1ed8a5393084620943dc78916bb9be14b2c2efd32d5ad5a980"} Jun 03 08:53:51.327129 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:51.327114 2559 scope.go:117] "RemoveContainer" containerID="4330381997e20a1ed8a5393084620943dc78916bb9be14b2c2efd32d5ad5a980" Jun 03 08:53:51.353668 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:51.353628 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-nq258" podStartSLOduration=2.35361806 podStartE2EDuration="2.35361806s" podCreationTimestamp="2026-06-03 08:53:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:53:51.353247842 +0000 UTC m=+148.884512151" watchObservedRunningTime="2026-06-03 08:53:51.35361806 +0000 UTC m=+148.884882406" Jun 03 08:53:51.405152 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:51.405090 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-tsx44" podStartSLOduration=1.653919613 podStartE2EDuration="3.405078639s" podCreationTimestamp="2026-06-03 08:53:48 +0000 UTC" firstStartedPulling="2026-06-03 08:53:48.669321576 +0000 UTC m=+146.200585861" lastFinishedPulling="2026-06-03 08:53:50.420480596 +0000 UTC m=+147.951744887" observedRunningTime="2026-06-03 08:53:51.399045481 +0000 UTC m=+148.930309800" watchObservedRunningTime="2026-06-03 08:53:51.405078639 +0000 UTC m=+148.936342951" Jun 03 08:53:51.936721 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:51.936693 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:51.936864 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:51.936821 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:53:51.936921 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:51.936881 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls podName:a3453c0b-9d88-49be-957f-7ecf597f62cf nodeName:}" failed. No retries permitted until 2026-06-03 08:53:55.936867065 +0000 UTC m=+153.468131352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-7qrrh" (UID: "a3453c0b-9d88-49be-957f-7ecf597f62cf") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:53:52.037653 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.037625 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6rmh5\" (UID: \"04e9d5af-7137-4d15-b021-5d9683bd0c66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:53:52.037773 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:52.037758 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:53:52.037818 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:52.037809 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls podName:04e9d5af-7137-4d15-b021-5d9683bd0c66 nodeName:}" failed. No retries permitted until 2026-06-03 08:53:56.037797232 +0000 UTC m=+153.569061523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6rmh5" (UID: "04e9d5af-7137-4d15-b021-5d9683bd0c66") : secret "samples-operator-tls" not found Jun 03 08:53:52.333831 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.333805 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/1.log" Jun 03 08:53:52.334175 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.334159 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/0.log" Jun 03 08:53:52.334256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.334192 2559 generic.go:358] "Generic (PLEG): container finished" podID="ecdcef30-d6e6-435e-813c-89f615992151" containerID="1a4e1d6a13b03db1bd177baf3af7066c1947d859de93d5fa36156916c7a070e5" exitCode=255 Jun 03 08:53:52.334325 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.334300 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" event={"ID":"ecdcef30-d6e6-435e-813c-89f615992151","Type":"ContainerDied","Data":"1a4e1d6a13b03db1bd177baf3af7066c1947d859de93d5fa36156916c7a070e5"} Jun 03 08:53:52.334376 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.334361 2559 scope.go:117] "RemoveContainer" containerID="4330381997e20a1ed8a5393084620943dc78916bb9be14b2c2efd32d5ad5a980" Jun 03 08:53:52.334544 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.334529 2559 scope.go:117] "RemoveContainer" containerID="1a4e1d6a13b03db1bd177baf3af7066c1947d859de93d5fa36156916c7a070e5" Jun 03 08:53:52.334741 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:52.334725 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-mphvt_openshift-console-operator(ecdcef30-d6e6-435e-813c-89f615992151)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" podUID="ecdcef30-d6e6-435e-813c-89f615992151" Jun 03 08:53:52.731701 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.731679 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s"] Jun 03 08:53:52.735922 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.735907 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s" Jun 03 08:53:52.738514 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.738490 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 08:53:52.738596 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.738558 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 08:53:52.739491 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.739473 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zvgsf\"" Jun 03 08:53:52.744526 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.744505 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s"] Jun 03 08:53:52.842508 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.842487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zswtz\" (UniqueName: \"kubernetes.io/projected/23036d92-f074-4b1b-96b9-30f0d4aba9f8-kube-api-access-zswtz\") pod \"migrator-96c6f749-gkk4s\" (UID: \"23036d92-f074-4b1b-96b9-30f0d4aba9f8\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s" Jun 03 08:53:52.943463 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.943441 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zswtz\" (UniqueName: \"kubernetes.io/projected/23036d92-f074-4b1b-96b9-30f0d4aba9f8-kube-api-access-zswtz\") pod \"migrator-96c6f749-gkk4s\" (UID: \"23036d92-f074-4b1b-96b9-30f0d4aba9f8\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s" Jun 03 08:53:52.952030 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:52.952010 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zswtz\" (UniqueName: \"kubernetes.io/projected/23036d92-f074-4b1b-96b9-30f0d4aba9f8-kube-api-access-zswtz\") pod \"migrator-96c6f749-gkk4s\" (UID: \"23036d92-f074-4b1b-96b9-30f0d4aba9f8\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s" Jun 03 08:53:53.044390 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:53.044320 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s" Jun 03 08:53:53.167151 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:53.167131 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s"] Jun 03 08:53:53.169986 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:53:53.169956 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23036d92_f074_4b1b_96b9_30f0d4aba9f8.slice/crio-052e0c4096a5047801b9c8d7ea333b4a6370aea778998a38a8fff5479d0930b1 WatchSource:0}: Error finding container 052e0c4096a5047801b9c8d7ea333b4a6370aea778998a38a8fff5479d0930b1: Status 404 returned error can't find the container with id 052e0c4096a5047801b9c8d7ea333b4a6370aea778998a38a8fff5479d0930b1 Jun 03 08:53:53.337135 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:53.337069 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s" event={"ID":"23036d92-f074-4b1b-96b9-30f0d4aba9f8","Type":"ContainerStarted","Data":"052e0c4096a5047801b9c8d7ea333b4a6370aea778998a38a8fff5479d0930b1"} Jun 03 08:53:53.338303 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:53.338268 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/1.log" Jun 03 08:53:53.338567 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:53.338554 2559 scope.go:117] "RemoveContainer" containerID="1a4e1d6a13b03db1bd177baf3af7066c1947d859de93d5fa36156916c7a070e5" Jun 03 08:53:53.338706 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:53.338691 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-mphvt_openshift-console-operator(ecdcef30-d6e6-435e-813c-89f615992151)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" podUID="ecdcef30-d6e6-435e-813c-89f615992151" Jun 03 08:53:54.112316 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:54.112254 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qgff7_dbc468ac-b2d9-40e6-a60f-a16d79b3720b/dns-node-resolver/0.log" Jun 03 08:53:55.101130 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.101109 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rrl7z_ba9932da-6f52-401b-a573-e160a5424714/node-ca/0.log" Jun 03 08:53:55.217763 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.217743 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-n7kzv"] Jun 03 08:53:55.220478 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.220465 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-n7kzv" Jun 03 08:53:55.222816 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.222801 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 08:53:55.223629 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.223608 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 08:53:55.223629 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.223618 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 08:53:55.223777 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.223637 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 08:53:55.223777 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.223719 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bnt7z\"" Jun 03 08:53:55.233660 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.233643 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-n7kzv"] Jun 03 08:53:55.261299 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.261261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5mxh\" (UniqueName: \"kubernetes.io/projected/ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc-kube-api-access-f5mxh\") pod \"service-ca-685df94d57-n7kzv\" (UID: \"ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc\") " pod="openshift-service-ca/service-ca-685df94d57-n7kzv" Jun 03 08:53:55.261382 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.261313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc-signing-cabundle\") pod \"service-ca-685df94d57-n7kzv\" (UID: \"ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc\") " pod="openshift-service-ca/service-ca-685df94d57-n7kzv" Jun 03 08:53:55.261382 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.261363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc-signing-key\") pod \"service-ca-685df94d57-n7kzv\" (UID: \"ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc\") " pod="openshift-service-ca/service-ca-685df94d57-n7kzv" Jun 03 08:53:55.345314 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.345275 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s" event={"ID":"23036d92-f074-4b1b-96b9-30f0d4aba9f8","Type":"ContainerStarted","Data":"0018f271c3351a4bed07d515e83d1db93bd4fcd85576e4e9a9c01ddf531a7980"} Jun 03 08:53:55.345401 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.345316 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s" event={"ID":"23036d92-f074-4b1b-96b9-30f0d4aba9f8","Type":"ContainerStarted","Data":"c0a651b9ec106d1d85191d6c798f9a347a84ab3e1d841e6e6a7f6a0e1240590a"} Jun 03 08:53:55.362235 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.362190 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5mxh\" (UniqueName: \"kubernetes.io/projected/ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc-kube-api-access-f5mxh\") pod \"service-ca-685df94d57-n7kzv\" (UID: \"ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc\") " pod="openshift-service-ca/service-ca-685df94d57-n7kzv" Jun 03 08:53:55.362235 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.362223 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc-signing-cabundle\") pod \"service-ca-685df94d57-n7kzv\" (UID: \"ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc\") " pod="openshift-service-ca/service-ca-685df94d57-n7kzv" Jun 03 08:53:55.362390 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.362247 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc-signing-key\") pod \"service-ca-685df94d57-n7kzv\" (UID: \"ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc\") " pod="openshift-service-ca/service-ca-685df94d57-n7kzv" Jun 03 08:53:55.362795 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.362777 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc-signing-cabundle\") pod \"service-ca-685df94d57-n7kzv\" (UID: \"ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc\") " pod="openshift-service-ca/service-ca-685df94d57-n7kzv" Jun 03 08:53:55.364482 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.364465 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc-signing-key\") pod \"service-ca-685df94d57-n7kzv\" (UID: \"ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc\") " pod="openshift-service-ca/service-ca-685df94d57-n7kzv" Jun 03 08:53:55.369251 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.369213 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-gkk4s" podStartSLOduration=1.946128706 podStartE2EDuration="3.369202912s" podCreationTimestamp="2026-06-03 08:53:52 +0000 UTC" firstStartedPulling="2026-06-03 08:53:53.172415042 +0000 UTC m=+150.703679328" lastFinishedPulling="2026-06-03 08:53:54.595489235 +0000 UTC m=+152.126753534" observedRunningTime="2026-06-03 08:53:55.367211385 +0000 UTC m=+152.898475692" watchObservedRunningTime="2026-06-03 08:53:55.369202912 +0000 UTC m=+152.900467220" Jun 03 08:53:55.378484 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.378468 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5mxh\" (UniqueName: \"kubernetes.io/projected/ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc-kube-api-access-f5mxh\") pod \"service-ca-685df94d57-n7kzv\" (UID: \"ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc\") " pod="openshift-service-ca/service-ca-685df94d57-n7kzv" Jun 03 08:53:55.529138 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.529119 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-n7kzv" Jun 03 08:53:55.653404 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.653322 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-n7kzv"] Jun 03 08:53:55.656350 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:53:55.656322 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce8096c4_d0d3_4eb0_b3f0_7bbb4622f8dc.slice/crio-9ed519daf02f0a53662d9166c72b65eff09f050be9369d1f7907e157683cf708 WatchSource:0}: Error finding container 9ed519daf02f0a53662d9166c72b65eff09f050be9369d1f7907e157683cf708: Status 404 returned error can't find the container with id 9ed519daf02f0a53662d9166c72b65eff09f050be9369d1f7907e157683cf708 Jun 03 08:53:55.965971 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:55.965944 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:53:55.966113 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:55.966094 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:53:55.966195 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:55.966170 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls podName:a3453c0b-9d88-49be-957f-7ecf597f62cf nodeName:}" failed. No retries permitted until 2026-06-03 08:54:03.966151392 +0000 UTC m=+161.497415693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-7qrrh" (UID: "a3453c0b-9d88-49be-957f-7ecf597f62cf") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:53:56.066318 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:56.066279 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6rmh5\" (UID: \"04e9d5af-7137-4d15-b021-5d9683bd0c66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:53:56.066427 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:56.066409 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:53:56.066477 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:56.066467 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls podName:04e9d5af-7137-4d15-b021-5d9683bd0c66 nodeName:}" failed. No retries permitted until 2026-06-03 08:54:04.066449551 +0000 UTC m=+161.597713850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-6rmh5" (UID: "04e9d5af-7137-4d15-b021-5d9683bd0c66") : secret "samples-operator-tls" not found Jun 03 08:53:56.349329 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:56.349224 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-n7kzv" event={"ID":"ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc","Type":"ContainerStarted","Data":"9ed519daf02f0a53662d9166c72b65eff09f050be9369d1f7907e157683cf708"} Jun 03 08:53:58.355604 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:58.355574 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-n7kzv" event={"ID":"ce8096c4-d0d3-4eb0-b3f0-7bbb4622f8dc","Type":"ContainerStarted","Data":"e4db31ef0bf0051d1ababc7e30ec9a16e37fbb2ecdf7ec62647db51570d7813d"} Jun 03 08:53:58.381939 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:58.381891 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-n7kzv" podStartSLOduration=1.4359929679999999 podStartE2EDuration="3.381877891s" podCreationTimestamp="2026-06-03 08:53:55 +0000 UTC" firstStartedPulling="2026-06-03 08:53:55.658209359 +0000 UTC m=+153.189473649" lastFinishedPulling="2026-06-03 08:53:57.604094286 +0000 UTC m=+155.135358572" observedRunningTime="2026-06-03 08:53:58.380663875 +0000 UTC m=+155.911928187" watchObservedRunningTime="2026-06-03 08:53:58.381877891 +0000 UTC m=+155.913142198" Jun 03 08:53:58.632463 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:58.632409 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:58.632463 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:58.632438 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:53:58.632742 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:53:58.632731 2559 scope.go:117] "RemoveContainer" containerID="1a4e1d6a13b03db1bd177baf3af7066c1947d859de93d5fa36156916c7a070e5" Jun 03 08:53:58.632877 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:58.632861 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-mphvt_openshift-console-operator(ecdcef30-d6e6-435e-813c-89f615992151)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" podUID="ecdcef30-d6e6-435e-813c-89f615992151" Jun 03 08:53:59.374371 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:59.374335 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" podUID="0cf56bdc-559e-468b-8839-c9fd2a22e247" Jun 03 08:53:59.391484 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:59.391456 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" podUID="e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" Jun 03 08:53:59.421219 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:59.421192 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-plgjm" podUID="b6379b8f-9270-4976-8f9e-1e91d766b9b9" Jun 03 08:53:59.446612 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:59.446583 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-45tmd" podUID="3230ad30-2269-4401-bf72-d7ffeeebd823" Jun 03 08:53:59.961745 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:53:59.961699 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2sx6r" podUID="30768073-4636-4456-aa24-a47199e99a4d" Jun 03 08:54:00.360408 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:00.360333 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-plgjm" Jun 03 08:54:00.360552 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:00.360335 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:54:00.360552 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:00.360346 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:54:04.030489 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.030456 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:54:04.030946 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:54:04.030598 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:54:04.030946 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:54:04.030680 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls podName:a3453c0b-9d88-49be-957f-7ecf597f62cf nodeName:}" failed. No retries permitted until 2026-06-03 08:54:20.030660718 +0000 UTC m=+177.561925021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-7qrrh" (UID: "a3453c0b-9d88-49be-957f-7ecf597f62cf") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:54:04.131482 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.131452 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6rmh5\" (UID: \"04e9d5af-7137-4d15-b021-5d9683bd0c66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:54:04.133687 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.133669 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/04e9d5af-7137-4d15-b021-5d9683bd0c66-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-6rmh5\" (UID: \"04e9d5af-7137-4d15-b021-5d9683bd0c66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:54:04.236933 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.236907 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" Jun 03 08:54:04.332817 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.332785 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:54:04.332949 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.332853 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:54:04.332949 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.332886 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:54:04.333113 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:54:04.333086 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 08:54:04.333225 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:54:04.333157 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert podName:0cf56bdc-559e-468b-8839-c9fd2a22e247 nodeName:}" failed. No retries permitted until 2026-06-03 08:56:06.333138604 +0000 UTC m=+283.864402897 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-bk6b2" (UID: "0cf56bdc-559e-468b-8839-c9fd2a22e247") : secret "networking-console-plugin-cert" not found Jun 03 08:54:04.335664 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.335626 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"image-registry-5d7c8999fd-dqqgg\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:54:04.335751 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.335707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6379b8f-9270-4976-8f9e-1e91d766b9b9-metrics-tls\") pod \"dns-default-plgjm\" (UID: \"b6379b8f-9270-4976-8f9e-1e91d766b9b9\") " pod="openshift-dns/dns-default-plgjm" Jun 03 08:54:04.383143 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.383119 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5"] Jun 03 08:54:04.433241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.433221 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:54:04.435321 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.435280 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230ad30-2269-4401-bf72-d7ffeeebd823-cert\") pod \"ingress-canary-45tmd\" (UID: \"3230ad30-2269-4401-bf72-d7ffeeebd823\") " pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:54:04.563870 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.563820 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nv5kj\"" Jun 03 08:54:04.564064 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.564046 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6n6ft\"" Jun 03 08:54:04.572353 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.572319 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:54:04.572353 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.572338 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-plgjm" Jun 03 08:54:04.739216 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.739192 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d7c8999fd-dqqgg"] Jun 03 08:54:04.741699 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:54:04.741675 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89c34e5_1069_4ef2_af5f_dd70d0be8c5b.slice/crio-cf2292a083438c17e68a570dc8d48899ee45dc6c5ca1e974d03cddea272a0fec WatchSource:0}: Error finding container cf2292a083438c17e68a570dc8d48899ee45dc6c5ca1e974d03cddea272a0fec: Status 404 returned error can't find the container with id cf2292a083438c17e68a570dc8d48899ee45dc6c5ca1e974d03cddea272a0fec Jun 03 08:54:04.749080 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:04.749060 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-plgjm"] Jun 03 08:54:04.750769 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:54:04.750744 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6379b8f_9270_4976_8f9e_1e91d766b9b9.slice/crio-0281e45db8d668c41d24f134411226712cdfbe26a08faa826726be3ab608c5fe WatchSource:0}: Error finding container 0281e45db8d668c41d24f134411226712cdfbe26a08faa826726be3ab608c5fe: Status 404 returned error can't find the container with id 0281e45db8d668c41d24f134411226712cdfbe26a08faa826726be3ab608c5fe Jun 03 08:54:05.373360 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:05.373317 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" event={"ID":"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b","Type":"ContainerStarted","Data":"7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69"} Jun 03 08:54:05.373360 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:05.373361 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" event={"ID":"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b","Type":"ContainerStarted","Data":"cf2292a083438c17e68a570dc8d48899ee45dc6c5ca1e974d03cddea272a0fec"} Jun 03 08:54:05.374100 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:05.374058 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:54:05.375517 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:05.375479 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-plgjm" event={"ID":"b6379b8f-9270-4976-8f9e-1e91d766b9b9","Type":"ContainerStarted","Data":"0281e45db8d668c41d24f134411226712cdfbe26a08faa826726be3ab608c5fe"} Jun 03 08:54:05.376588 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:05.376560 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" event={"ID":"04e9d5af-7137-4d15-b021-5d9683bd0c66","Type":"ContainerStarted","Data":"b51630a83f2616699a5199418abe0d266023846ab5065898d3c72bce8974ba4a"} Jun 03 08:54:05.412352 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:05.412312 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" podStartSLOduration=162.412296003 podStartE2EDuration="2m42.412296003s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:54:05.410403403 +0000 UTC m=+162.941667710" watchObservedRunningTime="2026-06-03 08:54:05.412296003 +0000 UTC m=+162.943560302" Jun 03 08:54:07.384431 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:07.384397 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-plgjm" event={"ID":"b6379b8f-9270-4976-8f9e-1e91d766b9b9","Type":"ContainerStarted","Data":"89149b3646f02373ec947f60a889ade4bd7f65c6dd785e90fd49d9a3374d3f1c"} Jun 03 08:54:07.384431 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:07.384427 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-plgjm" event={"ID":"b6379b8f-9270-4976-8f9e-1e91d766b9b9","Type":"ContainerStarted","Data":"aac0a9cd8f6dd3e6bb1b4c28df18eaa4bf032b2dcbc4e9b79fb7034107f1a25f"} Jun 03 08:54:07.384911 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:07.384539 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-plgjm" Jun 03 08:54:07.385831 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:07.385805 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" event={"ID":"04e9d5af-7137-4d15-b021-5d9683bd0c66","Type":"ContainerStarted","Data":"5726c7886cbf7ec09f3c2d24af2d56a3a00b2778a1167554b5bb5b43f9a171ea"} Jun 03 08:54:07.385892 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:07.385833 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" event={"ID":"04e9d5af-7137-4d15-b021-5d9683bd0c66","Type":"ContainerStarted","Data":"5c4c14325afdd3d8daaa5b75ba94bb599cce6af49379c2355bd31e3c9c37b342"} Jun 03 08:54:07.407426 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:07.407383 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-plgjm" podStartSLOduration=129.842315258 podStartE2EDuration="2m11.407371602s" podCreationTimestamp="2026-06-03 08:51:56 +0000 UTC" firstStartedPulling="2026-06-03 08:54:04.752356434 +0000 UTC m=+162.283620722" lastFinishedPulling="2026-06-03 08:54:06.317412772 +0000 UTC m=+163.848677066" observedRunningTime="2026-06-03 08:54:07.406456997 +0000 UTC m=+164.937721304" watchObservedRunningTime="2026-06-03 08:54:07.407371602 +0000 UTC m=+164.938635908" Jun 03 08:54:07.435545 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:07.435509 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-6rmh5" podStartSLOduration=17.540281981 podStartE2EDuration="19.435500047s" podCreationTimestamp="2026-06-03 08:53:48 +0000 UTC" firstStartedPulling="2026-06-03 08:54:04.419598836 +0000 UTC m=+161.950863121" lastFinishedPulling="2026-06-03 08:54:06.314816895 +0000 UTC m=+163.846081187" observedRunningTime="2026-06-03 08:54:07.435370001 +0000 UTC m=+164.966634310" watchObservedRunningTime="2026-06-03 08:54:07.435500047 +0000 UTC m=+164.966764354" Jun 03 08:54:10.936099 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:10.936074 2559 scope.go:117] "RemoveContainer" containerID="1a4e1d6a13b03db1bd177baf3af7066c1947d859de93d5fa36156916c7a070e5" Jun 03 08:54:11.395963 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:11.395937 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/2.log" Jun 03 08:54:11.396309 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:11.396277 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/1.log" Jun 03 08:54:11.396403 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:11.396329 2559 generic.go:358] "Generic (PLEG): container finished" podID="ecdcef30-d6e6-435e-813c-89f615992151" containerID="28d4d5e68dcdf7c993a0a3432ef080df520cd00f8a5eb85e7f531b1b375a2096" exitCode=255 Jun 03 08:54:11.396403 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:11.396387 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" event={"ID":"ecdcef30-d6e6-435e-813c-89f615992151","Type":"ContainerDied","Data":"28d4d5e68dcdf7c993a0a3432ef080df520cd00f8a5eb85e7f531b1b375a2096"} Jun 03 08:54:11.396498 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:11.396431 2559 scope.go:117] "RemoveContainer" containerID="1a4e1d6a13b03db1bd177baf3af7066c1947d859de93d5fa36156916c7a070e5" Jun 03 08:54:11.396707 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:11.396689 2559 scope.go:117] "RemoveContainer" containerID="28d4d5e68dcdf7c993a0a3432ef080df520cd00f8a5eb85e7f531b1b375a2096" Jun 03 08:54:11.396875 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:54:11.396859 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-mphvt_openshift-console-operator(ecdcef30-d6e6-435e-813c-89f615992151)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" podUID="ecdcef30-d6e6-435e-813c-89f615992151" Jun 03 08:54:12.399719 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:12.399698 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/2.log" Jun 03 08:54:13.935799 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:13.935766 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:54:13.935799 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:13.935766 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:54:13.938542 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:13.938526 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f4l24\"" Jun 03 08:54:13.947236 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:13.947217 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-45tmd" Jun 03 08:54:14.064510 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:14.064414 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-45tmd"] Jun 03 08:54:14.066812 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:54:14.066784 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3230ad30_2269_4401_bf72_d7ffeeebd823.slice/crio-6c83741cbb958b3d63175468264212238748681865d8df267c0fdd003059122c WatchSource:0}: Error finding container 6c83741cbb958b3d63175468264212238748681865d8df267c0fdd003059122c: Status 404 returned error can't find the container with id 6c83741cbb958b3d63175468264212238748681865d8df267c0fdd003059122c Jun 03 08:54:14.406876 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:14.406845 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-45tmd" event={"ID":"3230ad30-2269-4401-bf72-d7ffeeebd823","Type":"ContainerStarted","Data":"6c83741cbb958b3d63175468264212238748681865d8df267c0fdd003059122c"} Jun 03 08:54:16.184279 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.184247 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2bjv6"] Jun 03 08:54:16.187420 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.187405 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.189838 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.189815 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 08:54:16.189939 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.189815 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 08:54:16.191253 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.191232 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rff5d\"" Jun 03 08:54:16.204581 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.204563 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2bjv6"] Jun 03 08:54:16.328342 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.328322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b6aea76-27bc-4436-8f2f-ae2693acee3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.328434 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.328377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b6aea76-27bc-4436-8f2f-ae2693acee3d-data-volume\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.328492 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.328440 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b6aea76-27bc-4436-8f2f-ae2693acee3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.328542 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.328491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b6aea76-27bc-4436-8f2f-ae2693acee3d-crio-socket\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.328542 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.328511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmkkz\" (UniqueName: \"kubernetes.io/projected/4b6aea76-27bc-4436-8f2f-ae2693acee3d-kube-api-access-jmkkz\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.413091 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.413066 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-45tmd" event={"ID":"3230ad30-2269-4401-bf72-d7ffeeebd823","Type":"ContainerStarted","Data":"acbe609c3b4e73a53b2cb69c77de6f702c15d733abf5124abf4a54e085c35215"} Jun 03 08:54:16.428994 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.428970 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b6aea76-27bc-4436-8f2f-ae2693acee3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.429096 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.429015 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b6aea76-27bc-4436-8f2f-ae2693acee3d-crio-socket\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.429096 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.429031 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmkkz\" (UniqueName: \"kubernetes.io/projected/4b6aea76-27bc-4436-8f2f-ae2693acee3d-kube-api-access-jmkkz\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.429096 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.429077 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b6aea76-27bc-4436-8f2f-ae2693acee3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.429225 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.429100 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b6aea76-27bc-4436-8f2f-ae2693acee3d-crio-socket\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.429225 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.429108 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b6aea76-27bc-4436-8f2f-ae2693acee3d-data-volume\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.429499 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.429485 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b6aea76-27bc-4436-8f2f-ae2693acee3d-data-volume\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.429614 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.429599 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b6aea76-27bc-4436-8f2f-ae2693acee3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.431340 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.431282 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b6aea76-27bc-4436-8f2f-ae2693acee3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.431803 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.431767 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-45tmd" podStartSLOduration=139.021542811 podStartE2EDuration="2m20.431756873s" podCreationTimestamp="2026-06-03 08:51:56 +0000 UTC" firstStartedPulling="2026-06-03 08:54:14.068618497 +0000 UTC m=+171.599882797" lastFinishedPulling="2026-06-03 08:54:15.478832566 +0000 UTC m=+173.010096859" observedRunningTime="2026-06-03 08:54:16.43119206 +0000 UTC m=+173.962456369" watchObservedRunningTime="2026-06-03 08:54:16.431756873 +0000 UTC m=+173.963021181" Jun 03 08:54:16.440507 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.440442 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmkkz\" (UniqueName: \"kubernetes.io/projected/4b6aea76-27bc-4436-8f2f-ae2693acee3d-kube-api-access-jmkkz\") pod \"insights-runtime-extractor-2bjv6\" (UID: \"4b6aea76-27bc-4436-8f2f-ae2693acee3d\") " pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.496062 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.496039 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2bjv6" Jun 03 08:54:16.637444 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:16.637415 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2bjv6"] Jun 03 08:54:16.649174 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:54:16.649151 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6aea76_27bc_4436_8f2f_ae2693acee3d.slice/crio-08afc0d6095390eaa365433be2e8cb77ff6090b016467c114de5ae2aedf14ffb WatchSource:0}: Error finding container 08afc0d6095390eaa365433be2e8cb77ff6090b016467c114de5ae2aedf14ffb: Status 404 returned error can't find the container with id 08afc0d6095390eaa365433be2e8cb77ff6090b016467c114de5ae2aedf14ffb Jun 03 08:54:17.392091 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:17.392070 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-plgjm" Jun 03 08:54:17.417343 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:17.417318 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bjv6" event={"ID":"4b6aea76-27bc-4436-8f2f-ae2693acee3d","Type":"ContainerStarted","Data":"f46bbb43ca996f4f05934dabdd380820380ddee755625382f1d8575781838d6b"} Jun 03 08:54:17.417446 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:17.417351 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bjv6" event={"ID":"4b6aea76-27bc-4436-8f2f-ae2693acee3d","Type":"ContainerStarted","Data":"57aeba6c99bc73750aa0c6cb5e00deec319f2e20b854916b2b128db866d7d8f8"} Jun 03 08:54:17.417446 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:17.417360 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bjv6" event={"ID":"4b6aea76-27bc-4436-8f2f-ae2693acee3d","Type":"ContainerStarted","Data":"08afc0d6095390eaa365433be2e8cb77ff6090b016467c114de5ae2aedf14ffb"} Jun 03 08:54:18.632138 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:18.632101 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:54:18.632572 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:18.632149 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:54:18.632572 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:18.632533 2559 scope.go:117] "RemoveContainer" containerID="28d4d5e68dcdf7c993a0a3432ef080df520cd00f8a5eb85e7f531b1b375a2096" Jun 03 08:54:18.632749 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:54:18.632723 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-mphvt_openshift-console-operator(ecdcef30-d6e6-435e-813c-89f615992151)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" podUID="ecdcef30-d6e6-435e-813c-89f615992151" Jun 03 08:54:19.424313 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:19.424216 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bjv6" event={"ID":"4b6aea76-27bc-4436-8f2f-ae2693acee3d","Type":"ContainerStarted","Data":"c31dbde83540503be7c710aeead889313192d741a00d6ea93b67c46f10af627e"} Jun 03 08:54:19.444907 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:19.444859 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2bjv6" podStartSLOduration=1.182076601 podStartE2EDuration="3.444842511s" podCreationTimestamp="2026-06-03 08:54:16 +0000 UTC" firstStartedPulling="2026-06-03 08:54:16.710330678 +0000 UTC m=+174.241594967" lastFinishedPulling="2026-06-03 08:54:18.97309659 +0000 UTC m=+176.504360877" observedRunningTime="2026-06-03 08:54:19.444061905 +0000 UTC m=+176.975326215" watchObservedRunningTime="2026-06-03 08:54:19.444842511 +0000 UTC m=+176.976106817" Jun 03 08:54:20.053922 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:20.053879 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:54:20.056577 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:20.056549 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3453c0b-9d88-49be-957f-7ecf597f62cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-7qrrh\" (UID: \"a3453c0b-9d88-49be-957f-7ecf597f62cf\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:54:20.355893 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:20.355809 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" Jun 03 08:54:20.491357 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:20.491328 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh"] Jun 03 08:54:20.494078 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:54:20.494047 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3453c0b_9d88_49be_957f_7ecf597f62cf.slice/crio-725181327abc44fd0dab5166b94482eee882ea790a0cf3e9eb780fe712b0bb72 WatchSource:0}: Error finding container 725181327abc44fd0dab5166b94482eee882ea790a0cf3e9eb780fe712b0bb72: Status 404 returned error can't find the container with id 725181327abc44fd0dab5166b94482eee882ea790a0cf3e9eb780fe712b0bb72 Jun 03 08:54:21.430519 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:21.430481 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" event={"ID":"a3453c0b-9d88-49be-957f-7ecf597f62cf","Type":"ContainerStarted","Data":"725181327abc44fd0dab5166b94482eee882ea790a0cf3e9eb780fe712b0bb72"} Jun 03 08:54:22.435481 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:22.435447 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" event={"ID":"a3453c0b-9d88-49be-957f-7ecf597f62cf","Type":"ContainerStarted","Data":"90327792a6edf4b996ecfae69cd1bc1120681c1dfd8fecbcadfc82aa75f22e80"} Jun 03 08:54:22.458109 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:22.457918 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-7qrrh" podStartSLOduration=32.614575039 podStartE2EDuration="34.457904063s" podCreationTimestamp="2026-06-03 08:53:48 +0000 UTC" firstStartedPulling="2026-06-03 08:54:20.495801561 +0000 UTC m=+178.027065847" lastFinishedPulling="2026-06-03 08:54:22.33913058 +0000 UTC m=+179.870394871" observedRunningTime="2026-06-03 08:54:22.457570217 +0000 UTC m=+179.988834525" watchObservedRunningTime="2026-06-03 08:54:22.457904063 +0000 UTC m=+179.989168371" Jun 03 08:54:24.576758 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:24.576722 2559 patch_prober.go:28] interesting pod/image-registry-5d7c8999fd-dqqgg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 08:54:24.577117 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:24.576775 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" podUID="e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 08:54:26.111750 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.111716 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk"] Jun 03 08:54:26.115669 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.115652 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.119393 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.119364 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 08:54:26.119510 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.119400 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-49mwx\"" Jun 03 08:54:26.120258 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.120240 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 08:54:26.120368 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.120237 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 08:54:26.126123 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.126102 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk"] Jun 03 08:54:26.204981 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.204947 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.205164 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.205008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h58c\" (UniqueName: \"kubernetes.io/projected/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-kube-api-access-9h58c\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.205164 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.205076 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.205164 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.205114 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.306356 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.306317 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.306519 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.306395 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9h58c\" (UniqueName: \"kubernetes.io/projected/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-kube-api-access-9h58c\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.306519 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.306435 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.306519 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.306456 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.307116 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.307088 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.308775 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.308757 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.308879 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.308762 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.316436 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.316416 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h58c\" (UniqueName: \"kubernetes.io/projected/7b4a8c73-9a63-4656-bd09-555ecd8bf4f2-kube-api-access-9h58c\") pod \"prometheus-operator-658bcd8bdf-qd8xk\" (UID: \"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.424791 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.424712 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" Jun 03 08:54:26.562717 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:26.562682 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk"] Jun 03 08:54:26.565143 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:54:26.565114 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4a8c73_9a63_4656_bd09_555ecd8bf4f2.slice/crio-fdd090a891aa5ffeda846d48c0d84c6cb93d77a9a1622bd27435b00dab618873 WatchSource:0}: Error finding container fdd090a891aa5ffeda846d48c0d84c6cb93d77a9a1622bd27435b00dab618873: Status 404 returned error can't find the container with id fdd090a891aa5ffeda846d48c0d84c6cb93d77a9a1622bd27435b00dab618873 Jun 03 08:54:27.390266 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:27.390234 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:54:27.450230 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:27.450177 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" event={"ID":"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2","Type":"ContainerStarted","Data":"fdd090a891aa5ffeda846d48c0d84c6cb93d77a9a1622bd27435b00dab618873"} Jun 03 08:54:28.454302 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:28.454242 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" event={"ID":"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2","Type":"ContainerStarted","Data":"b287abed228d343e03e05455eab3982faf84f7af3042a984cbe7ccd08de2466e"} Jun 03 08:54:28.454302 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:28.454303 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" event={"ID":"7b4a8c73-9a63-4656-bd09-555ecd8bf4f2","Type":"ContainerStarted","Data":"83426b6bc528ea2c9e054df239e4bc5613422d84d83bdf3b9ed93951ecc7f370"} Jun 03 08:54:28.474687 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:28.474640 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qd8xk" podStartSLOduration=1.340070865 podStartE2EDuration="2.474626261s" podCreationTimestamp="2026-06-03 08:54:26 +0000 UTC" firstStartedPulling="2026-06-03 08:54:26.56691464 +0000 UTC m=+184.098178927" lastFinishedPulling="2026-06-03 08:54:27.701470034 +0000 UTC m=+185.232734323" observedRunningTime="2026-06-03 08:54:28.473543759 +0000 UTC m=+186.004808067" watchObservedRunningTime="2026-06-03 08:54:28.474626261 +0000 UTC m=+186.005890569" Jun 03 08:54:30.543503 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.543469 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7ff7t"] Jun 03 08:54:30.545935 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.545917 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.549464 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.549432 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8ckmd\"" Jun 03 08:54:30.549563 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.549518 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 08:54:30.549633 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.549519 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 08:54:30.549818 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.549802 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 08:54:30.639724 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.639704 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-textfile\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.639812 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.639731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.639812 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.639750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwvv2\" (UniqueName: \"kubernetes.io/projected/0eababab-d973-4988-94db-5c6db7623ef1-kube-api-access-nwvv2\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.639812 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.639768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0eababab-d973-4988-94db-5c6db7623ef1-root\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.639933 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.639836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-wtmp\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.639933 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.639875 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eababab-d973-4988-94db-5c6db7623ef1-metrics-client-ca\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.639933 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.639897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eababab-d973-4988-94db-5c6db7623ef1-sys\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.640034 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.639957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-tls\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.640034 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.639992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-accelerators-collector-config\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741151 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741124 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-accelerators-collector-config\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741188 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-textfile\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741217 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741247 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwvv2\" (UniqueName: \"kubernetes.io/projected/0eababab-d973-4988-94db-5c6db7623ef1-kube-api-access-nwvv2\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741426 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741274 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0eababab-d973-4988-94db-5c6db7623ef1-root\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741426 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741322 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-wtmp\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741426 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741358 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eababab-d973-4988-94db-5c6db7623ef1-metrics-client-ca\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741426 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741392 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eababab-d973-4988-94db-5c6db7623ef1-sys\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741616 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0eababab-d973-4988-94db-5c6db7623ef1-root\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741616 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741448 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-tls\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741616 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741565 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-textfile\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741751 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741631 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eababab-d973-4988-94db-5c6db7623ef1-sys\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741751 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741708 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-wtmp\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741851 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741764 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-accelerators-collector-config\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.741974 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.741956 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eababab-d973-4988-94db-5c6db7623ef1-metrics-client-ca\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.743809 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.743787 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.743972 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.743954 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0eababab-d973-4988-94db-5c6db7623ef1-node-exporter-tls\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.756619 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.756591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwvv2\" (UniqueName: \"kubernetes.io/projected/0eababab-d973-4988-94db-5c6db7623ef1-kube-api-access-nwvv2\") pod \"node-exporter-7ff7t\" (UID: \"0eababab-d973-4988-94db-5c6db7623ef1\") " pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.855461 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:30.855415 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7ff7t" Jun 03 08:54:30.863587 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:54:30.863565 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eababab_d973_4988_94db_5c6db7623ef1.slice/crio-0c92c47f5e68dd24385dfaed958b0682b3ea04681c9c4080805bec11587a35b2 WatchSource:0}: Error finding container 0c92c47f5e68dd24385dfaed958b0682b3ea04681c9c4080805bec11587a35b2: Status 404 returned error can't find the container with id 0c92c47f5e68dd24385dfaed958b0682b3ea04681c9c4080805bec11587a35b2 Jun 03 08:54:31.463523 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:31.463485 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ff7t" event={"ID":"0eababab-d973-4988-94db-5c6db7623ef1","Type":"ContainerStarted","Data":"0c92c47f5e68dd24385dfaed958b0682b3ea04681c9c4080805bec11587a35b2"} Jun 03 08:54:31.936726 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:31.936658 2559 scope.go:117] "RemoveContainer" containerID="28d4d5e68dcdf7c993a0a3432ef080df520cd00f8a5eb85e7f531b1b375a2096" Jun 03 08:54:32.467981 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.467945 2559 generic.go:358] "Generic (PLEG): container finished" podID="0eababab-d973-4988-94db-5c6db7623ef1" containerID="113e1c9d1bc1482fefeef4fd8924a2d2964105bbc378245b3d6ae12d1952a8a4" exitCode=0 Jun 03 08:54:32.468169 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.468034 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ff7t" event={"ID":"0eababab-d973-4988-94db-5c6db7623ef1","Type":"ContainerDied","Data":"113e1c9d1bc1482fefeef4fd8924a2d2964105bbc378245b3d6ae12d1952a8a4"} Jun 03 08:54:32.469670 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.469633 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/2.log" Jun 03 08:54:32.469793 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.469717 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" event={"ID":"ecdcef30-d6e6-435e-813c-89f615992151","Type":"ContainerStarted","Data":"e68cfdf32938872cd38d6d23a1eb24ed5ec9fc9ce3b0f23f612a267c9b492c14"} Jun 03 08:54:32.470166 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.469969 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:54:32.515436 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.515397 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" podStartSLOduration=42.234050927 podStartE2EDuration="44.515384147s" podCreationTimestamp="2026-06-03 08:53:48 +0000 UTC" firstStartedPulling="2026-06-03 08:53:48.756715606 +0000 UTC m=+146.287979895" lastFinishedPulling="2026-06-03 08:53:51.038048825 +0000 UTC m=+148.569313115" observedRunningTime="2026-06-03 08:54:32.51467957 +0000 UTC m=+190.045943878" watchObservedRunningTime="2026-06-03 08:54:32.515384147 +0000 UTC m=+190.046648455" Jun 03 08:54:32.634381 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.634352 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c45f88c7c-76pkq"] Jun 03 08:54:32.637797 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.637778 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.642050 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.642028 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 08:54:32.642147 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.642075 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 08:54:32.642147 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.642131 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5f7ff\"" Jun 03 08:54:32.642248 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.642142 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 08:54:32.642565 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.642549 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 08:54:32.643091 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.643078 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-45th6r6bnap6o\"" Jun 03 08:54:32.643823 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.643807 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 08:54:32.656500 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.656478 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c45f88c7c-76pkq"] Jun 03 08:54:32.710493 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.710461 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-mphvt" Jun 03 08:54:32.758235 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.758141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-tls\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.758235 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.758198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ccf7a4-9a9b-435b-8b4a-2e5082959240-metrics-client-ca\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.758466 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.758256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.758466 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.758348 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.758466 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.758380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.758466 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.758441 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2clp\" (UniqueName: \"kubernetes.io/projected/76ccf7a4-9a9b-435b-8b4a-2e5082959240-kube-api-access-v2clp\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.758669 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.758469 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.758669 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.758495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-grpc-tls\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.859224 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.859183 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2clp\" (UniqueName: \"kubernetes.io/projected/76ccf7a4-9a9b-435b-8b4a-2e5082959240-kube-api-access-v2clp\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.859415 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.859240 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.859415 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.859398 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-grpc-tls\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.859546 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.859437 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-tls\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.859546 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.859473 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ccf7a4-9a9b-435b-8b4a-2e5082959240-metrics-client-ca\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.859546 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.859524 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.859748 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.859722 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.859822 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.859771 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.860254 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.860214 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ccf7a4-9a9b-435b-8b4a-2e5082959240-metrics-client-ca\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.862059 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.862036 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.862975 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.862888 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-tls\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.862975 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.862917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.863091 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.862997 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-grpc-tls\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.863133 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.863094 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.864150 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.864129 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76ccf7a4-9a9b-435b-8b4a-2e5082959240-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.874430 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.874406 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2clp\" (UniqueName: \"kubernetes.io/projected/76ccf7a4-9a9b-435b-8b4a-2e5082959240-kube-api-access-v2clp\") pod \"thanos-querier-7c45f88c7c-76pkq\" (UID: \"76ccf7a4-9a9b-435b-8b4a-2e5082959240\") " pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:32.946942 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:32.946910 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:33.095947 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:33.095919 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c45f88c7c-76pkq"] Jun 03 08:54:33.099120 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:54:33.099090 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ccf7a4_9a9b_435b_8b4a_2e5082959240.slice/crio-1c077c8a89a5a7c75ebdf70fc50ba7e2c77360bda3031f1830bc4e761eca35d4 WatchSource:0}: Error finding container 1c077c8a89a5a7c75ebdf70fc50ba7e2c77360bda3031f1830bc4e761eca35d4: Status 404 returned error can't find the container with id 1c077c8a89a5a7c75ebdf70fc50ba7e2c77360bda3031f1830bc4e761eca35d4 Jun 03 08:54:33.474782 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:33.474749 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ff7t" event={"ID":"0eababab-d973-4988-94db-5c6db7623ef1","Type":"ContainerStarted","Data":"b3a529aee5ff0781e6cd853430aad3b639e5d67e41bd726e43899efdc940ae61"} Jun 03 08:54:33.474782 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:33.474783 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ff7t" event={"ID":"0eababab-d973-4988-94db-5c6db7623ef1","Type":"ContainerStarted","Data":"e5effb824d88e1915b35ab71a2c0da544ec057d71ec9618fca1075e0d4d75a07"} Jun 03 08:54:33.475772 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:33.475746 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" event={"ID":"76ccf7a4-9a9b-435b-8b4a-2e5082959240","Type":"ContainerStarted","Data":"1c077c8a89a5a7c75ebdf70fc50ba7e2c77360bda3031f1830bc4e761eca35d4"} Jun 03 08:54:33.513371 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:33.513243 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7ff7t" podStartSLOduration=2.380220555 podStartE2EDuration="3.513224655s" podCreationTimestamp="2026-06-03 08:54:30 +0000 UTC" firstStartedPulling="2026-06-03 08:54:30.865779324 +0000 UTC m=+188.397043610" lastFinishedPulling="2026-06-03 08:54:31.998783417 +0000 UTC m=+189.530047710" observedRunningTime="2026-06-03 08:54:33.512661961 +0000 UTC m=+191.043926282" watchObservedRunningTime="2026-06-03 08:54:33.513224655 +0000 UTC m=+191.044488965" Jun 03 08:54:34.976149 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:34.976116 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-586897b4df-qxlwg"] Jun 03 08:54:34.979799 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:34.979777 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:34.984144 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:34.984121 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 08:54:34.985070 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:34.985038 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 08:54:34.985184 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:34.985077 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 08:54:34.985184 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:34.985112 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fvlz2\"" Jun 03 08:54:34.985184 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:34.985141 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1fu9rjf9qjr6e\"" Jun 03 08:54:34.985184 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:34.985038 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 08:54:34.992327 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:34.992273 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-586897b4df-qxlwg"] Jun 03 08:54:35.079830 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.079787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1dcadce1-a564-4910-924a-0757d2709622-secret-metrics-server-tls\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.080053 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.079847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxvmw\" (UniqueName: \"kubernetes.io/projected/1dcadce1-a564-4910-924a-0757d2709622-kube-api-access-hxvmw\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.080053 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.079960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1dcadce1-a564-4910-924a-0757d2709622-metrics-server-audit-profiles\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.080053 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.080001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dcadce1-a564-4910-924a-0757d2709622-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.080214 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.080063 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1dcadce1-a564-4910-924a-0757d2709622-client-ca-bundle\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.080214 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.080129 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1dcadce1-a564-4910-924a-0757d2709622-audit-log\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.080214 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.080160 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1dcadce1-a564-4910-924a-0757d2709622-secret-metrics-server-client-certs\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.181172 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.181141 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1dcadce1-a564-4910-924a-0757d2709622-metrics-server-audit-profiles\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.181431 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.181185 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dcadce1-a564-4910-924a-0757d2709622-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.181431 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.181207 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1dcadce1-a564-4910-924a-0757d2709622-client-ca-bundle\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.181431 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.181249 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1dcadce1-a564-4910-924a-0757d2709622-audit-log\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.181431 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.181277 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1dcadce1-a564-4910-924a-0757d2709622-secret-metrics-server-client-certs\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.181431 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.181363 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1dcadce1-a564-4910-924a-0757d2709622-secret-metrics-server-tls\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.181431 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.181387 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxvmw\" (UniqueName: \"kubernetes.io/projected/1dcadce1-a564-4910-924a-0757d2709622-kube-api-access-hxvmw\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.181714 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.181675 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1dcadce1-a564-4910-924a-0757d2709622-audit-log\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.181970 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.181943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dcadce1-a564-4910-924a-0757d2709622-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.182162 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.182140 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1dcadce1-a564-4910-924a-0757d2709622-metrics-server-audit-profiles\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.183839 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.183816 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1dcadce1-a564-4910-924a-0757d2709622-client-ca-bundle\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.183953 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.183841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1dcadce1-a564-4910-924a-0757d2709622-secret-metrics-server-tls\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.183953 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.183908 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1dcadce1-a564-4910-924a-0757d2709622-secret-metrics-server-client-certs\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.202970 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.202943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxvmw\" (UniqueName: \"kubernetes.io/projected/1dcadce1-a564-4910-924a-0757d2709622-kube-api-access-hxvmw\") pod \"metrics-server-586897b4df-qxlwg\" (UID: \"1dcadce1-a564-4910-924a-0757d2709622\") " pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.290785 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.290746 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:35.470656 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.470490 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-586897b4df-qxlwg"] Jun 03 08:54:35.472969 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:54:35.472941 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dcadce1_a564_4910_924a_0757d2709622.slice/crio-8d3fdb9eedef71ad804e4ae79dedf92d9623f81a2ee7896f9480196d90b0248c WatchSource:0}: Error finding container 8d3fdb9eedef71ad804e4ae79dedf92d9623f81a2ee7896f9480196d90b0248c: Status 404 returned error can't find the container with id 8d3fdb9eedef71ad804e4ae79dedf92d9623f81a2ee7896f9480196d90b0248c Jun 03 08:54:35.483056 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.483027 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" event={"ID":"76ccf7a4-9a9b-435b-8b4a-2e5082959240","Type":"ContainerStarted","Data":"191f0b3fb659192e20b1950cc6d9df4af9ced7cff840d8208f43a82c59291b0d"} Jun 03 08:54:35.483185 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.483068 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" event={"ID":"76ccf7a4-9a9b-435b-8b4a-2e5082959240","Type":"ContainerStarted","Data":"86b2dd3b71e597800eb834dc7e1afb706432cd526853982d0e94a714cd8e7cff"} Jun 03 08:54:35.483185 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.483084 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" event={"ID":"76ccf7a4-9a9b-435b-8b4a-2e5082959240","Type":"ContainerStarted","Data":"93c8f73419680d88a1de4d2e73d02571bb1d0c7cfed16096e8a57d08a13f8f93"} Jun 03 08:54:35.484097 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:35.484073 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" event={"ID":"1dcadce1-a564-4910-924a-0757d2709622","Type":"ContainerStarted","Data":"8d3fdb9eedef71ad804e4ae79dedf92d9623f81a2ee7896f9480196d90b0248c"} Jun 03 08:54:36.491196 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.491157 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" event={"ID":"76ccf7a4-9a9b-435b-8b4a-2e5082959240","Type":"ContainerStarted","Data":"1e7ef76e31269566ed7395f2765f7e31ff46a537d79a2b8fabd9723ae364c9aa"} Jun 03 08:54:36.491520 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.491202 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" event={"ID":"76ccf7a4-9a9b-435b-8b4a-2e5082959240","Type":"ContainerStarted","Data":"c650a170be8d9d3a7db2ce451a88c3d1dd0016f1b254852ace842e762b5f9a6a"} Jun 03 08:54:36.909252 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.909047 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:54:36.918389 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.918351 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:36.921464 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.921440 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 08:54:36.923997 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.923976 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 08:54:36.926100 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.926080 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-db62l5faef4oi\"" Jun 03 08:54:36.929259 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.928993 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 08:54:36.929494 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.929008 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 08:54:36.929494 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.929321 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 08:54:36.929494 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.929449 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 08:54:36.929494 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.929449 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 08:54:36.929832 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.929656 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 08:54:36.930707 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.929951 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 08:54:36.930707 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.930276 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 08:54:36.930707 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.930326 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-27lm5\"" Jun 03 08:54:36.930707 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.930416 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 08:54:36.931798 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.931581 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 08:54:36.941781 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.941760 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:54:36.999661 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.999507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:36.999661 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.999572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:36.999661 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.999602 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:36.999959 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.999784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:36.999959 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.999832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:36.999959 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.999925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:36.999959 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:36.999954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.000162 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.000011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.000162 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.000078 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.000267 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.000178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.000267 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.000222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.000414 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.000264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.000414 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.000315 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.000512 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.000462 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.000567 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.000532 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.000621 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.000570 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.000671 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.000617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sshwc\" (UniqueName: \"kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-kube-api-access-sshwc\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.000671 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.000657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101487 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101460 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101600 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101506 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101600 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101539 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101600 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101578 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101926 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101605 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101926 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101648 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101926 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101677 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101926 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101704 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101926 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101730 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101926 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101768 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101926 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101802 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101926 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101826 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sshwc\" (UniqueName: \"kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-kube-api-access-sshwc\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101926 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101855 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.101926 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101924 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.102416 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.101975 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.102416 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.102005 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.102416 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.102036 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.102416 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.102071 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.102416 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.102191 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.102759 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.102736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.103046 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.102838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.103612 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.103585 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.105241 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.105186 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.105357 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.105328 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.106750 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.106705 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.106930 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.106905 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.107662 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.107206 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.107662 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.107608 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.107662 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.107625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.107662 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.107615 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.107927 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.107812 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.108047 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.108021 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.108047 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.108039 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.108207 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.108146 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.108804 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.108784 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.115479 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.115455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sshwc\" (UniqueName: \"kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-kube-api-access-sshwc\") pod \"prometheus-k8s-0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.232256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.232208 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:37.387743 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.387415 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:54:37.495141 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.495106 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" event={"ID":"1dcadce1-a564-4910-924a-0757d2709622","Type":"ContainerStarted","Data":"b0c20f56ecb132adecaa7fdca32f9471303f3a7a9964726a7a19c59269f39be2"} Jun 03 08:54:37.496630 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.496585 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerStarted","Data":"b43d99ab18c0f3c1e4d68a0bb8eba3e45214e6332f140174f6eba76a81885e0e"} Jun 03 08:54:37.499571 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.499539 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" event={"ID":"76ccf7a4-9a9b-435b-8b4a-2e5082959240","Type":"ContainerStarted","Data":"3b5483330e19bcf928ffa49fd42c0a0c9f19dfb05046e74c667a179a2dab5c78"} Jun 03 08:54:37.499831 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.499806 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:37.518206 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.518150 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" podStartSLOduration=1.900721418 podStartE2EDuration="3.518132497s" podCreationTimestamp="2026-06-03 08:54:34 +0000 UTC" firstStartedPulling="2026-06-03 08:54:35.474825499 +0000 UTC m=+193.006089785" lastFinishedPulling="2026-06-03 08:54:37.092236578 +0000 UTC m=+194.623500864" observedRunningTime="2026-06-03 08:54:37.516918834 +0000 UTC m=+195.048183143" watchObservedRunningTime="2026-06-03 08:54:37.518132497 +0000 UTC m=+195.049396807" Jun 03 08:54:37.554976 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:37.550469 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" podStartSLOduration=2.355409152 podStartE2EDuration="5.550449586s" podCreationTimestamp="2026-06-03 08:54:32 +0000 UTC" firstStartedPulling="2026-06-03 08:54:33.101154914 +0000 UTC m=+190.632419205" lastFinishedPulling="2026-06-03 08:54:36.29619534 +0000 UTC m=+193.827459639" observedRunningTime="2026-06-03 08:54:37.548829528 +0000 UTC m=+195.080093837" watchObservedRunningTime="2026-06-03 08:54:37.550449586 +0000 UTC m=+195.081713899" Jun 03 08:54:38.503506 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:38.503410 2559 generic.go:358] "Generic (PLEG): container finished" podID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerID="3f27292525384423dc96e85d6f312d7467f2efcf44b3638a329d97d78ceddc7c" exitCode=0 Jun 03 08:54:38.503921 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:38.503509 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerDied","Data":"3f27292525384423dc96e85d6f312d7467f2efcf44b3638a329d97d78ceddc7c"} Jun 03 08:54:38.562187 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:38.562145 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d7c8999fd-dqqgg"] Jun 03 08:54:42.519566 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:42.519533 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerStarted","Data":"9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702"} Jun 03 08:54:42.519566 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:42.519569 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerStarted","Data":"edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723"} Jun 03 08:54:42.519988 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:42.519582 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerStarted","Data":"9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14"} Jun 03 08:54:42.519988 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:42.519595 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerStarted","Data":"1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3"} Jun 03 08:54:42.519988 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:42.519606 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerStarted","Data":"85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a"} Jun 03 08:54:42.519988 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:42.519617 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerStarted","Data":"d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d"} Jun 03 08:54:42.559080 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:42.559029 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.142125488 podStartE2EDuration="6.559014665s" podCreationTimestamp="2026-06-03 08:54:36 +0000 UTC" firstStartedPulling="2026-06-03 08:54:37.394090573 +0000 UTC m=+194.925354872" lastFinishedPulling="2026-06-03 08:54:41.810979762 +0000 UTC m=+199.342244049" observedRunningTime="2026-06-03 08:54:42.556256748 +0000 UTC m=+200.087521056" watchObservedRunningTime="2026-06-03 08:54:42.559014665 +0000 UTC m=+200.090279038" Jun 03 08:54:43.510707 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:43.510682 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c45f88c7c-76pkq" Jun 03 08:54:47.233245 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:47.233219 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:54:55.290943 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:55.290901 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:54:55.291413 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:54:55.290971 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:55:03.588671 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.588613 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" podUID="e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" containerName="registry" containerID="cri-o://7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69" gracePeriod=30 Jun 03 08:55:03.831011 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.830989 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:55:03.922431 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.922357 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-bound-sa-token\") pod \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " Jun 03 08:55:03.922431 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.922412 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs7f7\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-kube-api-access-hs7f7\") pod \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " Jun 03 08:55:03.922603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.922446 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-ca-trust-extracted\") pod \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " Jun 03 08:55:03.922603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.922473 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") pod \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " Jun 03 08:55:03.922603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.922504 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-certificates\") pod \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " Jun 03 08:55:03.922603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.922538 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-trusted-ca\") pod \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " Jun 03 08:55:03.922603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.922562 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-installation-pull-secrets\") pod \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " Jun 03 08:55:03.922603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.922598 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-image-registry-private-configuration\") pod \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\" (UID: \"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b\") " Jun 03 08:55:03.922984 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.922956 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:55:03.923051 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.923003 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:55:03.924912 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.924887 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-kube-api-access-hs7f7" (OuterVolumeSpecName: "kube-api-access-hs7f7") pod "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b"). InnerVolumeSpecName "kube-api-access-hs7f7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:55:03.925200 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.925174 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:55:03.925313 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.925174 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:55:03.925313 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.925216 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:55:03.925609 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.925594 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:55:03.931001 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:03.930974 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" (UID: "e89c34e5-1069-4ef2-af5f-dd70d0be8c5b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:04.023847 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.023810 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs7f7\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-kube-api-access-hs7f7\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:04.023847 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.023845 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-ca-trust-extracted\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:04.023990 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.023861 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-tls\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:04.023990 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.023875 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-registry-certificates\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:04.023990 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.023887 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-trusted-ca\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:04.023990 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.023900 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-installation-pull-secrets\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:04.023990 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.023913 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-image-registry-private-configuration\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:04.023990 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.023929 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b-bound-sa-token\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:04.579707 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.579673 2559 generic.go:358] "Generic (PLEG): container finished" podID="e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" containerID="7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69" exitCode=0 Jun 03 08:55:04.579860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.579731 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" Jun 03 08:55:04.579860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.579742 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" event={"ID":"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b","Type":"ContainerDied","Data":"7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69"} Jun 03 08:55:04.579860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.579767 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7c8999fd-dqqgg" event={"ID":"e89c34e5-1069-4ef2-af5f-dd70d0be8c5b","Type":"ContainerDied","Data":"cf2292a083438c17e68a570dc8d48899ee45dc6c5ca1e974d03cddea272a0fec"} Jun 03 08:55:04.579860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.579782 2559 scope.go:117] "RemoveContainer" containerID="7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69" Jun 03 08:55:04.588109 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.588092 2559 scope.go:117] "RemoveContainer" containerID="7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69" Jun 03 08:55:04.588411 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:55:04.588389 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69\": container with ID starting with 7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69 not found: ID does not exist" containerID="7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69" Jun 03 08:55:04.588467 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.588418 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69"} err="failed to get container status \"7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69\": rpc error: code = NotFound desc = could not find container \"7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69\": container with ID starting with 7d7b6787255ad8957fd94b98734d9549b30c61f3ba82fa2a3690142348d96d69 not found: ID does not exist" Jun 03 08:55:04.608361 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.608338 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d7c8999fd-dqqgg"] Jun 03 08:55:04.615127 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.615110 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d7c8999fd-dqqgg"] Jun 03 08:55:04.940096 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:04.940022 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" path="/var/lib/kubelet/pods/e89c34e5-1069-4ef2-af5f-dd70d0be8c5b/volumes" Jun 03 08:55:15.296086 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:15.296056 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:55:15.300069 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:15.300048 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-586897b4df-qxlwg" Jun 03 08:55:26.647506 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:26.647474 2559 generic.go:358] "Generic (PLEG): container finished" podID="84e672d7-a248-4b8f-97d4-9f73d91f1bf4" containerID="ac7cad39c9035dcd1207c618b8c5b5c06a2d613b1e8c339eb239a5a6e122c312" exitCode=0 Jun 03 08:55:26.648029 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:26.647557 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-tsx44" event={"ID":"84e672d7-a248-4b8f-97d4-9f73d91f1bf4","Type":"ContainerDied","Data":"ac7cad39c9035dcd1207c618b8c5b5c06a2d613b1e8c339eb239a5a6e122c312"} Jun 03 08:55:26.648029 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:26.647997 2559 scope.go:117] "RemoveContainer" containerID="ac7cad39c9035dcd1207c618b8c5b5c06a2d613b1e8c339eb239a5a6e122c312" Jun 03 08:55:27.653658 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:27.653628 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-tsx44" event={"ID":"84e672d7-a248-4b8f-97d4-9f73d91f1bf4","Type":"ContainerStarted","Data":"b88fc64199b2fd2d15cd66a4dc979a7f5ea98ffa2fcfd211a176693fbf890c97"} Jun 03 08:55:34.787783 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:34.787740 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:55:34.790071 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:34.790039 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30768073-4636-4456-aa24-a47199e99a4d-metrics-certs\") pod \"network-metrics-daemon-2sx6r\" (UID: \"30768073-4636-4456-aa24-a47199e99a4d\") " pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:55:34.940041 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:34.940016 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n9vs5\"" Jun 03 08:55:34.946249 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:34.946229 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2sx6r" Jun 03 08:55:35.079581 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:35.079506 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2sx6r"] Jun 03 08:55:35.082382 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:55:35.082356 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30768073_4636_4456_aa24_a47199e99a4d.slice/crio-d787d22f2ac6e11fc3b1f86cc50ee271637e3760134a436c978a6d942cada159 WatchSource:0}: Error finding container d787d22f2ac6e11fc3b1f86cc50ee271637e3760134a436c978a6d942cada159: Status 404 returned error can't find the container with id d787d22f2ac6e11fc3b1f86cc50ee271637e3760134a436c978a6d942cada159 Jun 03 08:55:35.676785 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:35.676711 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2sx6r" event={"ID":"30768073-4636-4456-aa24-a47199e99a4d","Type":"ContainerStarted","Data":"d787d22f2ac6e11fc3b1f86cc50ee271637e3760134a436c978a6d942cada159"} Jun 03 08:55:36.681086 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:36.681052 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2sx6r" event={"ID":"30768073-4636-4456-aa24-a47199e99a4d","Type":"ContainerStarted","Data":"7703cc2316eb96f08ca50414be641d0569a886d558b8314b8588a1e2af3c2bd4"} Jun 03 08:55:36.681086 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:36.681087 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2sx6r" event={"ID":"30768073-4636-4456-aa24-a47199e99a4d","Type":"ContainerStarted","Data":"f175cbc84399e7cf2f212919b248979911a117c777c0de8b300735b436214b3c"} Jun 03 08:55:37.232892 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:37.232858 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:37.252844 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:37.252822 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:37.315539 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:37.315486 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2sx6r" podStartSLOduration=253.254778373 podStartE2EDuration="4m14.315469185s" podCreationTimestamp="2026-06-03 08:51:23 +0000 UTC" firstStartedPulling="2026-06-03 08:55:35.084041695 +0000 UTC m=+252.615305981" lastFinishedPulling="2026-06-03 08:55:36.144732508 +0000 UTC m=+253.675996793" observedRunningTime="2026-06-03 08:55:36.712108199 +0000 UTC m=+254.243372507" watchObservedRunningTime="2026-06-03 08:55:37.315469185 +0000 UTC m=+254.846733481" Jun 03 08:55:37.700001 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:37.699971 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:55.442556 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.442522 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:55:55.443054 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.442980 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="prometheus" containerID="cri-o://d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d" gracePeriod=600 Jun 03 08:55:55.443181 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.443157 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702" gracePeriod=600 Jun 03 08:55:55.444017 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.443307 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy" containerID="cri-o://edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723" gracePeriod=600 Jun 03 08:55:55.444216 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.443336 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="config-reloader" containerID="cri-o://85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a" gracePeriod=600 Jun 03 08:55:55.444331 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.443277 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="thanos-sidecar" containerID="cri-o://1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3" gracePeriod=600 Jun 03 08:55:55.444331 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.443358 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy-web" containerID="cri-o://9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14" gracePeriod=600 Jun 03 08:55:55.743422 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.743319 2559 generic.go:358] "Generic (PLEG): container finished" podID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerID="9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702" exitCode=0 Jun 03 08:55:55.743422 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.743352 2559 generic.go:358] "Generic (PLEG): container finished" podID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerID="edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723" exitCode=0 Jun 03 08:55:55.743422 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.743362 2559 generic.go:358] "Generic (PLEG): container finished" podID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerID="1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3" exitCode=0 Jun 03 08:55:55.743422 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.743371 2559 generic.go:358] "Generic (PLEG): container finished" podID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerID="85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a" exitCode=0 Jun 03 08:55:55.743422 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.743379 2559 generic.go:358] "Generic (PLEG): container finished" podID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerID="d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d" exitCode=0 Jun 03 08:55:55.743422 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.743370 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerDied","Data":"9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702"} Jun 03 08:55:55.743422 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.743412 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerDied","Data":"edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723"} Jun 03 08:55:55.743869 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.743426 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerDied","Data":"1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3"} Jun 03 08:55:55.743869 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.743443 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerDied","Data":"85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a"} Jun 03 08:55:55.743869 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:55.743457 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerDied","Data":"d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d"} Jun 03 08:55:56.696058 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.696034 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:56.749260 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.749229 2559 generic.go:358] "Generic (PLEG): container finished" podID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerID="9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14" exitCode=0 Jun 03 08:55:56.749525 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.749275 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerDied","Data":"9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14"} Jun 03 08:55:56.749525 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.749324 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a4d4cb-21b9-46e6-98d6-856cec3929d0","Type":"ContainerDied","Data":"b43d99ab18c0f3c1e4d68a0bb8eba3e45214e6332f140174f6eba76a81885e0e"} Jun 03 08:55:56.749525 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.749341 2559 scope.go:117] "RemoveContainer" containerID="9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702" Jun 03 08:55:56.749525 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.749343 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:56.757437 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.757394 2559 scope.go:117] "RemoveContainer" containerID="edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723" Jun 03 08:55:56.766325 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.766279 2559 scope.go:117] "RemoveContainer" containerID="9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14" Jun 03 08:55:56.773110 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.773088 2559 scope.go:117] "RemoveContainer" containerID="1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3" Jun 03 08:55:56.779454 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.779438 2559 scope.go:117] "RemoveContainer" containerID="85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a" Jun 03 08:55:56.782498 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782480 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-kube-rbac-proxy\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782505 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-tls\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782526 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-kubelet-serving-ca-bundle\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782543 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-trusted-ca-bundle\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782564 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-rulefiles-0\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782591 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config-out\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782621 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-serving-certs-ca-bundle\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782659 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-web-config\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782687 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782711 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-db\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782744 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782787 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-metrics-client-ca\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782816 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sshwc\" (UniqueName: \"kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-kube-api-access-sshwc\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.782860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782844 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.783220 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782891 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-tls-assets\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.783220 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782920 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-thanos-prometheus-http-client-file\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.783220 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782978 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-metrics-client-certs\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.783220 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.782972 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:55:56.783220 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.783044 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-grpc-tls\") pod \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\" (UID: \"85a4d4cb-21b9-46e6-98d6-856cec3929d0\") " Jun 03 08:55:56.783220 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.783192 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:55:56.783527 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.783231 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:55:56.783527 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.783373 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.783527 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.783395 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.783527 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.783412 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.785269 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.784904 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:55:56.788183 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.787027 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:55:56.788183 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.787089 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:55:56.788183 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.787476 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:55:56.788183 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.787593 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config-out" (OuterVolumeSpecName: "config-out") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:56.788183 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.787742 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:55:56.788183 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.788068 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:55:56.789135 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.788455 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:56.789135 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.788686 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:55:56.789370 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.789339 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config" (OuterVolumeSpecName: "config") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:55:56.789453 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.789363 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:55:56.789540 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.789517 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:55:56.789603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.789583 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:55:56.789660 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.789645 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-kube-api-access-sshwc" (OuterVolumeSpecName: "kube-api-access-sshwc") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "kube-api-access-sshwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:55:56.789849 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.789826 2559 scope.go:117] "RemoveContainer" containerID="d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d" Jun 03 08:55:56.802908 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.802878 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-web-config" (OuterVolumeSpecName: "web-config") pod "85a4d4cb-21b9-46e6-98d6-856cec3929d0" (UID: "85a4d4cb-21b9-46e6-98d6-856cec3929d0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:55:56.806677 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.806659 2559 scope.go:117] "RemoveContainer" containerID="3f27292525384423dc96e85d6f312d7467f2efcf44b3638a329d97d78ceddc7c" Jun 03 08:55:56.813236 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.813214 2559 scope.go:117] "RemoveContainer" containerID="9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702" Jun 03 08:55:56.813504 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:55:56.813481 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702\": container with ID starting with 9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702 not found: ID does not exist" containerID="9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702" Jun 03 08:55:56.813580 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.813518 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702"} err="failed to get container status \"9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702\": rpc error: code = NotFound desc = could not find container \"9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702\": container with ID starting with 9bb703f94dd4e266aedcd02cfc48c26f05973870b14230a9e38910ff64043702 not found: ID does not exist" Jun 03 08:55:56.813580 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.813549 2559 scope.go:117] "RemoveContainer" containerID="edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723" Jun 03 08:55:56.813814 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:55:56.813798 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723\": container with ID starting with edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723 not found: ID does not exist" containerID="edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723" Jun 03 08:55:56.813858 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.813820 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723"} err="failed to get container status \"edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723\": rpc error: code = NotFound desc = could not find container \"edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723\": container with ID starting with edddabcb74aeff0e599acbb1031144e4626c723a8019d0a7cb745926e11ba723 not found: ID does not exist" Jun 03 08:55:56.813858 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.813840 2559 scope.go:117] "RemoveContainer" containerID="9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14" Jun 03 08:55:56.814067 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:55:56.814051 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14\": container with ID starting with 9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14 not found: ID does not exist" containerID="9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14" Jun 03 08:55:56.814129 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.814075 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14"} err="failed to get container status \"9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14\": rpc error: code = NotFound desc = could not find container \"9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14\": container with ID starting with 9325ea74ae8008ef1f1faa2b8ee14dd040b875baef2612ecb4a2745b12ad4f14 not found: ID does not exist" Jun 03 08:55:56.814129 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.814096 2559 scope.go:117] "RemoveContainer" containerID="1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3" Jun 03 08:55:56.814328 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:55:56.814313 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3\": container with ID starting with 1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3 not found: ID does not exist" containerID="1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3" Jun 03 08:55:56.814371 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.814332 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3"} err="failed to get container status \"1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3\": rpc error: code = NotFound desc = could not find container \"1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3\": container with ID starting with 1ae3772240558583d3d5660d4c5b9f16226a4481d0e43385afa97feebfe5e7d3 not found: ID does not exist" Jun 03 08:55:56.814371 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.814344 2559 scope.go:117] "RemoveContainer" containerID="85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a" Jun 03 08:55:56.814557 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:55:56.814541 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a\": container with ID starting with 85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a not found: ID does not exist" containerID="85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a" Jun 03 08:55:56.814610 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.814564 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a"} err="failed to get container status \"85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a\": rpc error: code = NotFound desc = could not find container \"85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a\": container with ID starting with 85357c78b3bb8d9b0051788abc248892a7b31fbc7dbbc78238f330606e951e2a not found: ID does not exist" Jun 03 08:55:56.814610 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.814583 2559 scope.go:117] "RemoveContainer" containerID="d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d" Jun 03 08:55:56.814801 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:55:56.814783 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d\": container with ID starting with d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d not found: ID does not exist" containerID="d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d" Jun 03 08:55:56.814838 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.814805 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d"} err="failed to get container status \"d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d\": rpc error: code = NotFound desc = could not find container \"d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d\": container with ID starting with d3a4d014f5e5d8f79d9bb2bba80a630447e91168a39572d337e85a75fa1cda3d not found: ID does not exist" Jun 03 08:55:56.814838 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.814820 2559 scope.go:117] "RemoveContainer" containerID="3f27292525384423dc96e85d6f312d7467f2efcf44b3638a329d97d78ceddc7c" Jun 03 08:55:56.815054 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:55:56.815038 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f27292525384423dc96e85d6f312d7467f2efcf44b3638a329d97d78ceddc7c\": container with ID starting with 3f27292525384423dc96e85d6f312d7467f2efcf44b3638a329d97d78ceddc7c not found: ID does not exist" containerID="3f27292525384423dc96e85d6f312d7467f2efcf44b3638a329d97d78ceddc7c" Jun 03 08:55:56.815090 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.815061 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f27292525384423dc96e85d6f312d7467f2efcf44b3638a329d97d78ceddc7c"} err="failed to get container status \"3f27292525384423dc96e85d6f312d7467f2efcf44b3638a329d97d78ceddc7c\": rpc error: code = NotFound desc = could not find container \"3f27292525384423dc96e85d6f312d7467f2efcf44b3638a329d97d78ceddc7c\": container with ID starting with 3f27292525384423dc96e85d6f312d7467f2efcf44b3638a329d97d78ceddc7c not found: ID does not exist" Jun 03 08:55:56.884644 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884609 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-metrics-client-certs\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884644 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884649 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-grpc-tls\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884663 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-kube-rbac-proxy\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884671 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884682 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884691 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config-out\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884700 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-web-config\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884709 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884720 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85a4d4cb-21b9-46e6-98d6-856cec3929d0-prometheus-k8s-db\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884734 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884746 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a4d4cb-21b9-46e6-98d6-856cec3929d0-configmap-metrics-client-ca\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884755 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sshwc\" (UniqueName: \"kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-kube-api-access-sshwc\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.884764 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884764 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-config\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.885098 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884772 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85a4d4cb-21b9-46e6-98d6-856cec3929d0-tls-assets\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:56.885098 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:56.884781 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85a4d4cb-21b9-46e6-98d6-856cec3929d0-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-104.ec2.internal\" DevicePath \"\"" Jun 03 08:55:57.070506 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.070432 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:55:57.077989 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.077964 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:55:57.111264 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111234 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:55:57.111603 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111587 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="init-config-reloader" Jun 03 08:55:57.111681 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111606 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="init-config-reloader" Jun 03 08:55:57.111681 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111624 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy" Jun 03 08:55:57.111681 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111634 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy" Jun 03 08:55:57.111681 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111646 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" containerName="registry" Jun 03 08:55:57.111681 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111654 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" containerName="registry" Jun 03 08:55:57.111681 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111664 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="prometheus" Jun 03 08:55:57.111681 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111672 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="prometheus" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111687 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy-web" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111695 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy-web" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111707 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="config-reloader" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111716 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="config-reloader" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111739 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy-thanos" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111747 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy-thanos" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111757 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="thanos-sidecar" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111766 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="thanos-sidecar" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111847 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="e89c34e5-1069-4ef2-af5f-dd70d0be8c5b" containerName="registry" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111861 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="thanos-sidecar" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111872 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="prometheus" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111883 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy-thanos" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111894 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111904 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="kube-rbac-proxy-web" Jun 03 08:55:57.112018 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.111914 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" containerName="config-reloader" Jun 03 08:55:57.116922 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.116899 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.119398 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.119371 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 08:55:57.119522 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.119435 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 08:55:57.119522 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.119435 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 08:55:57.119639 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.119614 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 08:55:57.119955 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.119935 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 08:55:57.120237 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.120218 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 08:55:57.120443 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.120429 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-db62l5faef4oi\"" Jun 03 08:55:57.120663 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.120649 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 08:55:57.120758 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.120650 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 08:55:57.120758 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.120704 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-27lm5\"" Jun 03 08:55:57.121469 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.121453 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 08:55:57.121469 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.121467 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 08:55:57.123334 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.123060 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 08:55:57.127364 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.127347 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 08:55:57.133062 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.133039 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:55:57.187968 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.187940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c331d88-09b4-479f-af48-048f95025b95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188103 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.187974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188103 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.187993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188103 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c331d88-09b4-479f-af48-048f95025b95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188103 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188226 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188106 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188226 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188126 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188226 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-config\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188226 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188203 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188411 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188411 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188411 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clk7z\" (UniqueName: \"kubernetes.io/projected/2c331d88-09b4-479f-af48-048f95025b95-kube-api-access-clk7z\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188411 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c331d88-09b4-479f-af48-048f95025b95-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188411 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188411 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188343 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188411 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188411 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.188411 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.188408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.288835 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.288804 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.288950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.288841 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.288950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.288860 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.288950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.288887 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-config\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.288950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.288906 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.288950 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.288925 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289048 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289090 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clk7z\" (UniqueName: \"kubernetes.io/projected/2c331d88-09b4-479f-af48-048f95025b95-kube-api-access-clk7z\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289141 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c331d88-09b4-479f-af48-048f95025b95-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289174 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289199 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289236 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289588 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289260 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289588 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289326 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289588 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289377 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c331d88-09b4-479f-af48-048f95025b95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289588 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289412 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289588 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289444 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289588 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289469 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c331d88-09b4-479f-af48-048f95025b95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289900 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289637 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289900 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289672 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289900 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289709 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.289900 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.289768 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c331d88-09b4-479f-af48-048f95025b95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.292537 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.292059 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.292537 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.292117 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-config\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.292537 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.292181 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.292537 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.292198 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c331d88-09b4-479f-af48-048f95025b95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.292537 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.292220 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.292537 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.292464 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.292537 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.292491 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.293758 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.292667 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.293758 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.293035 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.293899 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.293875 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c331d88-09b4-479f-af48-048f95025b95-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.294473 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.294450 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.294718 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.294702 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c331d88-09b4-479f-af48-048f95025b95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.299493 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.296069 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c331d88-09b4-479f-af48-048f95025b95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.301971 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.301952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clk7z\" (UniqueName: \"kubernetes.io/projected/2c331d88-09b4-479f-af48-048f95025b95-kube-api-access-clk7z\") pod \"prometheus-k8s-0\" (UID: \"2c331d88-09b4-479f-af48-048f95025b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.428874 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.428791 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:55:57.587500 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.587451 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:55:57.754178 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.754146 2559 generic.go:358] "Generic (PLEG): container finished" podID="2c331d88-09b4-479f-af48-048f95025b95" containerID="f7636372f0a9834f7d2f615a6e9f4ec96c762b600d32f3dc394d3a953878f0a7" exitCode=0 Jun 03 08:55:57.754582 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.754228 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c331d88-09b4-479f-af48-048f95025b95","Type":"ContainerDied","Data":"f7636372f0a9834f7d2f615a6e9f4ec96c762b600d32f3dc394d3a953878f0a7"} Jun 03 08:55:57.754582 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:57.754271 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c331d88-09b4-479f-af48-048f95025b95","Type":"ContainerStarted","Data":"18d4e183b444fcdd0e7a568d91e66e2a4ebaa9de6883a42aceb30759b7788550"} Jun 03 08:55:58.760530 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:58.760493 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c331d88-09b4-479f-af48-048f95025b95","Type":"ContainerStarted","Data":"bb7676a7f5e8e430e6bc2997216231346e38f764c8ad5b639124c40c09e29434"} Jun 03 08:55:58.760530 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:58.760535 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c331d88-09b4-479f-af48-048f95025b95","Type":"ContainerStarted","Data":"9e98e238b54fecb200466bf59c856edf0e7cf57b1875642972df59b0950803a1"} Jun 03 08:55:58.760931 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:58.760550 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c331d88-09b4-479f-af48-048f95025b95","Type":"ContainerStarted","Data":"c58c81689d40541a7bfb2a8e7a8bf802cd6daa76ebf9b0de9e25b7b515677bdd"} Jun 03 08:55:58.760931 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:58.760563 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c331d88-09b4-479f-af48-048f95025b95","Type":"ContainerStarted","Data":"059af12987ad8b3131a6489e3a5382dc5f5771dd1da9f63cb1e29a9b6ad3319c"} Jun 03 08:55:58.760931 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:58.760575 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c331d88-09b4-479f-af48-048f95025b95","Type":"ContainerStarted","Data":"a76b77665e21ea1330e8abc84bcbcfc3a349103bfc20214a630a8a64c43fb664"} Jun 03 08:55:58.760931 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:58.760587 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c331d88-09b4-479f-af48-048f95025b95","Type":"ContainerStarted","Data":"2bb55d2dae484df25de60934090c82411af8f6a294902ea2e69c1944023f6d0b"} Jun 03 08:55:58.795717 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:58.795668 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.795654225 podStartE2EDuration="1.795654225s" podCreationTimestamp="2026-06-03 08:55:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:55:58.793423159 +0000 UTC m=+276.324687468" watchObservedRunningTime="2026-06-03 08:55:58.795654225 +0000 UTC m=+276.326918532" Jun 03 08:55:58.941015 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:55:58.940983 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85a4d4cb-21b9-46e6-98d6-856cec3929d0" path="/var/lib/kubelet/pods/85a4d4cb-21b9-46e6-98d6-856cec3929d0/volumes" Jun 03 08:56:02.429925 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:02.429891 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:56:03.361100 ip-10-0-143-104 kubenswrapper[2559]: E0603 08:56:03.361053 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" podUID="0cf56bdc-559e-468b-8839-c9fd2a22e247" Jun 03 08:56:03.778682 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:03.778644 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:56:06.370543 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:06.370506 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:56:06.373038 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:06.373013 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cf56bdc-559e-468b-8839-c9fd2a22e247-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-bk6b2\" (UID: \"0cf56bdc-559e-468b-8839-c9fd2a22e247\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:56:06.488491 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:06.488453 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rcmzp\"" Jun 03 08:56:06.489336 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:06.489316 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" Jun 03 08:56:06.629754 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:06.629671 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2"] Jun 03 08:56:06.632525 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:56:06.632497 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf56bdc_559e_468b_8839_c9fd2a22e247.slice/crio-3437caf07a51edb6997b3168eaccb12d60e975c403b093206ae12e5d7bc77826 WatchSource:0}: Error finding container 3437caf07a51edb6997b3168eaccb12d60e975c403b093206ae12e5d7bc77826: Status 404 returned error can't find the container with id 3437caf07a51edb6997b3168eaccb12d60e975c403b093206ae12e5d7bc77826 Jun 03 08:56:06.789864 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:06.789831 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" event={"ID":"0cf56bdc-559e-468b-8839-c9fd2a22e247","Type":"ContainerStarted","Data":"3437caf07a51edb6997b3168eaccb12d60e975c403b093206ae12e5d7bc77826"} Jun 03 08:56:08.796973 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:08.796937 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" event={"ID":"0cf56bdc-559e-468b-8839-c9fd2a22e247","Type":"ContainerStarted","Data":"c5087e8ed03e3d3769766ffe524b18177670213ba40755c56f7e0b5b812135d7"} Jun 03 08:56:08.823369 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:08.823322 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-bk6b2" podStartSLOduration=275.594926653 podStartE2EDuration="4m36.823309264s" podCreationTimestamp="2026-06-03 08:51:32 +0000 UTC" firstStartedPulling="2026-06-03 08:56:06.634397059 +0000 UTC m=+284.165661344" lastFinishedPulling="2026-06-03 08:56:07.862779657 +0000 UTC m=+285.394043955" observedRunningTime="2026-06-03 08:56:08.822079044 +0000 UTC m=+286.353343351" watchObservedRunningTime="2026-06-03 08:56:08.823309264 +0000 UTC m=+286.354573566" Jun 03 08:56:22.852363 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:22.852334 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/2.log" Jun 03 08:56:22.852799 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:22.852336 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/2.log" Jun 03 08:56:22.859454 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:22.859430 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/ovn-acl-logging/0.log" Jun 03 08:56:22.859583 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:22.859551 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/ovn-acl-logging/0.log" Jun 03 08:56:22.862755 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:22.862740 2559 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 08:56:57.429684 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:57.429647 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:56:57.444760 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:57.444736 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:56:57.962693 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:56:57.962667 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:58:15.202419 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:15.202391 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hssgq_ed0f87f6-b558-43fd-bf3a-67c9c21049c1/global-pull-secret-syncer/0.log" Jun 03 08:58:15.393255 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:15.393233 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jdntd_300c606c-8fd5-4de2-87ff-cad17d01162f/konnectivity-agent/0.log" Jun 03 08:58:15.465186 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:15.465128 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-104.ec2.internal_7421be42ddd759e44d9f8c88d591ebb2/haproxy/0.log" Jun 03 08:58:18.844914 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:18.844887 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-7qrrh_a3453c0b-9d88-49be-957f-7ecf597f62cf/cluster-monitoring-operator/0.log" Jun 03 08:58:18.966097 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:18.966031 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-586897b4df-qxlwg_1dcadce1-a564-4910-924a-0757d2709622/metrics-server/0.log" Jun 03 08:58:19.029679 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.029659 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ff7t_0eababab-d973-4988-94db-5c6db7623ef1/node-exporter/0.log" Jun 03 08:58:19.053734 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.053715 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ff7t_0eababab-d973-4988-94db-5c6db7623ef1/kube-rbac-proxy/0.log" Jun 03 08:58:19.082812 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.082795 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ff7t_0eababab-d973-4988-94db-5c6db7623ef1/init-textfile/0.log" Jun 03 08:58:19.378332 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.378252 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c331d88-09b4-479f-af48-048f95025b95/prometheus/0.log" Jun 03 08:58:19.409804 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.409780 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c331d88-09b4-479f-af48-048f95025b95/config-reloader/0.log" Jun 03 08:58:19.434954 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.434933 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c331d88-09b4-479f-af48-048f95025b95/thanos-sidecar/0.log" Jun 03 08:58:19.473131 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.473111 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c331d88-09b4-479f-af48-048f95025b95/kube-rbac-proxy-web/0.log" Jun 03 08:58:19.511240 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.511217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c331d88-09b4-479f-af48-048f95025b95/kube-rbac-proxy/0.log" Jun 03 08:58:19.550855 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.550838 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c331d88-09b4-479f-af48-048f95025b95/kube-rbac-proxy-thanos/0.log" Jun 03 08:58:19.590938 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.590922 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c331d88-09b4-479f-af48-048f95025b95/init-config-reloader/0.log" Jun 03 08:58:19.640785 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.640729 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-qd8xk_7b4a8c73-9a63-4656-bd09-555ecd8bf4f2/prometheus-operator/0.log" Jun 03 08:58:19.674889 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.674870 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-qd8xk_7b4a8c73-9a63-4656-bd09-555ecd8bf4f2/kube-rbac-proxy/0.log" Jun 03 08:58:19.850941 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.850921 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c45f88c7c-76pkq_76ccf7a4-9a9b-435b-8b4a-2e5082959240/thanos-query/0.log" Jun 03 08:58:19.877604 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.877553 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c45f88c7c-76pkq_76ccf7a4-9a9b-435b-8b4a-2e5082959240/kube-rbac-proxy-web/0.log" Jun 03 08:58:19.902654 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.902606 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c45f88c7c-76pkq_76ccf7a4-9a9b-435b-8b4a-2e5082959240/kube-rbac-proxy/0.log" Jun 03 08:58:19.928922 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.928907 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c45f88c7c-76pkq_76ccf7a4-9a9b-435b-8b4a-2e5082959240/prom-label-proxy/0.log" Jun 03 08:58:19.957722 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.957702 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c45f88c7c-76pkq_76ccf7a4-9a9b-435b-8b4a-2e5082959240/kube-rbac-proxy-rules/0.log" Jun 03 08:58:19.989149 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:19.989130 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c45f88c7c-76pkq_76ccf7a4-9a9b-435b-8b4a-2e5082959240/kube-rbac-proxy-metrics/0.log" Jun 03 08:58:20.922760 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:20.922732 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-bk6b2_0cf56bdc-559e-468b-8839-c9fd2a22e247/networking-console-plugin/0.log" Jun 03 08:58:21.341041 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.341014 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/2.log" Jun 03 08:58:21.345393 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.345374 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mphvt_ecdcef30-d6e6-435e-813c-89f615992151/console-operator/3.log" Jun 03 08:58:21.513955 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.513925 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4"] Jun 03 08:58:21.517474 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.517455 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.520850 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.520823 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rrgps\"/\"kube-root-ca.crt\"" Jun 03 08:58:21.521498 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.521478 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rrgps\"/\"openshift-service-ca.crt\"" Jun 03 08:58:21.521589 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.521484 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rrgps\"/\"default-dockercfg-kmvdq\"" Jun 03 08:58:21.538089 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.538065 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4"] Jun 03 08:58:21.648100 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.648031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-proc\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.648100 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.648077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-podres\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.648100 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.648097 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jcfn\" (UniqueName: \"kubernetes.io/projected/8a1b2667-3542-4330-b750-bd44a4d4e28a-kube-api-access-7jcfn\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.648278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.648169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-sys\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.648278 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.648206 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-lib-modules\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.749362 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.749333 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-lib-modules\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.749455 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.749388 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-proc\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.749455 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.749414 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-podres\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.749455 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.749432 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jcfn\" (UniqueName: \"kubernetes.io/projected/8a1b2667-3542-4330-b750-bd44a4d4e28a-kube-api-access-7jcfn\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.749571 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.749455 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-sys\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.749571 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.749527 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-lib-modules\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.749571 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.749549 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-sys\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.749661 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.749562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-proc\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.749661 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.749550 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a1b2667-3542-4330-b750-bd44a4d4e28a-podres\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.761367 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.761346 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jcfn\" (UniqueName: \"kubernetes.io/projected/8a1b2667-3542-4330-b750-bd44a4d4e28a-kube-api-access-7jcfn\") pod \"perf-node-gather-daemonset-lgjd4\" (UID: \"8a1b2667-3542-4330-b750-bd44a4d4e28a\") " pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.827183 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.827163 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:21.946742 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.946718 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4"] Jun 03 08:58:21.949619 ip-10-0-143-104 kubenswrapper[2559]: W0603 08:58:21.949596 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a1b2667_3542_4330_b750_bd44a4d4e28a.slice/crio-a41438a1d2178abe88d3235066b848a9d22542289b95e317115894a08afaf11a WatchSource:0}: Error finding container a41438a1d2178abe88d3235066b848a9d22542289b95e317115894a08afaf11a: Status 404 returned error can't find the container with id a41438a1d2178abe88d3235066b848a9d22542289b95e317115894a08afaf11a Jun 03 08:58:21.951060 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:21.951043 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 08:58:22.197256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:22.197222 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" event={"ID":"8a1b2667-3542-4330-b750-bd44a4d4e28a","Type":"ContainerStarted","Data":"72758361bc411ea70cd6c4716adb4f7e8be3b330e619beb7ec2408b77d8a5ebc"} Jun 03 08:58:22.197256 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:22.197258 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" event={"ID":"8a1b2667-3542-4330-b750-bd44a4d4e28a","Type":"ContainerStarted","Data":"a41438a1d2178abe88d3235066b848a9d22542289b95e317115894a08afaf11a"} Jun 03 08:58:22.197458 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:22.197348 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:22.216682 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:22.216630 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" podStartSLOduration=1.216614484 podStartE2EDuration="1.216614484s" podCreationTimestamp="2026-06-03 08:58:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:58:22.214912116 +0000 UTC m=+419.746176424" watchObservedRunningTime="2026-06-03 08:58:22.216614484 +0000 UTC m=+419.747878795" Jun 03 08:58:23.056368 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:23.056338 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-plgjm_b6379b8f-9270-4976-8f9e-1e91d766b9b9/dns/0.log" Jun 03 08:58:23.080154 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:23.080125 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-plgjm_b6379b8f-9270-4976-8f9e-1e91d766b9b9/kube-rbac-proxy/0.log" Jun 03 08:58:23.133242 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:23.133221 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qgff7_dbc468ac-b2d9-40e6-a60f-a16d79b3720b/dns-node-resolver/0.log" Jun 03 08:58:23.620175 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:23.620147 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rrl7z_ba9932da-6f52-401b-a573-e160a5424714/node-ca/0.log" Jun 03 08:58:24.722408 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:24.722373 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-45tmd_3230ad30-2269-4401-bf72-d7ffeeebd823/serve-healthcheck-canary/0.log" Jun 03 08:58:25.241155 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:25.241123 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-tsx44_84e672d7-a248-4b8f-97d4-9f73d91f1bf4/insights-operator/1.log" Jun 03 08:58:25.241912 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:25.241883 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-tsx44_84e672d7-a248-4b8f-97d4-9f73d91f1bf4/insights-operator/0.log" Jun 03 08:58:25.274571 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:25.274524 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2bjv6_4b6aea76-27bc-4436-8f2f-ae2693acee3d/kube-rbac-proxy/0.log" Jun 03 08:58:25.318160 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:25.318139 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2bjv6_4b6aea76-27bc-4436-8f2f-ae2693acee3d/exporter/0.log" Jun 03 08:58:25.357749 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:25.357727 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2bjv6_4b6aea76-27bc-4436-8f2f-ae2693acee3d/extractor/0.log" Jun 03 08:58:28.210087 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:28.210054 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rrgps/perf-node-gather-daemonset-lgjd4" Jun 03 08:58:29.869904 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:29.869874 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-gkk4s_23036d92-f074-4b1b-96b9-30f0d4aba9f8/migrator/0.log" Jun 03 08:58:29.895735 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:29.895701 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-gkk4s_23036d92-f074-4b1b-96b9-30f0d4aba9f8/graceful-termination/0.log" Jun 03 08:58:31.365655 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:31.365578 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9zq8h_107776cd-7780-45a3-bcba-7016788a3afe/kube-multus/0.log" Jun 03 08:58:31.574274 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:31.574245 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdcjd_80a34e60-bdea-48dc-9d97-2a044d2faf19/kube-multus-additional-cni-plugins/0.log" Jun 03 08:58:31.597907 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:31.597883 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdcjd_80a34e60-bdea-48dc-9d97-2a044d2faf19/egress-router-binary-copy/0.log" Jun 03 08:58:31.624734 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:31.624672 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdcjd_80a34e60-bdea-48dc-9d97-2a044d2faf19/cni-plugins/0.log" Jun 03 08:58:31.648781 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:31.648757 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdcjd_80a34e60-bdea-48dc-9d97-2a044d2faf19/bond-cni-plugin/0.log" Jun 03 08:58:31.681457 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:31.681427 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdcjd_80a34e60-bdea-48dc-9d97-2a044d2faf19/routeoverride-cni/0.log" Jun 03 08:58:31.709457 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:31.709429 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdcjd_80a34e60-bdea-48dc-9d97-2a044d2faf19/whereabouts-cni-bincopy/0.log" Jun 03 08:58:31.744929 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:31.744903 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdcjd_80a34e60-bdea-48dc-9d97-2a044d2faf19/whereabouts-cni/0.log" Jun 03 08:58:32.030424 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:32.030399 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2sx6r_30768073-4636-4456-aa24-a47199e99a4d/network-metrics-daemon/0.log" Jun 03 08:58:32.053822 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:32.053795 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2sx6r_30768073-4636-4456-aa24-a47199e99a4d/kube-rbac-proxy/0.log" Jun 03 08:58:33.429860 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:33.429832 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/ovn-controller/0.log" Jun 03 08:58:33.453267 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:33.453241 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/ovn-acl-logging/0.log" Jun 03 08:58:33.455170 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:33.455154 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/ovn-acl-logging/1.log" Jun 03 08:58:33.477809 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:33.477783 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/kube-rbac-proxy-node/0.log" Jun 03 08:58:33.501048 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:33.501021 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 08:58:33.522590 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:33.522561 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/northd/0.log" Jun 03 08:58:33.547784 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:33.547755 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/nbdb/0.log" Jun 03 08:58:33.573208 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:33.573178 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/sbdb/0.log" Jun 03 08:58:33.662484 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:33.662454 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kg4nm_4b3b98fd-e96e-40e1-a238-f11c00121ebc/ovnkube-controller/0.log" Jun 03 08:58:35.047076 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:35.047046 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-nq258_90ec62e8-5a77-410f-8ce2-086394e25eed/check-endpoints/0.log" Jun 03 08:58:35.126619 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:35.126583 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hkt2l_f5d4b63e-7d58-411f-ab3a-1ab5acfce9b3/network-check-target-container/0.log" Jun 03 08:58:36.101894 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:36.101828 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cd2df_84be9f15-fa8a-4426-825c-be4d3c9fcf1c/iptables-alerter/0.log" Jun 03 08:58:36.850400 ip-10-0-143-104 kubenswrapper[2559]: I0603 08:58:36.850368 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-h82q6_54b10fc1-f115-45ba-8967-7e75ea61f7f1/tuned/0.log"