Jun 02 14:44:38.359599 ip-10-0-133-192 systemd[1]: Starting Kubernetes Kubelet... Jun 02 14:44:38.828824 ip-10-0-133-192 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 14:44:38.828824 ip-10-0-133-192 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 14:44:38.831459 ip-10-0-133-192 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 14:44:38.831459 ip-10-0-133-192 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 14:44:38.831459 ip-10-0-133-192 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 14:44:38.833338 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.833223 2564 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 14:44:38.836932 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836916 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 14:44:38.836932 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836931 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836935 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836939 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836942 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836945 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836947 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836950 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836953 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836955 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836958 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836961 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836963 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836966 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836968 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836971 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836973 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836976 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836978 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836980 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836983 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836985 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 14:44:38.836999 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836988 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.836990 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837001 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837004 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837009 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837013 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837016 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837018 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837021 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837023 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837026 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837028 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837031 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837033 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837036 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837039 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837041 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837044 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837047 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 14:44:38.837527 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837049 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837052 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837054 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837057 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837060 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837062 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837065 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837068 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837071 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837073 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837075 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837078 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837080 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837083 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837085 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837089 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837091 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837094 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837096 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837099 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 14:44:38.838000 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837102 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837104 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837106 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837109 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837112 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837114 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837116 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837119 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837121 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837124 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837126 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837128 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837131 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837133 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837136 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837139 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837141 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837144 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837146 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837149 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 14:44:38.838518 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837152 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837155 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837157 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837162 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.837166 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838294 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838314 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838318 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838321 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838324 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838327 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838330 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838333 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838335 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838339 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838341 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838344 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838347 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838349 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 14:44:38.839064 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838352 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838354 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838357 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838360 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838362 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838365 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838367 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838370 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838373 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838376 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838378 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838381 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838385 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838388 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838391 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838394 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838397 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838399 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838401 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 14:44:38.839543 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838404 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838406 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838409 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838411 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838414 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838417 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838419 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838422 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838424 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838427 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838429 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838432 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838434 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838437 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838439 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838442 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838444 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838447 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838449 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838452 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 14:44:38.840126 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838454 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838457 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838459 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838461 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838464 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838468 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838470 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838472 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838475 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838477 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838480 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838482 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838484 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838487 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838489 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838492 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838495 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838498 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838500 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838503 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 14:44:38.840649 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838505 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838507 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838510 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838513 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838515 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838517 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838520 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838523 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838525 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838529 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838532 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838535 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.838537 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838615 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838624 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838630 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838635 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838639 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838643 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838647 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838651 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 14:44:38.841140 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838655 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838658 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838661 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838664 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838667 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838670 2564 flags.go:64] FLAG: --cgroup-root="" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838673 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838676 2564 flags.go:64] FLAG: --client-ca-file="" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838679 2564 flags.go:64] FLAG: --cloud-config="" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838682 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838685 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838689 2564 flags.go:64] FLAG: --cluster-domain="" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838691 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838694 2564 flags.go:64] FLAG: --config-dir="" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838696 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838700 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838703 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838706 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838709 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838712 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838715 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838718 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838720 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838724 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838727 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 14:44:38.841656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838731 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838738 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838742 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838745 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838748 2564 flags.go:64] FLAG: --enable-server="true" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838751 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838756 2564 flags.go:64] FLAG: --event-burst="100" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838759 2564 flags.go:64] FLAG: --event-qps="50" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838762 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838765 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838768 2564 flags.go:64] FLAG: --eviction-hard="" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838772 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838775 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838778 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838781 2564 flags.go:64] FLAG: --eviction-soft="" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838784 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838786 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838789 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838792 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838795 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838797 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838800 2564 flags.go:64] FLAG: --feature-gates="" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838804 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838807 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838810 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 14:44:38.842259 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838813 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838815 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838818 2564 flags.go:64] FLAG: --help="false" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838821 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-133-192.ec2.internal" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838824 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838827 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838829 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838832 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838835 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838839 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838842 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838845 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838847 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838850 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838853 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838856 2564 flags.go:64] FLAG: --kube-reserved="" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838859 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838861 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838864 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838868 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838871 2564 flags.go:64] FLAG: --lock-file="" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838873 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838876 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838879 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 14:44:38.842883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838884 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838887 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838890 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838892 2564 flags.go:64] FLAG: --logging-format="text" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838895 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838898 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838901 2564 flags.go:64] FLAG: --manifest-url="" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838904 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838908 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838910 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838915 2564 flags.go:64] FLAG: --max-pods="110" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838917 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838920 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838923 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838926 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838929 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838932 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838935 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838943 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838948 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838951 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838954 2564 flags.go:64] FLAG: --pod-cidr="" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838957 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 14:44:38.843520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838963 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838966 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838969 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838972 2564 flags.go:64] FLAG: --port="10250" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838975 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838978 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0737349b4c4d238e5" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838981 2564 flags.go:64] FLAG: --qos-reserved="" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838984 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838986 2564 flags.go:64] FLAG: --register-node="true" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838989 2564 flags.go:64] FLAG: --register-schedulable="true" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838992 2564 flags.go:64] FLAG: --register-with-taints="" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838995 2564 flags.go:64] FLAG: --registry-burst="10" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.838998 2564 flags.go:64] FLAG: --registry-qps="5" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839001 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839003 2564 flags.go:64] FLAG: --reserved-memory="" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839007 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839010 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839012 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839015 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839017 2564 flags.go:64] FLAG: --runonce="false" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839020 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839023 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839026 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839028 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839031 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839034 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 14:44:38.844082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839037 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839040 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839045 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839048 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839050 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839053 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839055 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839058 2564 flags.go:64] FLAG: --system-cgroups="" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839061 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839066 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839069 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839071 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839075 2564 flags.go:64] FLAG: --tls-min-version="" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839078 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839081 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839083 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839086 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839089 2564 flags.go:64] FLAG: --v="2" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839093 2564 flags.go:64] FLAG: --version="false" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839097 2564 flags.go:64] FLAG: --vmodule="" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839101 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.839104 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839201 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839204 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839207 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 14:44:38.844720 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839210 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839213 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839216 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839219 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839221 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839224 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839227 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839229 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839232 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839236 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839238 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839241 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839243 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839245 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839248 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839250 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839253 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839255 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839257 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839260 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 14:44:38.845336 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839262 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839264 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839267 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839269 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839272 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839274 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839277 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839280 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839282 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839285 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839287 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839290 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839292 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839295 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839297 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839314 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839317 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839321 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839324 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839326 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 14:44:38.845881 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839329 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839333 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839336 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839339 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839341 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839344 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839346 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839349 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839351 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839354 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839356 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839358 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839361 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839363 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839366 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839368 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839370 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839373 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839376 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839378 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 14:44:38.846412 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839381 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839383 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839386 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839390 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839393 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839396 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839399 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839403 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839406 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839411 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839414 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839417 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839420 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839424 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839426 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839429 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839432 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839434 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839437 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 14:44:38.846922 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839439 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839442 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839444 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.839447 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.840239 2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.846772 2564 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.846788 2564 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846837 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846843 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846846 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846849 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846852 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846855 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846858 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846861 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 14:44:38.847407 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846864 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846866 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846869 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846872 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846874 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846876 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846879 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846882 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846885 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846887 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846890 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846892 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846895 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846897 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846901 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846904 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846907 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846911 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846916 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846919 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 14:44:38.847783 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846921 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846924 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846927 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846930 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846932 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846935 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846938 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846941 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846944 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846946 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846949 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846951 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846954 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846957 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846959 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846962 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846964 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846966 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846969 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846971 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 14:44:38.848329 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846974 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846976 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846978 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846981 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846984 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846986 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846988 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846991 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846994 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846996 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.846998 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847001 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847003 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847005 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847008 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847012 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847014 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847017 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847019 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847022 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 14:44:38.848841 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847024 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847026 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847029 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847031 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847034 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847038 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847042 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847045 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847047 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847050 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847052 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847055 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847058 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847060 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847063 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847065 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847067 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 14:44:38.849348 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847070 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.847075 2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847179 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847185 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847188 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847191 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847194 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847197 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847199 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847202 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847205 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847207 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847211 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847213 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847216 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 14:44:38.849801 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847219 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847221 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847224 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847226 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847229 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847231 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847234 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847237 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847239 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847242 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847244 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847247 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847249 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847252 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847254 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847256 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847259 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847261 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847264 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847267 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 14:44:38.850169 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847269 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847272 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847274 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847277 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847279 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847282 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847285 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847287 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847290 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847292 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847295 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847297 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847300 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847323 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847326 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847328 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847331 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847333 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847336 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847340 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 14:44:38.850671 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847344 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847346 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847349 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847352 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847354 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847356 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847359 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847361 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847363 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847366 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847368 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847371 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847373 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847375 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847385 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847388 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847390 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847393 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847395 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 14:44:38.851158 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847398 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847401 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847403 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847405 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847408 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847411 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847413 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847416 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847419 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847422 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847424 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847426 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847429 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:38.847431 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.847436 2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 14:44:38.851628 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.848088 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 14:44:38.854389 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.854375 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 14:44:38.855311 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.855289 2564 server.go:1019] "Starting client certificate rotation" Jun 02 14:44:38.855427 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.855408 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 14:44:38.855472 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.855447 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 14:44:38.882996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.882976 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 14:44:38.886633 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.886612 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 14:44:38.904520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.904495 2564 log.go:25] "Validated CRI v1 runtime API" Jun 02 14:44:38.911419 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.911396 2564 log.go:25] "Validated CRI v1 image API" Jun 02 14:44:38.912904 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.912879 2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 14:44:38.914045 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.914028 2564 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 14:44:38.917226 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.917205 2564 fs.go:135] Filesystem UUIDs: map[682982f6-de2c-4248-8fbe-52473c21e1c5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8ee553f2-550e-4d13-b0fa-de97dec6eff4:/dev/nvme0n1p3] Jun 02 14:44:38.917273 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.917227 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 14:44:38.921634 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.921525 2564 manager.go:217] Machine: {Timestamp:2026-06-02 14:44:38.921018159 +0000 UTC m=+0.428920790 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3127234 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec251df1bfd94a54356f2d3d2bbbf8f5 SystemUUID:ec251df1-bfd9-4a54-356f-2d3d2bbbf8f5 BootID:957a536d-65e6-43b9-a7f5-856b6b028683 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:59:24:45:cc:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:59:24:45:cc:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:97:7a:be:3e:44 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 14:44:38.922260 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.922249 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 14:44:38.922371 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.922358 2564 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 14:44:38.926076 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.926052 2564 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 14:44:38.926224 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.926079 2564 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 14:44:38.926269 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.926234 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 14:44:38.926269 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.926243 2564 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 14:44:38.926269 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.926250 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 14:44:38.927154 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.927144 2564 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 14:44:38.928439 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.928428 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 02 14:44:38.928727 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.928716 2564 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 14:44:38.931159 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.931149 2564 kubelet.go:491] "Attempting to sync node with API server" Jun 02 14:44:38.931191 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.931169 2564 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 14:44:38.931191 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.931181 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 14:44:38.931255 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.931192 2564 kubelet.go:397] "Adding apiserver pod source" Jun 02 14:44:38.931255 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.931201 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 14:44:38.932671 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.932658 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 14:44:38.932718 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.932678 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 14:44:38.934731 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.934707 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d588v" Jun 02 14:44:38.935732 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.935715 2564 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 14:44:38.937636 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.937619 2564 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 14:44:38.939773 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939756 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 14:44:38.939821 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939783 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 14:44:38.939821 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939800 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 14:44:38.939821 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939806 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 14:44:38.939821 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939815 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 14:44:38.939821 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939821 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 14:44:38.939958 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939829 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 14:44:38.939958 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939836 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 14:44:38.939958 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939857 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 14:44:38.939958 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939864 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 14:44:38.939958 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939873 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 14:44:38.939958 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.939879 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 14:44:38.940125 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.940045 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d588v" Jun 02 14:44:38.940737 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.940726 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 14:44:38.940737 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.940737 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 14:44:38.942443 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:38.942414 2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 14:44:38.944056 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:38.942414 2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 14:44:38.946559 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.946537 2564 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 14:44:38.946762 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.946749 2564 server.go:1295] "Started kubelet" Jun 02 14:44:38.946984 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.946922 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 14:44:38.947038 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.946972 2564 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 14:44:38.947082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.947053 2564 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 14:44:38.948105 ip-10-0-133-192 systemd[1]: Started Kubernetes Kubelet. Jun 02 14:44:38.948275 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.948262 2564 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 14:44:38.952463 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.952444 2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-192.ec2.internal" not found Jun 02 14:44:38.952715 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.952702 2564 server.go:317] "Adding debug handlers to kubelet server" Jun 02 14:44:38.955466 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.955446 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 14:44:38.955466 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.955463 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 14:44:38.955624 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.955511 2564 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 14:44:38.955624 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.955520 2564 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 14:44:38.955737 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.955665 2564 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 14:44:38.955737 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.955713 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 02 14:44:38.955737 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.955721 2564 reconciler.go:26] "Reconciler: start to sync state" Jun 02 14:44:38.956626 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:38.956596 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:38.956891 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:38.956829 2564 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 14:44:38.956891 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.956861 2564 factory.go:153] Registering CRI-O factory Jun 02 14:44:38.956891 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.956880 2564 factory.go:223] Registration of the crio container factory successfully Jun 02 14:44:38.957065 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.956936 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 14:44:38.957065 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.956945 2564 factory.go:55] Registering systemd factory Jun 02 14:44:38.957065 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.956955 2564 factory.go:223] Registration of the systemd container factory successfully Jun 02 14:44:38.957065 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.956990 2564 factory.go:103] Registering Raw factory Jun 02 14:44:38.957065 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.957021 2564 manager.go:1196] Started watching for new ooms in manager Jun 02 14:44:38.957517 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.957497 2564 manager.go:319] Starting recovery of all containers Jun 02 14:44:38.959065 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.959042 2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:44:38.962472 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:38.962265 2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-192.ec2.internal\" not found" node="ip-10-0-133-192.ec2.internal" Jun 02 14:44:38.966221 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.966202 2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-192.ec2.internal" not found Jun 02 14:44:38.968377 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.968361 2564 manager.go:324] Recovery completed Jun 02 14:44:38.972418 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.972405 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:44:38.975554 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.975538 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:44:38.975627 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.975569 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:44:38.975627 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.975584 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:44:38.976068 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.976055 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 14:44:38.976068 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.976067 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 14:44:38.976151 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.976084 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 02 14:44:38.979042 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.979030 2564 policy_none.go:49] "None policy: Start" Jun 02 14:44:38.979085 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.979048 2564 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 14:44:38.979085 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:38.979057 2564 state_mem.go:35] "Initializing new in-memory state store" Jun 02 14:44:39.014893 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.014869 2564 manager.go:341] "Starting Device Plugin manager" Jun 02 14:44:39.028474 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.014940 2564 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 14:44:39.028474 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.014954 2564 server.go:85] "Starting device plugin registration server" Jun 02 14:44:39.028474 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.015183 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 14:44:39.028474 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.015195 2564 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 14:44:39.028474 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.015278 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 14:44:39.028474 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.015368 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 14:44:39.028474 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.015376 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 14:44:39.028474 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.016258 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 14:44:39.028474 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.016297 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:39.028474 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.023429 2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-192.ec2.internal" not found Jun 02 14:44:39.078423 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.078378 2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 14:44:39.079724 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.079665 2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 14:44:39.079724 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.079697 2564 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 14:44:39.079724 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.079722 2564 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 14:44:39.079895 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.079734 2564 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 14:44:39.079895 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.079780 2564 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 14:44:39.084007 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.083990 2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:44:39.115501 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.115475 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:44:39.116476 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.116463 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:44:39.116528 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.116494 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:44:39.116528 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.116509 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:44:39.116590 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.116531 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.125233 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.125220 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.125274 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.125241 2564 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-192.ec2.internal\": node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:39.135745 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.135725 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:39.180240 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.180218 2564 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-192.ec2.internal"] Jun 02 14:44:39.180295 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.180282 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:44:39.185425 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.185412 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:44:39.185474 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.185441 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:44:39.185474 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.185450 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:44:39.186810 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.186797 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:44:39.187457 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.187444 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:44:39.187507 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.187458 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.187507 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.187469 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:44:39.187507 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.187479 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:44:39.187507 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.187486 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:44:39.188114 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.188099 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:44:39.188194 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.188125 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:44:39.188194 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.188134 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:44:39.188567 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.188546 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.188567 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.188570 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:44:39.189188 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.189172 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:44:39.189264 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.189198 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:44:39.189264 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.189207 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:44:39.216958 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.216935 2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-192.ec2.internal\" not found" node="ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.221166 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.221151 2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-192.ec2.internal\" not found" node="ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.236055 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.236039 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:39.257357 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.257335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/612917a73c36c7ecd731f78efad6f442-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal\" (UID: \"612917a73c36c7ecd731f78efad6f442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.336785 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.336721 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:39.358095 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.358077 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/612917a73c36c7ecd731f78efad6f442-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal\" (UID: \"612917a73c36c7ecd731f78efad6f442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.358161 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.358103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/612917a73c36c7ecd731f78efad6f442-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal\" (UID: \"612917a73c36c7ecd731f78efad6f442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.358161 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.358124 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b2ad47d5e6987ad43e3dd52c6b00aa3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-192.ec2.internal\" (UID: \"3b2ad47d5e6987ad43e3dd52c6b00aa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.358226 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.358183 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/612917a73c36c7ecd731f78efad6f442-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal\" (UID: \"612917a73c36c7ecd731f78efad6f442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.437518 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.437486 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:39.458815 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.458787 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/612917a73c36c7ecd731f78efad6f442-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal\" (UID: \"612917a73c36c7ecd731f78efad6f442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.458863 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.458824 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b2ad47d5e6987ad43e3dd52c6b00aa3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-192.ec2.internal\" (UID: \"3b2ad47d5e6987ad43e3dd52c6b00aa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.458899 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.458883 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b2ad47d5e6987ad43e3dd52c6b00aa3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-192.ec2.internal\" (UID: \"3b2ad47d5e6987ad43e3dd52c6b00aa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.458899 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.458888 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/612917a73c36c7ecd731f78efad6f442-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal\" (UID: \"612917a73c36c7ecd731f78efad6f442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.518952 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.518928 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.524530 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.524516 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-192.ec2.internal" Jun 02 14:44:39.538138 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.538118 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:39.638698 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.638611 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:39.739123 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.739086 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:39.839680 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.839643 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:39.854764 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.854741 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 14:44:39.854916 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.854898 2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 14:44:39.854952 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.854919 2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 14:44:39.940367 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:39.940338 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:39.942541 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.942501 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 14:39:38 +0000 UTC" deadline="2027-12-08 00:38:29.129941431 +0000 UTC" Jun 02 14:44:39.942606 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.942545 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13281h53m49.187401184s" Jun 02 14:44:39.955625 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.955603 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 14:44:39.976018 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.975990 2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 14:44:39.983574 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:39.983548 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b2ad47d5e6987ad43e3dd52c6b00aa3.slice/crio-aee229b97ce14dfcb1e84ae3be2c80333dbaf716e501b0a8eb24bdd61acde01c WatchSource:0}: Error finding container aee229b97ce14dfcb1e84ae3be2c80333dbaf716e501b0a8eb24bdd61acde01c: Status 404 returned error can't find the container with id aee229b97ce14dfcb1e84ae3be2c80333dbaf716e501b0a8eb24bdd61acde01c Jun 02 14:44:39.983961 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:39.983924 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612917a73c36c7ecd731f78efad6f442.slice/crio-c44375fa4319ae2fc56f4ef3688869773d0044964c7d033c49a81b6ddd2a1f66 WatchSource:0}: Error finding container c44375fa4319ae2fc56f4ef3688869773d0044964c7d033c49a81b6ddd2a1f66: Status 404 returned error can't find the container with id c44375fa4319ae2fc56f4ef3688869773d0044964c7d033c49a81b6ddd2a1f66 Jun 02 14:44:39.987366 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.987349 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 14:44:39.995437 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:39.995416 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mhbtd" Jun 02 14:44:40.002082 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.002064 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mhbtd" Jun 02 14:44:40.040680 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:40.040623 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:40.083551 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.083502 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-192.ec2.internal" event={"ID":"3b2ad47d5e6987ad43e3dd52c6b00aa3","Type":"ContainerStarted","Data":"aee229b97ce14dfcb1e84ae3be2c80333dbaf716e501b0a8eb24bdd61acde01c"} Jun 02 14:44:40.084422 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.084400 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" event={"ID":"612917a73c36c7ecd731f78efad6f442","Type":"ContainerStarted","Data":"c44375fa4319ae2fc56f4ef3688869773d0044964c7d033c49a81b6ddd2a1f66"} Jun 02 14:44:40.141577 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:40.141556 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:40.242096 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:40.242030 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:40.342578 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:40.342544 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-192.ec2.internal\" not found" Jun 02 14:44:40.354817 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.354796 2564 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:44:40.387664 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.387634 2564 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:44:40.456131 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.456103 2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-192.ec2.internal" Jun 02 14:44:40.465998 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.465883 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 14:44:40.466865 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.466841 2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" Jun 02 14:44:40.475593 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.475467 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 14:44:40.932678 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.932641 2564 apiserver.go:52] "Watching apiserver" Jun 02 14:44:40.944318 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.944275 2564 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 14:44:40.944645 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.944612 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-wn6xc","kube-system/kube-apiserver-proxy-ip-10-0-133-192.ec2.internal","openshift-cluster-node-tuning-operator/tuned-rthgk","openshift-dns/node-resolver-k6sqt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal","openshift-multus/multus-additional-cni-plugins-8vp9n","openshift-multus/network-metrics-daemon-2p9gp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr","openshift-image-registry/node-ca-7987p","openshift-multus/multus-b68xm","openshift-network-diagnostics/network-check-target-f4q6p","openshift-network-operator/iptables-alerter-8qq9p","openshift-ovn-kubernetes/ovnkube-node-hjh6n"] Jun 02 14:44:40.946132 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.946113 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:40.946237 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:40.946192 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:44:40.947268 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.947245 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.948421 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.948399 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k6sqt" Jun 02 14:44:40.949778 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.949758 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 14:44:40.950260 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.950241 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2nvvr\"" Jun 02 14:44:40.950364 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.950262 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 14:44:40.950990 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.950969 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 14:44:40.951216 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.951194 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:44:40.951366 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.951345 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 14:44:40.951736 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.951720 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qlkn6\"" Jun 02 14:44:40.953177 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.952809 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:40.953177 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.952891 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:40.953724 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.953709 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 14:44:40.953821 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.953741 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-phlrf\"" Jun 02 14:44:40.953821 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.953785 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 14:44:40.953997 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.953978 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7987p" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.955336 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.955555 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.955740 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.955917 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.956207 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-65q5f\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.956281 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.956398 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.956491 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.956560 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.956711 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.956752 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ds6tb\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.956713 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.956782 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tpsnl\"" Jun 02 14:44:40.956859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.956836 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 14:44:40.957741 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.957673 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:40.957803 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:40.957747 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:44:40.957867 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.957815 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8qq9p" Jun 02 14:44:40.957960 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.957675 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.959271 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.959254 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:40.960449 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.960420 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dmbfh\"" Jun 02 14:44:40.960842 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.960820 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 14:44:40.961008 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.960991 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 14:44:40.961067 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.961022 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zmtjn\"" Jun 02 14:44:40.961067 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.961039 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 14:44:40.961534 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.961514 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 14:44:40.961768 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.961753 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 14:44:40.962839 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.962817 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gw4np\"" Jun 02 14:44:40.963072 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.963055 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 14:44:40.963220 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.963200 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 14:44:40.964199 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.963277 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 14:44:40.964199 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.963361 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 14:44:40.964199 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.963683 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 14:44:40.966462 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966445 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-sysconfig\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.966557 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f958cf4-1e44-4c9a-8dcd-1fec1aa04671-serviceca\") pod \"node-ca-7987p\" (UID: \"8f958cf4-1e44-4c9a-8dcd-1fec1aa04671\") " pod="openshift-image-registry/node-ca-7987p" Jun 02 14:44:40.966557 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966507 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-cni-binary-copy\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.966557 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-run-k8s-cni-cncf-io\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.966684 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-daemon-config\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.966684 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966617 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-cnibin\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.966684 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966642 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-registration-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:40.966684 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-tuned\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.966684 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966684 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40a50a59-49da-4034-af9a-15a13dd4084d-agent-certs\") pod \"konnectivity-agent-wn6xc\" (UID: \"40a50a59-49da-4034-af9a-15a13dd4084d\") " pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:44:40.966883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966715 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b54104a8-2be1-44c9-bed2-d8fbafd191f5-host-slash\") pod \"iptables-alerter-8qq9p\" (UID: \"b54104a8-2be1-44c9-bed2-d8fbafd191f5\") " pod="openshift-network-operator/iptables-alerter-8qq9p" Jun 02 14:44:40.966883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16039595-d233-421f-a7ac-dc51ff2b230a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:40.966883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966801 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:40.966883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:40.966883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-systemd\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.966883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966870 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-socket-dir-parent\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.967081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m24fp\" (UniqueName: \"kubernetes.io/projected/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-kube-api-access-m24fp\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.967081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966920 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16039595-d233-421f-a7ac-dc51ff2b230a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:40.967081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-device-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:40.967081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966951 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-host\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.967081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.966982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-run-netns\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.967081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-var-lib-kubelet\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.967081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10109fca-6b44-4d66-8efd-269151775e41-hosts-file\") pod \"node-resolver-k6sqt\" (UID: \"10109fca-6b44-4d66-8efd-269151775e41\") " pod="openshift-dns/node-resolver-k6sqt" Jun 02 14:44:40.967081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10109fca-6b44-4d66-8efd-269151775e41-tmp-dir\") pod \"node-resolver-k6sqt\" (UID: \"10109fca-6b44-4d66-8efd-269151775e41\") " pod="openshift-dns/node-resolver-k6sqt" Jun 02 14:44:40.967081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967051 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ggqz\" (UniqueName: \"kubernetes.io/projected/77654ab6-6b10-4650-8a14-0001fcd9eb85-kube-api-access-8ggqz\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:40.967081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6cqp\" (UniqueName: \"kubernetes.io/projected/662bb68f-e9d1-42ba-865e-07085a1e8ba0-kube-api-access-g6cqp\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967096 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-sys-fs\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-hostroot\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-conf-dir\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-os-release\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgmq8\" (UniqueName: \"kubernetes.io/projected/068d069e-b79f-4012-a06a-e54f48e699b9-kube-api-access-sgmq8\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/662bb68f-e9d1-42ba-865e-07085a1e8ba0-tmp\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-var-lib-cni-bin\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-system-cni-dir\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxmp4\" (UniqueName: \"kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4\") pod \"network-check-target-f4q6p\" (UID: \"276ea801-82c9-4207-bc13-1bd3174c4629\") " pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-kubernetes\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-lib-modules\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-system-cni-dir\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967327 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-var-lib-cni-multus\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967358 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-etc-kubernetes\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.967504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967372 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-socket-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbtpd\" (UniqueName: \"kubernetes.io/projected/8f958cf4-1e44-4c9a-8dcd-1fec1aa04671-kube-api-access-cbtpd\") pod \"node-ca-7987p\" (UID: \"8f958cf4-1e44-4c9a-8dcd-1fec1aa04671\") " pod="openshift-image-registry/node-ca-7987p" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-run\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-var-lib-kubelet\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40a50a59-49da-4034-af9a-15a13dd4084d-konnectivity-ca\") pod \"konnectivity-agent-wn6xc\" (UID: \"40a50a59-49da-4034-af9a-15a13dd4084d\") " pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967496 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-cni-dir\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-os-release\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16039595-d233-421f-a7ac-dc51ff2b230a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-cnibin\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk2rd\" (UniqueName: \"kubernetes.io/projected/b54104a8-2be1-44c9-bed2-d8fbafd191f5-kube-api-access-xk2rd\") pod \"iptables-alerter-8qq9p\" (UID: \"b54104a8-2be1-44c9-bed2-d8fbafd191f5\") " pod="openshift-network-operator/iptables-alerter-8qq9p" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967635 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-sysctl-conf\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-sys\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md97p\" (UniqueName: \"kubernetes.io/projected/16039595-d233-421f-a7ac-dc51ff2b230a-kube-api-access-md97p\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f958cf4-1e44-4c9a-8dcd-1fec1aa04671-host\") pod \"node-ca-7987p\" (UID: \"8f958cf4-1e44-4c9a-8dcd-1fec1aa04671\") " pod="openshift-image-registry/node-ca-7987p" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967739 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-sysctl-d\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:40.968231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-run-multus-certs\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:40.968992 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967778 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7f2w\" (UniqueName: \"kubernetes.io/projected/10109fca-6b44-4d66-8efd-269151775e41-kube-api-access-v7f2w\") pod \"node-resolver-k6sqt\" (UID: \"10109fca-6b44-4d66-8efd-269151775e41\") " pod="openshift-dns/node-resolver-k6sqt" Jun 02 14:44:40.968992 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b54104a8-2be1-44c9-bed2-d8fbafd191f5-iptables-alerter-script\") pod \"iptables-alerter-8qq9p\" (UID: \"b54104a8-2be1-44c9-bed2-d8fbafd191f5\") " pod="openshift-network-operator/iptables-alerter-8qq9p" Jun 02 14:44:40.968992 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:40.967806 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-modprobe-d\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.002928 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.002861 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 14:39:39 +0000 UTC" deadline="2028-01-14 02:56:49.766320279 +0000 UTC" Jun 02 14:44:41.002928 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.002892 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14172h12m8.763432347s" Jun 02 14:44:41.057190 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.057166 2564 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 14:44:41.068316 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068272 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-system-cni-dir\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.068316 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068315 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-var-lib-cni-multus\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.068523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068339 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.068523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97cfdf33-ab98-4e07-a458-a3266fac0eb5-ovnkube-config\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.068523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068375 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-system-cni-dir\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.068523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmm2b\" (UniqueName: \"kubernetes.io/projected/97cfdf33-ab98-4e07-a458-a3266fac0eb5-kube-api-access-jmm2b\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.068523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068427 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-etc-kubernetes\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.068523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068454 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-socket-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.068523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068454 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-var-lib-cni-multus\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.068523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068504 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-etc-kubernetes\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.068523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068512 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.068523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068519 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbtpd\" (UniqueName: \"kubernetes.io/projected/8f958cf4-1e44-4c9a-8dcd-1fec1aa04671-kube-api-access-cbtpd\") pod \"node-ca-7987p\" (UID: \"8f958cf4-1e44-4c9a-8dcd-1fec1aa04671\") " pod="openshift-image-registry/node-ca-7987p" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-var-lib-openvswitch\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068571 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-socket-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068575 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-run\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068610 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-var-lib-kubelet\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068619 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-run\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068641 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40a50a59-49da-4034-af9a-15a13dd4084d-konnectivity-ca\") pod \"konnectivity-agent-wn6xc\" (UID: \"40a50a59-49da-4034-af9a-15a13dd4084d\") " pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068678 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-cni-dir\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068692 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-var-lib-kubelet\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068702 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-os-release\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068734 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16039595-d233-421f-a7ac-dc51ff2b230a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068748 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-cni-dir\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068754 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-os-release\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068763 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-cnibin\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068790 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xk2rd\" (UniqueName: \"kubernetes.io/projected/b54104a8-2be1-44c9-bed2-d8fbafd191f5-kube-api-access-xk2rd\") pod \"iptables-alerter-8qq9p\" (UID: \"b54104a8-2be1-44c9-bed2-d8fbafd191f5\") " pod="openshift-network-operator/iptables-alerter-8qq9p" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068815 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068793 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-cnibin\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.068996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97cfdf33-ab98-4e07-a458-a3266fac0eb5-ovnkube-script-lib\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068889 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-sysctl-conf\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068912 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-sys\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.068923 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068938 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-md97p\" (UniqueName: \"kubernetes.io/projected/16039595-d233-421f-a7ac-dc51ff2b230a-kube-api-access-md97p\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.068961 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f958cf4-1e44-4c9a-8dcd-1fec1aa04671-host\") pod \"node-ca-7987p\" (UID: \"8f958cf4-1e44-4c9a-8dcd-1fec1aa04671\") " pod="openshift-image-registry/node-ca-7987p" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069014 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f958cf4-1e44-4c9a-8dcd-1fec1aa04671-host\") pod \"node-ca-7987p\" (UID: \"8f958cf4-1e44-4c9a-8dcd-1fec1aa04671\") " pod="openshift-image-registry/node-ca-7987p" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.069057 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs podName:77654ab6-6b10-4650-8a14-0001fcd9eb85 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:41.568977893 +0000 UTC m=+3.076880525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs") pod "network-metrics-daemon-2p9gp" (UID: "77654ab6-6b10-4650-8a14-0001fcd9eb85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069068 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-sysctl-conf\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069096 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40a50a59-49da-4034-af9a-15a13dd4084d-konnectivity-ca\") pod \"konnectivity-agent-wn6xc\" (UID: \"40a50a59-49da-4034-af9a-15a13dd4084d\") " pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069121 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-sys\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069323 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16039595-d233-421f-a7ac-dc51ff2b230a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-systemd-units\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069589 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-node-log\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-cni-netd\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069634 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-sysctl-d\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.069804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069660 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-run-multus-certs\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069683 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7f2w\" (UniqueName: \"kubernetes.io/projected/10109fca-6b44-4d66-8efd-269151775e41-kube-api-access-v7f2w\") pod \"node-resolver-k6sqt\" (UID: \"10109fca-6b44-4d66-8efd-269151775e41\") " pod="openshift-dns/node-resolver-k6sqt" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069703 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b54104a8-2be1-44c9-bed2-d8fbafd191f5-iptables-alerter-script\") pod \"iptables-alerter-8qq9p\" (UID: \"b54104a8-2be1-44c9-bed2-d8fbafd191f5\") " pod="openshift-network-operator/iptables-alerter-8qq9p" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069722 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-modprobe-d\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069741 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-sysconfig\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069751 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-run-multus-certs\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069772 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f958cf4-1e44-4c9a-8dcd-1fec1aa04671-serviceca\") pod \"node-ca-7987p\" (UID: \"8f958cf4-1e44-4c9a-8dcd-1fec1aa04671\") " pod="openshift-image-registry/node-ca-7987p" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069780 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-sysctl-d\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069788 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-sysconfig\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069843 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-modprobe-d\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069866 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-cni-binary-copy\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069913 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-run-k8s-cni-cncf-io\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069942 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-daemon-config\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069967 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-kubelet\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.069981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-run-k8s-cni-cncf-io\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070055 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-run-ovn\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070087 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-cnibin\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.070662 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070111 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-registration-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-slash\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070167 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-registration-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070185 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f958cf4-1e44-4c9a-8dcd-1fec1aa04671-serviceca\") pod \"node-ca-7987p\" (UID: \"8f958cf4-1e44-4c9a-8dcd-1fec1aa04671\") " pod="openshift-image-registry/node-ca-7987p" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-log-socket\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070222 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-tuned\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070223 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-cnibin\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070252 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40a50a59-49da-4034-af9a-15a13dd4084d-agent-certs\") pod \"konnectivity-agent-wn6xc\" (UID: \"40a50a59-49da-4034-af9a-15a13dd4084d\") " pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070285 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b54104a8-2be1-44c9-bed2-d8fbafd191f5-iptables-alerter-script\") pod \"iptables-alerter-8qq9p\" (UID: \"b54104a8-2be1-44c9-bed2-d8fbafd191f5\") " pod="openshift-network-operator/iptables-alerter-8qq9p" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070320 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b54104a8-2be1-44c9-bed2-d8fbafd191f5-host-slash\") pod \"iptables-alerter-8qq9p\" (UID: \"b54104a8-2be1-44c9-bed2-d8fbafd191f5\") " pod="openshift-network-operator/iptables-alerter-8qq9p" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070348 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b54104a8-2be1-44c9-bed2-d8fbafd191f5-host-slash\") pod \"iptables-alerter-8qq9p\" (UID: \"b54104a8-2be1-44c9-bed2-d8fbafd191f5\") " pod="openshift-network-operator/iptables-alerter-8qq9p" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070349 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-etc-openvswitch\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070382 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-run-openvswitch\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070406 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16039595-d233-421f-a7ac-dc51ff2b230a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070425 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070470 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-cni-binary-copy\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070480 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.071450 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070506 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-systemd\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070528 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-socket-dir-parent\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070536 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070551 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m24fp\" (UniqueName: \"kubernetes.io/projected/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-kube-api-access-m24fp\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070554 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070577 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16039595-d233-421f-a7ac-dc51ff2b230a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070582 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-systemd\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070589 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-daemon-config\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070602 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-device-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070594 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070632 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-socket-dir-parent\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070633 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070660 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-host\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070660 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-device-dir\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070692 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-run-netns\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070736 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-host\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070767 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-var-lib-kubelet\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070794 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10109fca-6b44-4d66-8efd-269151775e41-hosts-file\") pod \"node-resolver-k6sqt\" (UID: \"10109fca-6b44-4d66-8efd-269151775e41\") " pod="openshift-dns/node-resolver-k6sqt" Jun 02 14:44:41.072227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070808 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-var-lib-kubelet\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070818 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10109fca-6b44-4d66-8efd-269151775e41-tmp-dir\") pod \"node-resolver-k6sqt\" (UID: \"10109fca-6b44-4d66-8efd-269151775e41\") " pod="openshift-dns/node-resolver-k6sqt" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070842 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ggqz\" (UniqueName: \"kubernetes.io/projected/77654ab6-6b10-4650-8a14-0001fcd9eb85-kube-api-access-8ggqz\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070853 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10109fca-6b44-4d66-8efd-269151775e41-hosts-file\") pod \"node-resolver-k6sqt\" (UID: \"10109fca-6b44-4d66-8efd-269151775e41\") " pod="openshift-dns/node-resolver-k6sqt" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070771 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-run-netns\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070866 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6cqp\" (UniqueName: \"kubernetes.io/projected/662bb68f-e9d1-42ba-865e-07085a1e8ba0-kube-api-access-g6cqp\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.070863 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16039595-d233-421f-a7ac-dc51ff2b230a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071015 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-sys-fs\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071043 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-run-systemd\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071044 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16039595-d233-421f-a7ac-dc51ff2b230a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071070 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-hostroot\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071097 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-conf-dir\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071104 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10109fca-6b44-4d66-8efd-269151775e41-tmp-dir\") pod \"node-resolver-k6sqt\" (UID: \"10109fca-6b44-4d66-8efd-269151775e41\") " pod="openshift-dns/node-resolver-k6sqt" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071123 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-os-release\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071147 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgmq8\" (UniqueName: \"kubernetes.io/projected/068d069e-b79f-4012-a06a-e54f48e699b9-kube-api-access-sgmq8\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071162 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/068d069e-b79f-4012-a06a-e54f48e699b9-sys-fs\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071169 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-hostroot\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.073090 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071173 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-run-netns\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-multus-conf-dir\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071228 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-os-release\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071263 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/662bb68f-e9d1-42ba-865e-07085a1e8ba0-tmp\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071291 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-var-lib-cni-bin\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071332 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-system-cni-dir\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071355 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-host-var-lib-cni-bin\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071359 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxmp4\" (UniqueName: \"kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4\") pod \"network-check-target-f4q6p\" (UID: \"276ea801-82c9-4207-bc13-1bd3174c4629\") " pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-cni-bin\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071441 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97cfdf33-ab98-4e07-a458-a3266fac0eb5-env-overrides\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071417 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16039595-d233-421f-a7ac-dc51ff2b230a-system-cni-dir\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071459 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97cfdf33-ab98-4e07-a458-a3266fac0eb5-ovn-node-metrics-cert\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071541 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-kubernetes\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071565 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-lib-modules\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071615 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-kubernetes\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.071706 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/662bb68f-e9d1-42ba-865e-07085a1e8ba0-lib-modules\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.073549 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/662bb68f-e9d1-42ba-865e-07085a1e8ba0-tmp\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.073944 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.073563 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/662bb68f-e9d1-42ba-865e-07085a1e8ba0-etc-tuned\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.074617 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.073767 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40a50a59-49da-4034-af9a-15a13dd4084d-agent-certs\") pod \"konnectivity-agent-wn6xc\" (UID: \"40a50a59-49da-4034-af9a-15a13dd4084d\") " pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:44:41.079417 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.079390 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:44:41.079544 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.079451 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:44:41.079544 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.079466 2564 projected.go:194] Error preparing data for projected volume kube-api-access-jxmp4 for pod openshift-network-diagnostics/network-check-target-f4q6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:41.079544 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.079526 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4 podName:276ea801-82c9-4207-bc13-1bd3174c4629 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:41.579509334 +0000 UTC m=+3.087411973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jxmp4" (UniqueName: "kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4") pod "network-check-target-f4q6p" (UID: "276ea801-82c9-4207-bc13-1bd3174c4629") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:41.080861 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.080524 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbtpd\" (UniqueName: \"kubernetes.io/projected/8f958cf4-1e44-4c9a-8dcd-1fec1aa04671-kube-api-access-cbtpd\") pod \"node-ca-7987p\" (UID: \"8f958cf4-1e44-4c9a-8dcd-1fec1aa04671\") " pod="openshift-image-registry/node-ca-7987p" Jun 02 14:44:41.080978 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.080921 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7f2w\" (UniqueName: \"kubernetes.io/projected/10109fca-6b44-4d66-8efd-269151775e41-kube-api-access-v7f2w\") pod \"node-resolver-k6sqt\" (UID: \"10109fca-6b44-4d66-8efd-269151775e41\") " pod="openshift-dns/node-resolver-k6sqt" Jun 02 14:44:41.082205 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.082179 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m24fp\" (UniqueName: \"kubernetes.io/projected/bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c-kube-api-access-m24fp\") pod \"multus-b68xm\" (UID: \"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c\") " pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.083292 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.083244 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6cqp\" (UniqueName: \"kubernetes.io/projected/662bb68f-e9d1-42ba-865e-07085a1e8ba0-kube-api-access-g6cqp\") pod \"tuned-rthgk\" (UID: \"662bb68f-e9d1-42ba-865e-07085a1e8ba0\") " pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.083637 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.083600 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ggqz\" (UniqueName: \"kubernetes.io/projected/77654ab6-6b10-4650-8a14-0001fcd9eb85-kube-api-access-8ggqz\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:41.084504 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.084487 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgmq8\" (UniqueName: \"kubernetes.io/projected/068d069e-b79f-4012-a06a-e54f48e699b9-kube-api-access-sgmq8\") pod \"aws-ebs-csi-driver-node-hbcvr\" (UID: \"068d069e-b79f-4012-a06a-e54f48e699b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.085014 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.084990 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md97p\" (UniqueName: \"kubernetes.io/projected/16039595-d233-421f-a7ac-dc51ff2b230a-kube-api-access-md97p\") pod \"multus-additional-cni-plugins-8vp9n\" (UID: \"16039595-d233-421f-a7ac-dc51ff2b230a\") " pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.085604 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.085581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk2rd\" (UniqueName: \"kubernetes.io/projected/b54104a8-2be1-44c9-bed2-d8fbafd191f5-kube-api-access-xk2rd\") pod \"iptables-alerter-8qq9p\" (UID: \"b54104a8-2be1-44c9-bed2-d8fbafd191f5\") " pod="openshift-network-operator/iptables-alerter-8qq9p" Jun 02 14:44:41.111221 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.111201 2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:44:41.172641 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.172596 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.172764 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.172649 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-run-systemd\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.172764 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.172726 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.172860 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.172777 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-run-systemd\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.172860 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.172806 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-run-netns\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.172860 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.172850 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-cni-bin\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.172994 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.172872 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97cfdf33-ab98-4e07-a458-a3266fac0eb5-env-overrides\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.172994 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.172897 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97cfdf33-ab98-4e07-a458-a3266fac0eb5-ovn-node-metrics-cert\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.172994 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.172926 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-cni-bin\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173126 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.172987 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-run-netns\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173126 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173023 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97cfdf33-ab98-4e07-a458-a3266fac0eb5-ovnkube-config\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173208 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173186 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmm2b\" (UniqueName: \"kubernetes.io/projected/97cfdf33-ab98-4e07-a458-a3266fac0eb5-kube-api-access-jmm2b\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173255 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173223 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-var-lib-openvswitch\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173269 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173292 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97cfdf33-ab98-4e07-a458-a3266fac0eb5-ovnkube-script-lib\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173340 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-systemd-units\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173366 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-node-log\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173379 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-var-lib-openvswitch\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173387 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-cni-netd\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173411 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-cni-netd\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173448 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-kubelet\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173468 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-run-ovn\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173485 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-slash\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173502 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-log-socket\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173528 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-etc-openvswitch\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173531 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97cfdf33-ab98-4e07-a458-a3266fac0eb5-env-overrides\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173544 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173551 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-run-openvswitch\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173587 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-run-openvswitch\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173615 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-systemd-units\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.173880 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173619 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-node-log\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.174846 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173622 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-kubelet\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.174846 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173587 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-run-ovn\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.174846 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-host-slash\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.174846 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173662 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-log-socket\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.174846 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173662 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97cfdf33-ab98-4e07-a458-a3266fac0eb5-etc-openvswitch\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.174846 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.173856 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97cfdf33-ab98-4e07-a458-a3266fac0eb5-ovnkube-script-lib\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.174846 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.174090 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97cfdf33-ab98-4e07-a458-a3266fac0eb5-ovnkube-config\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.175686 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.175669 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97cfdf33-ab98-4e07-a458-a3266fac0eb5-ovn-node-metrics-cert\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.181993 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.181972 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmm2b\" (UniqueName: \"kubernetes.io/projected/97cfdf33-ab98-4e07-a458-a3266fac0eb5-kube-api-access-jmm2b\") pod \"ovnkube-node-hjh6n\" (UID: \"97cfdf33-ab98-4e07-a458-a3266fac0eb5\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.259110 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.259040 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rthgk" Jun 02 14:44:41.268836 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.268806 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k6sqt" Jun 02 14:44:41.274609 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.274580 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:44:41.280165 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.280144 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" Jun 02 14:44:41.286181 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.286164 2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:44:41.287327 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.287297 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" Jun 02 14:44:41.294369 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.294351 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7987p" Jun 02 14:44:41.303909 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.303891 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8qq9p" Jun 02 14:44:41.311472 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.311456 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b68xm" Jun 02 14:44:41.316056 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.316037 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:44:41.544879 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:41.544747 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a50a59_49da_4034_af9a_15a13dd4084d.slice/crio-e9b4f1730767c3ed225ffa4df23ed7d4494c27dc6bed031827f9a68a43fb94f3 WatchSource:0}: Error finding container e9b4f1730767c3ed225ffa4df23ed7d4494c27dc6bed031827f9a68a43fb94f3: Status 404 returned error can't find the container with id e9b4f1730767c3ed225ffa4df23ed7d4494c27dc6bed031827f9a68a43fb94f3 Jun 02 14:44:41.548124 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:41.548100 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54104a8_2be1_44c9_bed2_d8fbafd191f5.slice/crio-cec16c463db4722743fd013075d22d0ba800b46322bc792adbcf47bb5f5f55e3 WatchSource:0}: Error finding container cec16c463db4722743fd013075d22d0ba800b46322bc792adbcf47bb5f5f55e3: Status 404 returned error can't find the container with id cec16c463db4722743fd013075d22d0ba800b46322bc792adbcf47bb5f5f55e3 Jun 02 14:44:41.549679 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:41.549654 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662bb68f_e9d1_42ba_865e_07085a1e8ba0.slice/crio-a6bd10712a0c0b5ff570040e54c2ba79f556805f053fe6750e21873e14103dc8 WatchSource:0}: Error finding container a6bd10712a0c0b5ff570040e54c2ba79f556805f053fe6750e21873e14103dc8: Status 404 returned error can't find the container with id a6bd10712a0c0b5ff570040e54c2ba79f556805f053fe6750e21873e14103dc8 Jun 02 14:44:41.550805 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:41.550771 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f958cf4_1e44_4c9a_8dcd_1fec1aa04671.slice/crio-58f8bf99e59b4d0521c1a887d6674e6b706076d9e954a4b9525367c8452feafa WatchSource:0}: Error finding container 58f8bf99e59b4d0521c1a887d6674e6b706076d9e954a4b9525367c8452feafa: Status 404 returned error can't find the container with id 58f8bf99e59b4d0521c1a887d6674e6b706076d9e954a4b9525367c8452feafa Jun 02 14:44:41.551817 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:41.551784 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97cfdf33_ab98_4e07_a458_a3266fac0eb5.slice/crio-81d2fe0b7b4f95537db15e26d7b2166679448501d8db6be338118750d9cbb5e9 WatchSource:0}: Error finding container 81d2fe0b7b4f95537db15e26d7b2166679448501d8db6be338118750d9cbb5e9: Status 404 returned error can't find the container with id 81d2fe0b7b4f95537db15e26d7b2166679448501d8db6be338118750d9cbb5e9 Jun 02 14:44:41.552209 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:41.552132 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc3d843_a7f0_40fa_9142_ce5f5a06aa9c.slice/crio-ecb82092e570adee0b4417fc77c75e161a0661f68cfbfc37f96c7ef0812e4f36 WatchSource:0}: Error finding container ecb82092e570adee0b4417fc77c75e161a0661f68cfbfc37f96c7ef0812e4f36: Status 404 returned error can't find the container with id ecb82092e570adee0b4417fc77c75e161a0661f68cfbfc37f96c7ef0812e4f36 Jun 02 14:44:41.553754 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:41.553384 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16039595_d233_421f_a7ac_dc51ff2b230a.slice/crio-642e99b0ebc1ef69b038606f6eaa4d102e5334089c01688a7e08b74dcaf622ef WatchSource:0}: Error finding container 642e99b0ebc1ef69b038606f6eaa4d102e5334089c01688a7e08b74dcaf622ef: Status 404 returned error can't find the container with id 642e99b0ebc1ef69b038606f6eaa4d102e5334089c01688a7e08b74dcaf622ef Jun 02 14:44:41.554202 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:41.553901 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068d069e_b79f_4012_a06a_e54f48e699b9.slice/crio-6a23a4e8f4f9e06a7ae806963eae315e4a17a08dd6355b45bd3ec24f65994600 WatchSource:0}: Error finding container 6a23a4e8f4f9e06a7ae806963eae315e4a17a08dd6355b45bd3ec24f65994600: Status 404 returned error can't find the container with id 6a23a4e8f4f9e06a7ae806963eae315e4a17a08dd6355b45bd3ec24f65994600 Jun 02 14:44:41.554809 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:44:41.554792 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10109fca_6b44_4d66_8efd_269151775e41.slice/crio-d46dedee33290e0f8ac001eeb34cafe1d59f9b9b24f8e42ff1011c927939e088 WatchSource:0}: Error finding container d46dedee33290e0f8ac001eeb34cafe1d59f9b9b24f8e42ff1011c927939e088: Status 404 returned error can't find the container with id d46dedee33290e0f8ac001eeb34cafe1d59f9b9b24f8e42ff1011c927939e088 Jun 02 14:44:41.577178 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.577016 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:41.577235 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.577161 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:41.577267 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.577244 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs podName:77654ab6-6b10-4650-8a14-0001fcd9eb85 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:42.577229708 +0000 UTC m=+4.085132326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs") pod "network-metrics-daemon-2p9gp" (UID: "77654ab6-6b10-4650-8a14-0001fcd9eb85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:41.677791 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:41.677756 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxmp4\" (UniqueName: \"kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4\") pod \"network-check-target-f4q6p\" (UID: \"276ea801-82c9-4207-bc13-1bd3174c4629\") " pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:41.677958 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.677866 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:44:41.677958 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.677879 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:44:41.677958 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.677890 2564 projected.go:194] Error preparing data for projected volume kube-api-access-jxmp4 for pod openshift-network-diagnostics/network-check-target-f4q6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:41.677958 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:41.677937 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4 podName:276ea801-82c9-4207-bc13-1bd3174c4629 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:42.677922629 +0000 UTC m=+4.185825247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxmp4" (UniqueName: "kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4") pod "network-check-target-f4q6p" (UID: "276ea801-82c9-4207-bc13-1bd3174c4629") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:42.003622 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.003558 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 14:39:39 +0000 UTC" deadline="2028-03-03 18:31:01.90342946 +0000 UTC" Jun 02 14:44:42.003622 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.003597 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15363h46m19.89983705s" Jun 02 14:44:42.081494 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.080944 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:42.081494 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:42.081077 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:44:42.097386 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.097348 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-192.ec2.internal" event={"ID":"3b2ad47d5e6987ad43e3dd52c6b00aa3","Type":"ContainerStarted","Data":"25a131c94c64b6a0a3e9571de2dd0e1b2f7a181c109a8b00f3963c86cb9ca4a8"} Jun 02 14:44:42.114432 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.113861 2564 generic.go:358] "Generic (PLEG): container finished" podID="612917a73c36c7ecd731f78efad6f442" containerID="ee745ef8c78af0480306cba4bb9867365396688e42409652c557a7a81c31d20d" exitCode=0 Jun 02 14:44:42.114432 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.113952 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" event={"ID":"612917a73c36c7ecd731f78efad6f442","Type":"ContainerDied","Data":"ee745ef8c78af0480306cba4bb9867365396688e42409652c557a7a81c31d20d"} Jun 02 14:44:42.126113 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.126082 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k6sqt" event={"ID":"10109fca-6b44-4d66-8efd-269151775e41","Type":"ContainerStarted","Data":"d46dedee33290e0f8ac001eeb34cafe1d59f9b9b24f8e42ff1011c927939e088"} Jun 02 14:44:42.129013 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.127926 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-192.ec2.internal" podStartSLOduration=2.127910283 podStartE2EDuration="2.127910283s" podCreationTimestamp="2026-06-02 14:44:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 14:44:42.116049833 +0000 UTC m=+3.623952475" watchObservedRunningTime="2026-06-02 14:44:42.127910283 +0000 UTC m=+3.635812925" Jun 02 14:44:42.143714 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.143681 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" event={"ID":"068d069e-b79f-4012-a06a-e54f48e699b9","Type":"ContainerStarted","Data":"6a23a4e8f4f9e06a7ae806963eae315e4a17a08dd6355b45bd3ec24f65994600"} Jun 02 14:44:42.153103 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.153045 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rthgk" event={"ID":"662bb68f-e9d1-42ba-865e-07085a1e8ba0","Type":"ContainerStarted","Data":"a6bd10712a0c0b5ff570040e54c2ba79f556805f053fe6750e21873e14103dc8"} Jun 02 14:44:42.158801 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.158727 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" event={"ID":"16039595-d233-421f-a7ac-dc51ff2b230a","Type":"ContainerStarted","Data":"642e99b0ebc1ef69b038606f6eaa4d102e5334089c01688a7e08b74dcaf622ef"} Jun 02 14:44:42.176027 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.175990 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8qq9p" event={"ID":"b54104a8-2be1-44c9-bed2-d8fbafd191f5","Type":"ContainerStarted","Data":"cec16c463db4722743fd013075d22d0ba800b46322bc792adbcf47bb5f5f55e3"} Jun 02 14:44:42.201580 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.201490 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b68xm" event={"ID":"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c","Type":"ContainerStarted","Data":"ecb82092e570adee0b4417fc77c75e161a0661f68cfbfc37f96c7ef0812e4f36"} Jun 02 14:44:42.216247 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.216184 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" event={"ID":"97cfdf33-ab98-4e07-a458-a3266fac0eb5","Type":"ContainerStarted","Data":"81d2fe0b7b4f95537db15e26d7b2166679448501d8db6be338118750d9cbb5e9"} Jun 02 14:44:42.227436 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.227399 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7987p" event={"ID":"8f958cf4-1e44-4c9a-8dcd-1fec1aa04671","Type":"ContainerStarted","Data":"58f8bf99e59b4d0521c1a887d6674e6b706076d9e954a4b9525367c8452feafa"} Jun 02 14:44:42.232043 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.232013 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wn6xc" event={"ID":"40a50a59-49da-4034-af9a-15a13dd4084d","Type":"ContainerStarted","Data":"e9b4f1730767c3ed225ffa4df23ed7d4494c27dc6bed031827f9a68a43fb94f3"} Jun 02 14:44:42.585683 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.585642 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:42.585872 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:42.585855 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:42.585977 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:42.585926 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs podName:77654ab6-6b10-4650-8a14-0001fcd9eb85 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:44.585906972 +0000 UTC m=+6.093809597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs") pod "network-metrics-daemon-2p9gp" (UID: "77654ab6-6b10-4650-8a14-0001fcd9eb85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:42.687018 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:42.686945 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxmp4\" (UniqueName: \"kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4\") pod \"network-check-target-f4q6p\" (UID: \"276ea801-82c9-4207-bc13-1bd3174c4629\") " pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:42.687199 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:42.687132 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:44:42.687199 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:42.687150 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:44:42.687199 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:42.687162 2564 projected.go:194] Error preparing data for projected volume kube-api-access-jxmp4 for pod openshift-network-diagnostics/network-check-target-f4q6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:42.687374 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:42.687222 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4 podName:276ea801-82c9-4207-bc13-1bd3174c4629 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:44.687203687 +0000 UTC m=+6.195106322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxmp4" (UniqueName: "kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4") pod "network-check-target-f4q6p" (UID: "276ea801-82c9-4207-bc13-1bd3174c4629") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:43.081548 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:43.081464 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:43.081991 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:43.081602 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:44:43.254975 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:43.254914 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" event={"ID":"612917a73c36c7ecd731f78efad6f442","Type":"ContainerStarted","Data":"53f14591f8569920c31035435e729aba92ed617ec7ebcfe640f95f033ffe3fdd"} Jun 02 14:44:44.080751 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:44.080715 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:44.080948 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:44.080865 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:44:44.604949 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:44.604909 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:44.605414 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:44.605095 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:44.605414 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:44.605174 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs podName:77654ab6-6b10-4650-8a14-0001fcd9eb85 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:48.605150667 +0000 UTC m=+10.113053297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs") pod "network-metrics-daemon-2p9gp" (UID: "77654ab6-6b10-4650-8a14-0001fcd9eb85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:44.705622 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:44.705583 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxmp4\" (UniqueName: \"kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4\") pod \"network-check-target-f4q6p\" (UID: \"276ea801-82c9-4207-bc13-1bd3174c4629\") " pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:44.705811 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:44.705789 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:44:44.705811 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:44.705813 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:44:44.705940 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:44.705825 2564 projected.go:194] Error preparing data for projected volume kube-api-access-jxmp4 for pod openshift-network-diagnostics/network-check-target-f4q6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:44.705940 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:44.705884 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4 podName:276ea801-82c9-4207-bc13-1bd3174c4629 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:48.705864127 +0000 UTC m=+10.213766751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxmp4" (UniqueName: "kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4") pod "network-check-target-f4q6p" (UID: "276ea801-82c9-4207-bc13-1bd3174c4629") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:45.082155 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:45.082121 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:45.082296 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:45.082237 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:44:46.080595 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:46.080073 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:46.080595 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:46.080213 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:44:47.080796 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:47.080752 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:47.081284 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:47.080883 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:44:48.080476 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:48.080441 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:48.080879 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:48.080590 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:44:48.645282 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:48.645240 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:48.645520 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:48.645426 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:48.645520 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:48.645490 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs podName:77654ab6-6b10-4650-8a14-0001fcd9eb85 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:56.645471536 +0000 UTC m=+18.153374168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs") pod "network-metrics-daemon-2p9gp" (UID: "77654ab6-6b10-4650-8a14-0001fcd9eb85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:48.746131 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:48.745577 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxmp4\" (UniqueName: \"kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4\") pod \"network-check-target-f4q6p\" (UID: \"276ea801-82c9-4207-bc13-1bd3174c4629\") " pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:48.746131 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:48.745761 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:44:48.746131 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:48.745782 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:44:48.746131 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:48.745793 2564 projected.go:194] Error preparing data for projected volume kube-api-access-jxmp4 for pod openshift-network-diagnostics/network-check-target-f4q6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:48.746131 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:48.745848 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4 podName:276ea801-82c9-4207-bc13-1bd3174c4629 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:56.745831201 +0000 UTC m=+18.253733839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxmp4" (UniqueName: "kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4") pod "network-check-target-f4q6p" (UID: "276ea801-82c9-4207-bc13-1bd3174c4629") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:49.080731 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:49.080696 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:49.080910 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:49.080779 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:44:50.081022 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:50.080590 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:50.081022 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:50.080725 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:44:51.079991 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:51.079957 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:51.080177 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:51.080073 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:44:52.080861 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:52.080772 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:52.081269 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:52.080927 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:44:53.080774 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:53.080737 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:53.080940 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:53.080856 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:44:54.080076 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:54.080039 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:54.080241 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:54.080198 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:44:55.080208 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:55.080172 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:55.080677 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:55.080329 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:44:56.080567 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.080537 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:56.080927 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:56.080647 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:44:56.500078 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.500041 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-192.ec2.internal" podStartSLOduration=16.500028167 podStartE2EDuration="16.500028167s" podCreationTimestamp="2026-06-02 14:44:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 14:44:43.268802916 +0000 UTC m=+4.776705571" watchObservedRunningTime="2026-06-02 14:44:56.500028167 +0000 UTC m=+18.007930807" Jun 02 14:44:56.500590 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.500575 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-cqkg2"] Jun 02 14:44:56.515423 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.515404 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:56.515492 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:56.515475 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqkg2" podUID="8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2" Jun 02 14:44:56.606146 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.606104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:56.606345 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.606179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-kubelet-config\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:56.606345 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.606205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-dbus\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:56.707228 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.707192 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-kubelet-config\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:56.707401 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.707235 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-dbus\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:56.707401 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.707322 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:56.707401 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.707337 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-kubelet-config\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:56.707401 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.707357 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:56.707518 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:56.707449 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:56.707518 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:56.707449 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 14:44:56.707518 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.707464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-dbus\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:56.707518 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:56.707510 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs podName:77654ab6-6b10-4650-8a14-0001fcd9eb85 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:12.707493178 +0000 UTC m=+34.215395797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs") pod "network-metrics-daemon-2p9gp" (UID: "77654ab6-6b10-4650-8a14-0001fcd9eb85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:44:56.707670 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:56.707524 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret podName:8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:57.207517691 +0000 UTC m=+18.715420310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret") pod "global-pull-secret-syncer-cqkg2" (UID: "8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2") : object "kube-system"/"original-pull-secret" not registered Jun 02 14:44:56.808740 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:56.808653 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxmp4\" (UniqueName: \"kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4\") pod \"network-check-target-f4q6p\" (UID: \"276ea801-82c9-4207-bc13-1bd3174c4629\") " pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:56.808904 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:56.808835 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:44:56.808904 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:56.808861 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:44:56.808904 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:56.808875 2564 projected.go:194] Error preparing data for projected volume kube-api-access-jxmp4 for pod openshift-network-diagnostics/network-check-target-f4q6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:56.809012 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:56.808942 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4 podName:276ea801-82c9-4207-bc13-1bd3174c4629 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:12.808922847 +0000 UTC m=+34.316825468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxmp4" (UniqueName: "kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4") pod "network-check-target-f4q6p" (UID: "276ea801-82c9-4207-bc13-1bd3174c4629") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:44:57.080267 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:57.080189 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:57.080456 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:57.080326 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:44:57.212128 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:57.212084 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:57.212589 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:57.212285 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 14:44:57.212589 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:57.212378 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret podName:8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2 nodeName:}" failed. No retries permitted until 2026-06-02 14:44:58.212357004 +0000 UTC m=+19.720259625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret") pod "global-pull-secret-syncer-cqkg2" (UID: "8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2") : object "kube-system"/"original-pull-secret" not registered Jun 02 14:44:58.080653 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:58.080605 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:58.080847 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:58.080747 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqkg2" podUID="8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2" Jun 02 14:44:58.080847 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:58.080804 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:44:58.080965 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:58.080932 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:44:58.220529 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:58.220491 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:44:58.220967 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:58.220676 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 14:44:58.220967 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:58.220758 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret podName:8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:00.220736548 +0000 UTC m=+21.728639173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret") pod "global-pull-secret-syncer-cqkg2" (UID: "8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2") : object "kube-system"/"original-pull-secret" not registered Jun 02 14:44:59.081286 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:44:59.081252 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:44:59.081460 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:44:59.081355 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:45:00.080749 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:00.080725 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:00.080749 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:00.080743 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:45:00.081178 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:00.080834 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqkg2" podUID="8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2" Jun 02 14:45:00.081178 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:00.080955 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:45:00.233427 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:00.233223 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:00.233533 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:00.233340 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 14:45:00.233533 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:00.233507 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret podName:8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:04.233489661 +0000 UTC m=+25.741392299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret") pod "global-pull-secret-syncer-cqkg2" (UID: "8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2") : object "kube-system"/"original-pull-secret" not registered Jun 02 14:45:00.295866 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:00.295840 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k6sqt" event={"ID":"10109fca-6b44-4d66-8efd-269151775e41","Type":"ContainerStarted","Data":"c655e0070fe13809291e5c836957f597b07e1a0dcb1c44e272a2bb312284bd16"} Jun 02 14:45:00.299521 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:00.299494 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" event={"ID":"068d069e-b79f-4012-a06a-e54f48e699b9","Type":"ContainerStarted","Data":"2e2faf2ef1669262df4f54fc862371049a628c16c81487343301b6ef5cfe1b7d"} Jun 02 14:45:00.300851 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:00.300827 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" event={"ID":"16039595-d233-421f-a7ac-dc51ff2b230a","Type":"ContainerStarted","Data":"cd05b8f9e651a21c128156278168867c9cba5ed47253bc17b2e9eff0b856450c"} Jun 02 14:45:00.302145 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:00.302124 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7987p" event={"ID":"8f958cf4-1e44-4c9a-8dcd-1fec1aa04671","Type":"ContainerStarted","Data":"0d391951d12bed3f867d08df96fedb83df9be8f5310d776e9a947e7cb413b479"} Jun 02 14:45:00.303724 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:00.303706 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wn6xc" event={"ID":"40a50a59-49da-4034-af9a-15a13dd4084d","Type":"ContainerStarted","Data":"deb5e1434c2826d608338978212a9328a744a5e1ae1c1d098a2136898912d17c"} Jun 02 14:45:00.309803 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:00.309757 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-k6sqt" podStartSLOduration=2.912873622 podStartE2EDuration="21.309743622s" podCreationTimestamp="2026-06-02 14:44:39 +0000 UTC" firstStartedPulling="2026-06-02 14:44:41.557018272 +0000 UTC m=+3.064920890" lastFinishedPulling="2026-06-02 14:44:59.953888255 +0000 UTC m=+21.461790890" observedRunningTime="2026-06-02 14:45:00.309606559 +0000 UTC m=+21.817509198" watchObservedRunningTime="2026-06-02 14:45:00.309743622 +0000 UTC m=+21.817646262" Jun 02 14:45:00.323727 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:00.323684 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wn6xc" podStartSLOduration=6.399971475 podStartE2EDuration="21.323669869s" podCreationTimestamp="2026-06-02 14:44:39 +0000 UTC" firstStartedPulling="2026-06-02 14:44:41.546985966 +0000 UTC m=+3.054888585" lastFinishedPulling="2026-06-02 14:44:56.470684361 +0000 UTC m=+17.978586979" observedRunningTime="2026-06-02 14:45:00.323635816 +0000 UTC m=+21.831538458" watchObservedRunningTime="2026-06-02 14:45:00.323669869 +0000 UTC m=+21.831572506" Jun 02 14:45:00.337334 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:00.337277 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7987p" podStartSLOduration=2.886475392 podStartE2EDuration="21.337253614s" podCreationTimestamp="2026-06-02 14:44:39 +0000 UTC" firstStartedPulling="2026-06-02 14:44:41.552821704 +0000 UTC m=+3.060724324" lastFinishedPulling="2026-06-02 14:45:00.00359991 +0000 UTC m=+21.511502546" observedRunningTime="2026-06-02 14:45:00.336592401 +0000 UTC m=+21.844495053" watchObservedRunningTime="2026-06-02 14:45:00.337253614 +0000 UTC m=+21.845156256" Jun 02 14:45:01.080681 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.080506 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:01.080818 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:01.080750 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:45:01.309372 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.309342 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b68xm" event={"ID":"bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c","Type":"ContainerStarted","Data":"8dd9f283cc102fe55b0b35db30c1c7017ef0a375fa93d8d2a4b088f1e0d9d2d1"} Jun 02 14:45:01.312146 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.312121 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/0.log" Jun 02 14:45:01.312506 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.312481 2564 generic.go:358] "Generic (PLEG): container finished" podID="97cfdf33-ab98-4e07-a458-a3266fac0eb5" containerID="0a017b30f3ea0e72c7ea4932b7f2f4ed961729b1be9be37d75fdfb01b45c29f3" exitCode=1 Jun 02 14:45:01.312568 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.312538 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" event={"ID":"97cfdf33-ab98-4e07-a458-a3266fac0eb5","Type":"ContainerStarted","Data":"a3b66657134426bf20c1494dd8fd88b73152719dbdcd3972c379bd3a8a11c73b"} Jun 02 14:45:01.312623 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.312568 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" event={"ID":"97cfdf33-ab98-4e07-a458-a3266fac0eb5","Type":"ContainerStarted","Data":"6cb115ede171f82dee018b0f2645a089ed950697bd8d35cbe968733c32848852"} Jun 02 14:45:01.312623 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.312577 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" event={"ID":"97cfdf33-ab98-4e07-a458-a3266fac0eb5","Type":"ContainerStarted","Data":"b0f665768216af9bc570ed7dcfe91978f728452498c87615ae5dcfccaa081441"} Jun 02 14:45:01.312623 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.312585 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" event={"ID":"97cfdf33-ab98-4e07-a458-a3266fac0eb5","Type":"ContainerStarted","Data":"852c7cacc67bd3fb915fb4f3cd2f6fa7eb8231ad5bb7763d3177b38d08732669"} Jun 02 14:45:01.312623 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.312596 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" event={"ID":"97cfdf33-ab98-4e07-a458-a3266fac0eb5","Type":"ContainerDied","Data":"0a017b30f3ea0e72c7ea4932b7f2f4ed961729b1be9be37d75fdfb01b45c29f3"} Jun 02 14:45:01.312623 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.312608 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" event={"ID":"97cfdf33-ab98-4e07-a458-a3266fac0eb5","Type":"ContainerStarted","Data":"79813e8e696a2724337876466750a19c7b5154ff16fab9df0d33ac6e86121eb1"} Jun 02 14:45:01.313882 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.313862 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rthgk" event={"ID":"662bb68f-e9d1-42ba-865e-07085a1e8ba0","Type":"ContainerStarted","Data":"567eba0c07bcb9c1937408e01302c295024e0116f9491ea7b61176377904ec01"} Jun 02 14:45:01.315207 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.315187 2564 generic.go:358] "Generic (PLEG): container finished" podID="16039595-d233-421f-a7ac-dc51ff2b230a" containerID="cd05b8f9e651a21c128156278168867c9cba5ed47253bc17b2e9eff0b856450c" exitCode=0 Jun 02 14:45:01.315331 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.315294 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" event={"ID":"16039595-d233-421f-a7ac-dc51ff2b230a","Type":"ContainerDied","Data":"cd05b8f9e651a21c128156278168867c9cba5ed47253bc17b2e9eff0b856450c"} Jun 02 14:45:01.327510 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.327477 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-b68xm" podStartSLOduration=3.549113626 podStartE2EDuration="22.327466068s" podCreationTimestamp="2026-06-02 14:44:39 +0000 UTC" firstStartedPulling="2026-06-02 14:44:41.554252038 +0000 UTC m=+3.062154661" lastFinishedPulling="2026-06-02 14:45:00.332604482 +0000 UTC m=+21.840507103" observedRunningTime="2026-06-02 14:45:01.326891412 +0000 UTC m=+22.834794056" watchObservedRunningTime="2026-06-02 14:45:01.327466068 +0000 UTC m=+22.835368707" Jun 02 14:45:01.341525 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.341494 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 14:45:01.361126 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:01.361085 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rthgk" podStartSLOduration=3.907330645 podStartE2EDuration="22.361073864s" podCreationTimestamp="2026-06-02 14:44:39 +0000 UTC" firstStartedPulling="2026-06-02 14:44:41.551409172 +0000 UTC m=+3.059311791" lastFinishedPulling="2026-06-02 14:45:00.005152385 +0000 UTC m=+21.513055010" observedRunningTime="2026-06-02 14:45:01.360752737 +0000 UTC m=+22.868655376" watchObservedRunningTime="2026-06-02 14:45:01.361073864 +0000 UTC m=+22.868976547" Jun 02 14:45:02.029291 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:02.028984 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T14:45:01.341519648Z","UUID":"5136506b-0a23-4aff-96ef-b7ad03b5459b","Handler":null,"Name":"","Endpoint":""} Jun 02 14:45:02.032059 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:02.032034 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 14:45:02.032059 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:02.032068 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 14:45:02.080548 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:02.080488 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:02.080714 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:02.080495 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:45:02.080714 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:02.080611 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqkg2" podUID="8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2" Jun 02 14:45:02.080714 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:02.080654 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:45:02.319552 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:02.319446 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8qq9p" event={"ID":"b54104a8-2be1-44c9-bed2-d8fbafd191f5","Type":"ContainerStarted","Data":"7bfe03db4653fb12b14643f8785423ce312ac614f16454e576511b7b0f651f5e"} Jun 02 14:45:02.321683 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:02.321637 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" event={"ID":"068d069e-b79f-4012-a06a-e54f48e699b9","Type":"ContainerStarted","Data":"c90f12c5d3bf2345b495c394c8874fe35324a1c9d02fa91ab40239a70ffbe491"} Jun 02 14:45:02.338112 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:02.338067 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8qq9p" podStartSLOduration=4.884219429 podStartE2EDuration="23.338051119s" podCreationTimestamp="2026-06-02 14:44:39 +0000 UTC" firstStartedPulling="2026-06-02 14:44:41.549899777 +0000 UTC m=+3.057802400" lastFinishedPulling="2026-06-02 14:45:00.003731473 +0000 UTC m=+21.511634090" observedRunningTime="2026-06-02 14:45:02.337881503 +0000 UTC m=+23.845784142" watchObservedRunningTime="2026-06-02 14:45:02.338051119 +0000 UTC m=+23.845953760" Jun 02 14:45:03.080867 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:03.080834 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:03.081338 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:03.080971 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:45:03.326510 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:03.326481 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/0.log" Jun 02 14:45:03.326921 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:03.326883 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" event={"ID":"97cfdf33-ab98-4e07-a458-a3266fac0eb5","Type":"ContainerStarted","Data":"7b888d9b8f1e03e17a8e7c29d0d4fce6fce28c98b16d0a2e67052a51ad18db31"} Jun 02 14:45:03.329661 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:03.329004 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" event={"ID":"068d069e-b79f-4012-a06a-e54f48e699b9","Type":"ContainerStarted","Data":"595603fe99b68e38d1f9fd4d01bbe9649b7a707a719cfd3d6930c45f0d88151b"} Jun 02 14:45:03.347253 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:03.347172 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbcvr" podStartSLOduration=3.4640840969999998 podStartE2EDuration="24.347157296s" podCreationTimestamp="2026-06-02 14:44:39 +0000 UTC" firstStartedPulling="2026-06-02 14:44:41.556026606 +0000 UTC m=+3.063929226" lastFinishedPulling="2026-06-02 14:45:02.439099803 +0000 UTC m=+23.947002425" observedRunningTime="2026-06-02 14:45:03.346857252 +0000 UTC m=+24.854759893" watchObservedRunningTime="2026-06-02 14:45:03.347157296 +0000 UTC m=+24.855059938" Jun 02 14:45:04.080569 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:04.080538 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:04.080763 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:04.080542 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:45:04.080763 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:04.080673 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqkg2" podUID="8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2" Jun 02 14:45:04.080860 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:04.080764 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:45:04.265150 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:04.265109 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:04.265881 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:04.265254 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 14:45:04.265881 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:04.265336 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret podName:8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:12.265321486 +0000 UTC m=+33.773224124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret") pod "global-pull-secret-syncer-cqkg2" (UID: "8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2") : object "kube-system"/"original-pull-secret" not registered Jun 02 14:45:04.712728 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:04.712688 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:45:04.713351 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:04.713321 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:45:05.081073 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:05.080980 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:05.081233 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:05.081101 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:45:05.333132 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:05.333047 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:45:05.333646 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:05.333631 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wn6xc" Jun 02 14:45:06.081086 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.080900 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:06.081297 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.080904 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:45:06.081297 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:06.081182 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqkg2" podUID="8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2" Jun 02 14:45:06.081297 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:06.081226 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:45:06.336602 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.336517 2564 generic.go:358] "Generic (PLEG): container finished" podID="16039595-d233-421f-a7ac-dc51ff2b230a" containerID="9f7a813db94c22d506764e441adc686533d74826b743a4dc5c268b4f12094ae0" exitCode=0 Jun 02 14:45:06.337145 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.336596 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" event={"ID":"16039595-d233-421f-a7ac-dc51ff2b230a","Type":"ContainerDied","Data":"9f7a813db94c22d506764e441adc686533d74826b743a4dc5c268b4f12094ae0"} Jun 02 14:45:06.339797 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.339778 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/0.log" Jun 02 14:45:06.340161 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.340123 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" event={"ID":"97cfdf33-ab98-4e07-a458-a3266fac0eb5","Type":"ContainerStarted","Data":"42ce5717d72c307e9837538b4cfa6586de419afab474f45e008d05f4dde6cf79"} Jun 02 14:45:06.340729 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.340706 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:45:06.340838 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.340738 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:45:06.340901 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.340859 2564 scope.go:117] "RemoveContainer" containerID="0a017b30f3ea0e72c7ea4932b7f2f4ed961729b1be9be37d75fdfb01b45c29f3" Jun 02 14:45:06.341501 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.341164 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:45:06.361178 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.361152 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:45:06.361288 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:06.361262 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:45:07.080966 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.080928 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:07.081083 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:07.081033 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:45:07.344487 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.344256 2564 generic.go:358] "Generic (PLEG): container finished" podID="16039595-d233-421f-a7ac-dc51ff2b230a" containerID="b397f4983fa456584993aef123f671a6d824a89035557f689eb3e935b069bfdf" exitCode=0 Jun 02 14:45:07.344883 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.344335 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" event={"ID":"16039595-d233-421f-a7ac-dc51ff2b230a","Type":"ContainerDied","Data":"b397f4983fa456584993aef123f671a6d824a89035557f689eb3e935b069bfdf"} Jun 02 14:45:07.349374 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.349358 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/0.log" Jun 02 14:45:07.349764 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.349736 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" event={"ID":"97cfdf33-ab98-4e07-a458-a3266fac0eb5","Type":"ContainerStarted","Data":"844d3aefbf5f612dc18cb8292621fd03727476bd20de39c3a9eaf06edea3f8c2"} Jun 02 14:45:07.389930 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.389888 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" podStartSLOduration=9.89459853 podStartE2EDuration="28.389877435s" podCreationTimestamp="2026-06-02 14:44:39 +0000 UTC" firstStartedPulling="2026-06-02 14:44:41.554415554 +0000 UTC m=+3.062318177" lastFinishedPulling="2026-06-02 14:45:00.049694446 +0000 UTC m=+21.557597082" observedRunningTime="2026-06-02 14:45:07.387938807 +0000 UTC m=+28.895841447" watchObservedRunningTime="2026-06-02 14:45:07.389877435 +0000 UTC m=+28.897780074" Jun 02 14:45:07.538441 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.538409 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f4q6p"] Jun 02 14:45:07.538630 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.538522 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:07.538630 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:07.538601 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:45:07.541595 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.541383 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2p9gp"] Jun 02 14:45:07.541595 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.541582 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:45:07.541770 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:07.541701 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:45:07.542069 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.542029 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cqkg2"] Jun 02 14:45:07.542151 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:07.542136 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:07.542243 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:07.542225 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqkg2" podUID="8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2" Jun 02 14:45:08.353371 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:08.353341 2564 generic.go:358] "Generic (PLEG): container finished" podID="16039595-d233-421f-a7ac-dc51ff2b230a" containerID="2076d4a695301f536a395cc4308842839f56124f97d15899dd7e67b99c825c3c" exitCode=0 Jun 02 14:45:08.353818 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:08.353428 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" event={"ID":"16039595-d233-421f-a7ac-dc51ff2b230a","Type":"ContainerDied","Data":"2076d4a695301f536a395cc4308842839f56124f97d15899dd7e67b99c825c3c"} Jun 02 14:45:09.081321 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:09.081273 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:45:09.081495 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:09.081381 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:09.081495 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:09.081423 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:09.081495 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:09.081420 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:45:09.081609 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:09.081496 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:45:09.081609 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:09.081572 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqkg2" podUID="8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2" Jun 02 14:45:11.081037 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:11.080985 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:11.081037 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:11.081021 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:11.081702 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:11.081133 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:45:11.081702 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:11.081226 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqkg2" podUID="8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2" Jun 02 14:45:11.081702 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:11.081267 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:45:11.081702 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:11.081387 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:45:12.334269 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:12.334183 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:12.334805 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:12.334346 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 14:45:12.334805 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:12.334417 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret podName:8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:28.334397111 +0000 UTC m=+49.842299749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret") pod "global-pull-secret-syncer-cqkg2" (UID: "8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2") : object "kube-system"/"original-pull-secret" not registered Jun 02 14:45:12.738158 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:12.738115 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:45:12.738375 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:12.738253 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:45:12.738375 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:12.738351 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs podName:77654ab6-6b10-4650-8a14-0001fcd9eb85 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:44.738330475 +0000 UTC m=+66.246233095 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs") pod "network-metrics-daemon-2p9gp" (UID: "77654ab6-6b10-4650-8a14-0001fcd9eb85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:45:12.838501 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:12.838460 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxmp4\" (UniqueName: \"kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4\") pod \"network-check-target-f4q6p\" (UID: \"276ea801-82c9-4207-bc13-1bd3174c4629\") " pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:12.838691 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:12.838609 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:45:12.838691 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:12.838632 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:45:12.838691 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:12.838645 2564 projected.go:194] Error preparing data for projected volume kube-api-access-jxmp4 for pod openshift-network-diagnostics/network-check-target-f4q6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:45:12.838849 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:12.838711 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4 podName:276ea801-82c9-4207-bc13-1bd3174c4629 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:44.83869101 +0000 UTC m=+66.346593629 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxmp4" (UniqueName: "kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4") pod "network-check-target-f4q6p" (UID: "276ea801-82c9-4207-bc13-1bd3174c4629") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:45:13.080404 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:13.080317 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:13.080607 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:13.080483 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4q6p" podUID="276ea801-82c9-4207-bc13-1bd3174c4629" Jun 02 14:45:13.080727 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:13.080705 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:45:13.080911 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:13.080872 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p9gp" podUID="77654ab6-6b10-4650-8a14-0001fcd9eb85" Jun 02 14:45:13.080997 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:13.080937 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:13.081072 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:13.081041 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqkg2" podUID="8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2" Jun 02 14:45:14.239437 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.239407 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-192.ec2.internal" event="NodeReady" Jun 02 14:45:14.239839 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.239542 2564 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 14:45:14.286380 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.286342 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8vdkd"] Jun 02 14:45:14.347540 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.347499 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-twx4g"] Jun 02 14:45:14.347705 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.347686 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.350711 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.350536 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 14:45:14.350839 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.350533 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 14:45:14.350839 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.350637 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rr6kw\"" Jun 02 14:45:14.370294 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.370271 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-twx4g"] Jun 02 14:45:14.370294 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.370294 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vdkd"] Jun 02 14:45:14.370491 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.370432 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:14.372985 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.372957 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hx8l9\"" Jun 02 14:45:14.372985 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.372979 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 14:45:14.373149 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.373038 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 14:45:14.373149 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.373055 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 14:45:14.448707 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.448668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn9lz\" (UniqueName: \"kubernetes.io/projected/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-kube-api-access-hn9lz\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.448876 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.448720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.448876 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.448751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-tmp-dir\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.448876 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.448781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-config-volume\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.549467 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.549394 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.549467 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.549428 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-tmp-dir\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.549651 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.549543 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-config-volume\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.549651 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.549618 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn9lz\" (UniqueName: \"kubernetes.io/projected/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-kube-api-access-hn9lz\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.549748 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.549652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bfz8\" (UniqueName: \"kubernetes.io/projected/0403ed56-b191-4b5c-9fe0-606899a8db88-kube-api-access-9bfz8\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:14.549748 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:14.549542 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 14:45:14.549748 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.549683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:14.549748 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.549741 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-tmp-dir\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.549893 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:14.549748 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls podName:bad3a9fa-8660-4a5e-9a2f-1337fc62bae8 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:15.049720952 +0000 UTC m=+36.557623593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls") pod "dns-default-8vdkd" (UID: "bad3a9fa-8660-4a5e-9a2f-1337fc62bae8") : secret "dns-default-metrics-tls" not found Jun 02 14:45:14.550036 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.550015 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-config-volume\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.560318 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.560273 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn9lz\" (UniqueName: \"kubernetes.io/projected/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-kube-api-access-hn9lz\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:14.650815 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.650783 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bfz8\" (UniqueName: \"kubernetes.io/projected/0403ed56-b191-4b5c-9fe0-606899a8db88-kube-api-access-9bfz8\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:14.650815 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.650816 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:14.651034 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:14.650946 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 14:45:14.651034 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:14.650997 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert podName:0403ed56-b191-4b5c-9fe0-606899a8db88 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:15.150982981 +0000 UTC m=+36.658885602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert") pod "ingress-canary-twx4g" (UID: "0403ed56-b191-4b5c-9fe0-606899a8db88") : secret "canary-serving-cert" not found Jun 02 14:45:14.661803 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:14.661774 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bfz8\" (UniqueName: \"kubernetes.io/projected/0403ed56-b191-4b5c-9fe0-606899a8db88-kube-api-access-9bfz8\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:15.053787 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.053757 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:15.053896 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:15.053864 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 14:45:15.053937 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:15.053916 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls podName:bad3a9fa-8660-4a5e-9a2f-1337fc62bae8 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:16.053902076 +0000 UTC m=+37.561804693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls") pod "dns-default-8vdkd" (UID: "bad3a9fa-8660-4a5e-9a2f-1337fc62bae8") : secret "dns-default-metrics-tls" not found Jun 02 14:45:15.080829 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.080768 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:15.080829 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.080800 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:15.080958 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.080780 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:45:15.083858 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.083762 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 14:45:15.083858 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.083801 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 14:45:15.083858 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.083801 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 14:45:15.084255 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.084218 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hfb2n\"" Jun 02 14:45:15.084376 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.084296 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 14:45:15.086943 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.084436 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxfqv\"" Jun 02 14:45:15.154631 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.154600 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:15.154758 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:15.154736 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 14:45:15.154810 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:15.154795 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert podName:0403ed56-b191-4b5c-9fe0-606899a8db88 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:16.15478037 +0000 UTC m=+37.662682987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert") pod "ingress-canary-twx4g" (UID: "0403ed56-b191-4b5c-9fe0-606899a8db88") : secret "canary-serving-cert" not found Jun 02 14:45:15.369112 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.369017 2564 generic.go:358] "Generic (PLEG): container finished" podID="16039595-d233-421f-a7ac-dc51ff2b230a" containerID="98838786ef5073a5c5407cfab46b78b474d56f2fc998fc99e5cc54293b567fc3" exitCode=0 Jun 02 14:45:15.369112 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:15.369077 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" event={"ID":"16039595-d233-421f-a7ac-dc51ff2b230a","Type":"ContainerDied","Data":"98838786ef5073a5c5407cfab46b78b474d56f2fc998fc99e5cc54293b567fc3"} Jun 02 14:45:16.061501 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:16.061449 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:16.061695 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:16.061603 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 14:45:16.061695 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:16.061673 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls podName:bad3a9fa-8660-4a5e-9a2f-1337fc62bae8 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:18.06165658 +0000 UTC m=+39.569559198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls") pod "dns-default-8vdkd" (UID: "bad3a9fa-8660-4a5e-9a2f-1337fc62bae8") : secret "dns-default-metrics-tls" not found Jun 02 14:45:16.162539 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:16.162503 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:16.162698 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:16.162619 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 14:45:16.162698 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:16.162676 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert podName:0403ed56-b191-4b5c-9fe0-606899a8db88 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:18.162659132 +0000 UTC m=+39.670561752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert") pod "ingress-canary-twx4g" (UID: "0403ed56-b191-4b5c-9fe0-606899a8db88") : secret "canary-serving-cert" not found Jun 02 14:45:16.374076 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:16.373986 2564 generic.go:358] "Generic (PLEG): container finished" podID="16039595-d233-421f-a7ac-dc51ff2b230a" containerID="238b5f4f9d3787b7a32d48cec9c9b3f905ca71e9c5670f25ccc5955d3fb7c7c5" exitCode=0 Jun 02 14:45:16.374076 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:16.374048 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" event={"ID":"16039595-d233-421f-a7ac-dc51ff2b230a","Type":"ContainerDied","Data":"238b5f4f9d3787b7a32d48cec9c9b3f905ca71e9c5670f25ccc5955d3fb7c7c5"} Jun 02 14:45:17.378251 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:17.378166 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" event={"ID":"16039595-d233-421f-a7ac-dc51ff2b230a","Type":"ContainerStarted","Data":"6f78d4b1de5c39a1f38569ca30031709eebd7db8fc9af7b1f2c6c4de51bdb26d"} Jun 02 14:45:17.400039 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:17.399990 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8vp9n" podStartSLOduration=5.20262825 podStartE2EDuration="38.399975028s" podCreationTimestamp="2026-06-02 14:44:39 +0000 UTC" firstStartedPulling="2026-06-02 14:44:41.55563817 +0000 UTC m=+3.063540794" lastFinishedPulling="2026-06-02 14:45:14.752984952 +0000 UTC m=+36.260887572" observedRunningTime="2026-06-02 14:45:17.398235395 +0000 UTC m=+38.906138036" watchObservedRunningTime="2026-06-02 14:45:17.399975028 +0000 UTC m=+38.907877668" Jun 02 14:45:18.077358 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:18.077294 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:18.077521 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:18.077421 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 14:45:18.077521 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:18.077495 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls podName:bad3a9fa-8660-4a5e-9a2f-1337fc62bae8 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:22.077476443 +0000 UTC m=+43.585379061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls") pod "dns-default-8vdkd" (UID: "bad3a9fa-8660-4a5e-9a2f-1337fc62bae8") : secret "dns-default-metrics-tls" not found Jun 02 14:45:18.177839 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:18.177788 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:18.178021 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:18.177957 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 14:45:18.178071 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:18.178028 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert podName:0403ed56-b191-4b5c-9fe0-606899a8db88 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:22.178011651 +0000 UTC m=+43.685914268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert") pod "ingress-canary-twx4g" (UID: "0403ed56-b191-4b5c-9fe0-606899a8db88") : secret "canary-serving-cert" not found Jun 02 14:45:22.102358 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:22.102149 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:22.102747 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:22.102292 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 14:45:22.102747 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:22.102457 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls podName:bad3a9fa-8660-4a5e-9a2f-1337fc62bae8 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:30.10244155 +0000 UTC m=+51.610344168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls") pod "dns-default-8vdkd" (UID: "bad3a9fa-8660-4a5e-9a2f-1337fc62bae8") : secret "dns-default-metrics-tls" not found Jun 02 14:45:22.203236 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:22.203185 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:22.203373 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:22.203355 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 14:45:22.203431 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:22.203421 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert podName:0403ed56-b191-4b5c-9fe0-606899a8db88 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:30.203402016 +0000 UTC m=+51.711304638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert") pod "ingress-canary-twx4g" (UID: "0403ed56-b191-4b5c-9fe0-606899a8db88") : secret "canary-serving-cert" not found Jun 02 14:45:28.346251 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:28.346202 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:28.349721 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:28.349701 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2-original-pull-secret\") pod \"global-pull-secret-syncer-cqkg2\" (UID: \"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2\") " pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:28.592620 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:28.592577 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqkg2" Jun 02 14:45:28.752943 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:28.752913 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cqkg2"] Jun 02 14:45:28.756633 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:45:28.756582 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3634eb_c8b9_4ee4_9a34_0865f33b9ed2.slice/crio-dbdb4cf19d83dc6af40ba9e7b73f096e3561f63b7ba27ad0a9b302e37d22ddf6 WatchSource:0}: Error finding container dbdb4cf19d83dc6af40ba9e7b73f096e3561f63b7ba27ad0a9b302e37d22ddf6: Status 404 returned error can't find the container with id dbdb4cf19d83dc6af40ba9e7b73f096e3561f63b7ba27ad0a9b302e37d22ddf6 Jun 02 14:45:29.400870 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:29.400828 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cqkg2" event={"ID":"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2","Type":"ContainerStarted","Data":"dbdb4cf19d83dc6af40ba9e7b73f096e3561f63b7ba27ad0a9b302e37d22ddf6"} Jun 02 14:45:30.155820 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:30.155779 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:30.155999 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:30.155954 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 14:45:30.156053 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:30.156040 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls podName:bad3a9fa-8660-4a5e-9a2f-1337fc62bae8 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:46.156015937 +0000 UTC m=+67.663918555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls") pod "dns-default-8vdkd" (UID: "bad3a9fa-8660-4a5e-9a2f-1337fc62bae8") : secret "dns-default-metrics-tls" not found Jun 02 14:45:30.256541 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:30.256501 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:30.256720 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:30.256646 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 14:45:30.256769 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:30.256730 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert podName:0403ed56-b191-4b5c-9fe0-606899a8db88 nodeName:}" failed. No retries permitted until 2026-06-02 14:45:46.256709336 +0000 UTC m=+67.764611960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert") pod "ingress-canary-twx4g" (UID: "0403ed56-b191-4b5c-9fe0-606899a8db88") : secret "canary-serving-cert" not found Jun 02 14:45:31.824343 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.824290 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p"] Jun 02 14:45:31.846953 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.846920 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p"] Jun 02 14:45:31.846953 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.846960 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c"] Jun 02 14:45:31.847210 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.847094 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:31.849578 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.849550 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 14:45:31.850395 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.850371 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 14:45:31.850515 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.850379 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 14:45:31.850515 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.850379 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 14:45:31.863183 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.863153 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c"] Jun 02 14:45:31.863342 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.863263 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.866114 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866081 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 14:45:31.866239 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866115 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 14:45:31.866239 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866182 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 14:45:31.866369 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866095 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 14:45:31.866570 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.866646 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866584 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/abbd4674-6e5a-4ebb-9913-5519498b80a7-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.866646 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-ca\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.866746 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgh69\" (UniqueName: \"kubernetes.io/projected/abbd4674-6e5a-4ebb-9913-5519498b80a7-kube-api-access-dgh69\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.866794 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-hub\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.866847 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866790 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3de22f5b-6efd-43c1-b69a-ee923a3160e4-tmp\") pod \"klusterlet-addon-workmgr-756c47d7f7-dvd8p\" (UID: \"3de22f5b-6efd-43c1-b69a-ee923a3160e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:31.866847 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.866928 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866854 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3de22f5b-6efd-43c1-b69a-ee923a3160e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-756c47d7f7-dvd8p\" (UID: \"3de22f5b-6efd-43c1-b69a-ee923a3160e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:31.866928 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.866906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqcj\" (UniqueName: \"kubernetes.io/projected/3de22f5b-6efd-43c1-b69a-ee923a3160e4-kube-api-access-6lqcj\") pod \"klusterlet-addon-workmgr-756c47d7f7-dvd8p\" (UID: \"3de22f5b-6efd-43c1-b69a-ee923a3160e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:31.968218 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.968175 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-ca\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.968431 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.968230 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dgh69\" (UniqueName: \"kubernetes.io/projected/abbd4674-6e5a-4ebb-9913-5519498b80a7-kube-api-access-dgh69\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.968431 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.968361 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-hub\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.968539 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.968434 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3de22f5b-6efd-43c1-b69a-ee923a3160e4-tmp\") pod \"klusterlet-addon-workmgr-756c47d7f7-dvd8p\" (UID: \"3de22f5b-6efd-43c1-b69a-ee923a3160e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:31.968539 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.968470 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.968539 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.968501 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3de22f5b-6efd-43c1-b69a-ee923a3160e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-756c47d7f7-dvd8p\" (UID: \"3de22f5b-6efd-43c1-b69a-ee923a3160e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:31.968679 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.968550 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqcj\" (UniqueName: \"kubernetes.io/projected/3de22f5b-6efd-43c1-b69a-ee923a3160e4-kube-api-access-6lqcj\") pod \"klusterlet-addon-workmgr-756c47d7f7-dvd8p\" (UID: \"3de22f5b-6efd-43c1-b69a-ee923a3160e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:31.968770 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.968742 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.968824 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.968789 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/abbd4674-6e5a-4ebb-9913-5519498b80a7-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.969171 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.969136 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3de22f5b-6efd-43c1-b69a-ee923a3160e4-tmp\") pod \"klusterlet-addon-workmgr-756c47d7f7-dvd8p\" (UID: \"3de22f5b-6efd-43c1-b69a-ee923a3160e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:31.969765 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.969739 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/abbd4674-6e5a-4ebb-9913-5519498b80a7-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.971474 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.971447 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-ca\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.971855 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.971834 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.972126 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.972108 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3de22f5b-6efd-43c1-b69a-ee923a3160e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-756c47d7f7-dvd8p\" (UID: \"3de22f5b-6efd-43c1-b69a-ee923a3160e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:31.972279 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.972242 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.972383 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.972323 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/abbd4674-6e5a-4ebb-9913-5519498b80a7-hub\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.977677 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.977499 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgh69\" (UniqueName: \"kubernetes.io/projected/abbd4674-6e5a-4ebb-9913-5519498b80a7-kube-api-access-dgh69\") pod \"cluster-proxy-proxy-agent-788b4877ff-wqk9c\" (UID: \"abbd4674-6e5a-4ebb-9913-5519498b80a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:31.977677 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:31.977634 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqcj\" (UniqueName: \"kubernetes.io/projected/3de22f5b-6efd-43c1-b69a-ee923a3160e4-kube-api-access-6lqcj\") pod \"klusterlet-addon-workmgr-756c47d7f7-dvd8p\" (UID: \"3de22f5b-6efd-43c1-b69a-ee923a3160e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:32.161371 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:32.161270 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:32.194406 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:32.194362 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:45:33.134248 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:33.134201 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c"] Jun 02 14:45:33.147412 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:33.147385 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p"] Jun 02 14:45:33.225403 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:45:33.225370 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabbd4674_6e5a_4ebb_9913_5519498b80a7.slice/crio-0d267d4688e26eab1ff8c9af87cd867d27db3ae096c899466f8d6cb231930066 WatchSource:0}: Error finding container 0d267d4688e26eab1ff8c9af87cd867d27db3ae096c899466f8d6cb231930066: Status 404 returned error can't find the container with id 0d267d4688e26eab1ff8c9af87cd867d27db3ae096c899466f8d6cb231930066 Jun 02 14:45:33.225663 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:45:33.225637 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de22f5b_6efd_43c1_b69a_ee923a3160e4.slice/crio-3a897eebccd4d6e6174122564a9731c38f4f2fdcdd4101be28bf07d83a72a755 WatchSource:0}: Error finding container 3a897eebccd4d6e6174122564a9731c38f4f2fdcdd4101be28bf07d83a72a755: Status 404 returned error can't find the container with id 3a897eebccd4d6e6174122564a9731c38f4f2fdcdd4101be28bf07d83a72a755 Jun 02 14:45:33.410804 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:33.410766 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" event={"ID":"abbd4674-6e5a-4ebb-9913-5519498b80a7","Type":"ContainerStarted","Data":"0d267d4688e26eab1ff8c9af87cd867d27db3ae096c899466f8d6cb231930066"} Jun 02 14:45:33.412100 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:33.412072 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cqkg2" event={"ID":"8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2","Type":"ContainerStarted","Data":"8b221081378185dad3c7aca238b1bbe335e8028d7067a511f9385496b41f3a53"} Jun 02 14:45:33.413199 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:33.413165 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" event={"ID":"3de22f5b-6efd-43c1-b69a-ee923a3160e4","Type":"ContainerStarted","Data":"3a897eebccd4d6e6174122564a9731c38f4f2fdcdd4101be28bf07d83a72a755"} Jun 02 14:45:33.426102 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:33.426053 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cqkg2" podStartSLOduration=32.928853012 podStartE2EDuration="37.426039568s" podCreationTimestamp="2026-06-02 14:44:56 +0000 UTC" firstStartedPulling="2026-06-02 14:45:28.758327073 +0000 UTC m=+50.266229691" lastFinishedPulling="2026-06-02 14:45:33.255513625 +0000 UTC m=+54.763416247" observedRunningTime="2026-06-02 14:45:33.42540304 +0000 UTC m=+54.933305680" watchObservedRunningTime="2026-06-02 14:45:33.426039568 +0000 UTC m=+54.933942208" Jun 02 14:45:38.367514 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:38.367484 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjh6n" Jun 02 14:45:39.428229 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:39.428189 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" event={"ID":"abbd4674-6e5a-4ebb-9913-5519498b80a7","Type":"ContainerStarted","Data":"9e0989cf7037b7fb6b6219e7cbd4d101e99fe1ac25be9b9c464960d89e6dd6b0"} Jun 02 14:45:39.429390 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:39.429369 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" event={"ID":"3de22f5b-6efd-43c1-b69a-ee923a3160e4","Type":"ContainerStarted","Data":"aa2c6cc5aefa63b59828dc47cae1d708dbaa577d582444caaf05bf1fce9587ac"} Jun 02 14:45:39.429651 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:39.429629 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:39.431382 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:39.431361 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:45:39.446447 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:39.446411 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" podStartSLOduration=3.250921919 podStartE2EDuration="8.446399882s" podCreationTimestamp="2026-06-02 14:45:31 +0000 UTC" firstStartedPulling="2026-06-02 14:45:33.241402207 +0000 UTC m=+54.749304825" lastFinishedPulling="2026-06-02 14:45:38.436880163 +0000 UTC m=+59.944782788" observedRunningTime="2026-06-02 14:45:39.44615718 +0000 UTC m=+60.954059819" watchObservedRunningTime="2026-06-02 14:45:39.446399882 +0000 UTC m=+60.954302521" Jun 02 14:45:42.436771 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:42.436729 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" event={"ID":"abbd4674-6e5a-4ebb-9913-5519498b80a7","Type":"ContainerStarted","Data":"99c167a40611bb4fc8c29198d7c6d55af0474360b874a89d125abb2d4ed54326"} Jun 02 14:45:42.436771 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:42.436768 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" event={"ID":"abbd4674-6e5a-4ebb-9913-5519498b80a7","Type":"ContainerStarted","Data":"0040a275fdafc1005046ca692864880fbcd8c1bde24b3a5159b73025d78c4a9b"} Jun 02 14:45:42.454147 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:42.454099 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" podStartSLOduration=3.006912923 podStartE2EDuration="11.454084576s" podCreationTimestamp="2026-06-02 14:45:31 +0000 UTC" firstStartedPulling="2026-06-02 14:45:33.241382763 +0000 UTC m=+54.749285384" lastFinishedPulling="2026-06-02 14:45:41.688554415 +0000 UTC m=+63.196457037" observedRunningTime="2026-06-02 14:45:42.453394844 +0000 UTC m=+63.961297488" watchObservedRunningTime="2026-06-02 14:45:42.454084576 +0000 UTC m=+63.961987215" Jun 02 14:45:44.766394 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:44.766347 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:45:44.769352 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:44.769332 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 14:45:44.776639 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:44.776607 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 14:45:44.776733 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:44.776722 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs podName:77654ab6-6b10-4650-8a14-0001fcd9eb85 nodeName:}" failed. No retries permitted until 2026-06-02 14:46:48.776703595 +0000 UTC m=+130.284606213 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs") pod "network-metrics-daemon-2p9gp" (UID: "77654ab6-6b10-4650-8a14-0001fcd9eb85") : secret "metrics-daemon-secret" not found Jun 02 14:45:44.867125 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:44.867080 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxmp4\" (UniqueName: \"kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4\") pod \"network-check-target-f4q6p\" (UID: \"276ea801-82c9-4207-bc13-1bd3174c4629\") " pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:44.870177 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:44.870158 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 14:45:44.880073 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:44.880051 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 14:45:44.890717 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:44.890696 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxmp4\" (UniqueName: \"kubernetes.io/projected/276ea801-82c9-4207-bc13-1bd3174c4629-kube-api-access-jxmp4\") pod \"network-check-target-f4q6p\" (UID: \"276ea801-82c9-4207-bc13-1bd3174c4629\") " pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:45.105447 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:45.105363 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxfqv\"" Jun 02 14:45:45.113519 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:45.113503 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:45.233160 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:45.233125 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f4q6p"] Jun 02 14:45:45.236265 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:45:45.236237 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276ea801_82c9_4207_bc13_1bd3174c4629.slice/crio-a06cbef796ce1e67dab5cbdea33482cb87e5017d27d856b132d709b04e25c549 WatchSource:0}: Error finding container a06cbef796ce1e67dab5cbdea33482cb87e5017d27d856b132d709b04e25c549: Status 404 returned error can't find the container with id a06cbef796ce1e67dab5cbdea33482cb87e5017d27d856b132d709b04e25c549 Jun 02 14:45:45.443536 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:45.443496 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f4q6p" event={"ID":"276ea801-82c9-4207-bc13-1bd3174c4629","Type":"ContainerStarted","Data":"a06cbef796ce1e67dab5cbdea33482cb87e5017d27d856b132d709b04e25c549"} Jun 02 14:45:46.176589 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:46.176545 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:45:46.177173 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:46.176723 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 14:45:46.177173 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:46.176801 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls podName:bad3a9fa-8660-4a5e-9a2f-1337fc62bae8 nodeName:}" failed. No retries permitted until 2026-06-02 14:46:18.176781746 +0000 UTC m=+99.684684372 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls") pod "dns-default-8vdkd" (UID: "bad3a9fa-8660-4a5e-9a2f-1337fc62bae8") : secret "dns-default-metrics-tls" not found Jun 02 14:45:46.277600 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:46.277564 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:45:46.277789 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:46.277698 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 14:45:46.277789 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:45:46.277760 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert podName:0403ed56-b191-4b5c-9fe0-606899a8db88 nodeName:}" failed. No retries permitted until 2026-06-02 14:46:18.277741446 +0000 UTC m=+99.785644069 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert") pod "ingress-canary-twx4g" (UID: "0403ed56-b191-4b5c-9fe0-606899a8db88") : secret "canary-serving-cert" not found Jun 02 14:45:48.451144 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:48.451109 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f4q6p" event={"ID":"276ea801-82c9-4207-bc13-1bd3174c4629","Type":"ContainerStarted","Data":"854478d701e86df1c1b2d0831de385860292c88eb875e4d3f3befe4d2aba6512"} Jun 02 14:45:48.451609 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:48.451228 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:45:48.466768 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:45:48.466718 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f4q6p" podStartSLOduration=66.821618596 podStartE2EDuration="1m9.466703623s" podCreationTimestamp="2026-06-02 14:44:39 +0000 UTC" firstStartedPulling="2026-06-02 14:45:45.238117767 +0000 UTC m=+66.746020385" lastFinishedPulling="2026-06-02 14:45:47.883202792 +0000 UTC m=+69.391105412" observedRunningTime="2026-06-02 14:45:48.466276604 +0000 UTC m=+69.974179257" watchObservedRunningTime="2026-06-02 14:45:48.466703623 +0000 UTC m=+69.974606262" Jun 02 14:46:18.204192 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:18.204150 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:46:18.204631 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:46:18.204293 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 14:46:18.204631 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:46:18.204390 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls podName:bad3a9fa-8660-4a5e-9a2f-1337fc62bae8 nodeName:}" failed. No retries permitted until 2026-06-02 14:47:22.204371966 +0000 UTC m=+163.712274588 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls") pod "dns-default-8vdkd" (UID: "bad3a9fa-8660-4a5e-9a2f-1337fc62bae8") : secret "dns-default-metrics-tls" not found Jun 02 14:46:18.305075 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:18.305031 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:46:18.305235 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:46:18.305159 2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 14:46:18.305235 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:46:18.305224 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert podName:0403ed56-b191-4b5c-9fe0-606899a8db88 nodeName:}" failed. No retries permitted until 2026-06-02 14:47:22.305207217 +0000 UTC m=+163.813109838 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert") pod "ingress-canary-twx4g" (UID: "0403ed56-b191-4b5c-9fe0-606899a8db88") : secret "canary-serving-cert" not found Jun 02 14:46:19.456609 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:19.456573 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f4q6p" Jun 02 14:46:30.708424 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:30.708396 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k6sqt_10109fca-6b44-4d66-8efd-269151775e41/dns-node-resolver/0.log" Jun 02 14:46:31.308583 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:31.308556 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7987p_8f958cf4-1e44-4c9a-8dcd-1fec1aa04671/node-ca/0.log" Jun 02 14:46:48.832622 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:48.832579 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:46:48.835041 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:48.835008 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77654ab6-6b10-4650-8a14-0001fcd9eb85-metrics-certs\") pod \"network-metrics-daemon-2p9gp\" (UID: \"77654ab6-6b10-4650-8a14-0001fcd9eb85\") " pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:46:49.000081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:49.000052 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hfb2n\"" Jun 02 14:46:49.008171 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:49.008144 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p9gp" Jun 02 14:46:49.129961 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:49.129930 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2p9gp"] Jun 02 14:46:49.133264 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:46:49.133233 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77654ab6_6b10_4650_8a14_0001fcd9eb85.slice/crio-6f6a4cd1063ca9cf3b9aaa61a68f3264b00096f54caf9bc029c69d3162519fb8 WatchSource:0}: Error finding container 6f6a4cd1063ca9cf3b9aaa61a68f3264b00096f54caf9bc029c69d3162519fb8: Status 404 returned error can't find the container with id 6f6a4cd1063ca9cf3b9aaa61a68f3264b00096f54caf9bc029c69d3162519fb8 Jun 02 14:46:49.598223 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:49.598177 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2p9gp" event={"ID":"77654ab6-6b10-4650-8a14-0001fcd9eb85","Type":"ContainerStarted","Data":"6f6a4cd1063ca9cf3b9aaa61a68f3264b00096f54caf9bc029c69d3162519fb8"} Jun 02 14:46:50.602404 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:50.602370 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2p9gp" event={"ID":"77654ab6-6b10-4650-8a14-0001fcd9eb85","Type":"ContainerStarted","Data":"9889e2caa2d41af9d4412781618e41e9dfe6ae4ab205b04d8375b4713b782ee1"} Jun 02 14:46:50.602404 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:50.602405 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2p9gp" event={"ID":"77654ab6-6b10-4650-8a14-0001fcd9eb85","Type":"ContainerStarted","Data":"e2c8a9bc8106d73475b55668f3969032d5b2e4e6633feaba19f2a72898a70fba"} Jun 02 14:46:50.619295 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:50.619245 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2p9gp" podStartSLOduration=130.641946746 podStartE2EDuration="2m11.619196459s" podCreationTimestamp="2026-06-02 14:44:39 +0000 UTC" firstStartedPulling="2026-06-02 14:46:49.135095595 +0000 UTC m=+130.642998214" lastFinishedPulling="2026-06-02 14:46:50.112345308 +0000 UTC m=+131.620247927" observedRunningTime="2026-06-02 14:46:50.619136791 +0000 UTC m=+132.127039433" watchObservedRunningTime="2026-06-02 14:46:50.619196459 +0000 UTC m=+132.127099100" Jun 02 14:46:52.196068 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.196023 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" podUID="abbd4674-6e5a-4ebb-9913-5519498b80a7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 14:46:52.840391 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.840330 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hpbxk"] Jun 02 14:46:52.843608 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.843587 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:52.846549 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.846527 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 14:46:52.846677 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.846585 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 14:46:52.848530 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.848384 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7chpp\"" Jun 02 14:46:52.848530 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.848472 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 14:46:52.848530 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.848496 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 14:46:52.855687 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.855662 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hpbxk"] Jun 02 14:46:52.934891 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.934856 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f57fbcb78-zrskt"] Jun 02 14:46:52.937664 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.937650 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:52.940147 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.940125 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 14:46:52.940484 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.940468 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lvw2l\"" Jun 02 14:46:52.940578 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.940470 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 14:46:52.940578 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.940518 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 14:46:52.946680 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.946664 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 14:46:52.948988 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.948949 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f57fbcb78-zrskt"] Jun 02 14:46:52.960266 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.960244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e65c822-a96d-4055-b76e-96ae7610e9ed-crio-socket\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:52.960387 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.960281 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtkmd\" (UniqueName: \"kubernetes.io/projected/8e65c822-a96d-4055-b76e-96ae7610e9ed-kube-api-access-rtkmd\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:52.960387 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.960366 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e65c822-a96d-4055-b76e-96ae7610e9ed-data-volume\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:52.960486 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.960399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e65c822-a96d-4055-b76e-96ae7610e9ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:52.960525 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.960475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e65c822-a96d-4055-b76e-96ae7610e9ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:52.979682 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:52.979652 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f57fbcb78-zrskt"] Jun 02 14:46:52.979825 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:46:52.979806 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-mh9n2 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" podUID="5ea793b6-0aa0-47e2-8260-42daf9c84c96" Jun 02 14:46:53.061054 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-certificates\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.061233 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061082 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e65c822-a96d-4055-b76e-96ae7610e9ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:53.061233 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ea793b6-0aa0-47e2-8260-42daf9c84c96-ca-trust-extracted\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.061233 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061153 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e65c822-a96d-4055-b76e-96ae7610e9ed-crio-socket\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:53.061233 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-tls\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.061470 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061295 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e65c822-a96d-4055-b76e-96ae7610e9ed-crio-socket\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:53.061470 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061351 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-image-registry-private-configuration\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.061470 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061386 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-installation-pull-secrets\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.061470 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-trusted-ca\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.061656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061506 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rtkmd\" (UniqueName: \"kubernetes.io/projected/8e65c822-a96d-4055-b76e-96ae7610e9ed-kube-api-access-rtkmd\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:53.061656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-bound-sa-token\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.061656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh9n2\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-kube-api-access-mh9n2\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.061656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061565 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e65c822-a96d-4055-b76e-96ae7610e9ed-data-volume\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:53.061656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061602 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e65c822-a96d-4055-b76e-96ae7610e9ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:53.061656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061605 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e65c822-a96d-4055-b76e-96ae7610e9ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:53.061936 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.061788 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e65c822-a96d-4055-b76e-96ae7610e9ed-data-volume\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:53.064000 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.063981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e65c822-a96d-4055-b76e-96ae7610e9ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:53.072669 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.072639 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtkmd\" (UniqueName: \"kubernetes.io/projected/8e65c822-a96d-4055-b76e-96ae7610e9ed-kube-api-access-rtkmd\") pod \"insights-runtime-extractor-hpbxk\" (UID: \"8e65c822-a96d-4055-b76e-96ae7610e9ed\") " pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:53.155436 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.155344 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hpbxk" Jun 02 14:46:53.163960 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.162321 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-bound-sa-token\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.163960 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.162372 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mh9n2\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-kube-api-access-mh9n2\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.163960 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.162413 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-certificates\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.163960 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.162458 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ea793b6-0aa0-47e2-8260-42daf9c84c96-ca-trust-extracted\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.163960 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.162507 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-tls\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.163960 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.162545 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-image-registry-private-configuration\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.163960 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.162573 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-installation-pull-secrets\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.163960 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.162600 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-trusted-ca\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.163960 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.163567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-trusted-ca\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.164843 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.164815 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-certificates\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.165638 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.165610 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ea793b6-0aa0-47e2-8260-42daf9c84c96-ca-trust-extracted\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.167792 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.167761 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-tls\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.168227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.168207 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-image-registry-private-configuration\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.168762 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.168740 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-installation-pull-secrets\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.174571 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.174543 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-bound-sa-token\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.174816 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.174793 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh9n2\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-kube-api-access-mh9n2\") pod \"image-registry-7f57fbcb78-zrskt\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.281201 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.281166 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hpbxk"] Jun 02 14:46:53.284470 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:46:53.284437 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e65c822_a96d_4055_b76e_96ae7610e9ed.slice/crio-35a938d59eb2228002851de63e457287d43e6fe4065ffb9e232aade14b6298e2 WatchSource:0}: Error finding container 35a938d59eb2228002851de63e457287d43e6fe4065ffb9e232aade14b6298e2: Status 404 returned error can't find the container with id 35a938d59eb2228002851de63e457287d43e6fe4065ffb9e232aade14b6298e2 Jun 02 14:46:53.610791 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.610765 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.610964 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.610759 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hpbxk" event={"ID":"8e65c822-a96d-4055-b76e-96ae7610e9ed","Type":"ContainerStarted","Data":"46f6480aa55fff9bf15f3371f452f70ff6ad411a7573fab2ce5377bc81384630"} Jun 02 14:46:53.610964 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.610876 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hpbxk" event={"ID":"8e65c822-a96d-4055-b76e-96ae7610e9ed","Type":"ContainerStarted","Data":"35a938d59eb2228002851de63e457287d43e6fe4065ffb9e232aade14b6298e2"} Jun 02 14:46:53.614717 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.614700 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:53.767606 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.767575 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-bound-sa-token\") pod \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " Jun 02 14:46:53.767754 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.767614 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-installation-pull-secrets\") pod \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " Jun 02 14:46:53.767754 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.767654 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-tls\") pod \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " Jun 02 14:46:53.767754 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.767682 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-certificates\") pod \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " Jun 02 14:46:53.767754 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.767727 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-trusted-ca\") pod \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " Jun 02 14:46:53.768012 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.767761 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-image-registry-private-configuration\") pod \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " Jun 02 14:46:53.768012 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.767787 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ea793b6-0aa0-47e2-8260-42daf9c84c96-ca-trust-extracted\") pod \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " Jun 02 14:46:53.768012 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.767836 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh9n2\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-kube-api-access-mh9n2\") pod \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\" (UID: \"5ea793b6-0aa0-47e2-8260-42daf9c84c96\") " Jun 02 14:46:53.768265 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.768207 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5ea793b6-0aa0-47e2-8260-42daf9c84c96" (UID: "5ea793b6-0aa0-47e2-8260-42daf9c84c96"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:46:53.768627 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.768373 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5ea793b6-0aa0-47e2-8260-42daf9c84c96" (UID: "5ea793b6-0aa0-47e2-8260-42daf9c84c96"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:46:53.768627 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.768377 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ea793b6-0aa0-47e2-8260-42daf9c84c96-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5ea793b6-0aa0-47e2-8260-42daf9c84c96" (UID: "5ea793b6-0aa0-47e2-8260-42daf9c84c96"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 14:46:53.770205 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.770178 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5ea793b6-0aa0-47e2-8260-42daf9c84c96" (UID: "5ea793b6-0aa0-47e2-8260-42daf9c84c96"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:46:53.770608 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.770584 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5ea793b6-0aa0-47e2-8260-42daf9c84c96" (UID: "5ea793b6-0aa0-47e2-8260-42daf9c84c96"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:46:53.770681 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.770589 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-kube-api-access-mh9n2" (OuterVolumeSpecName: "kube-api-access-mh9n2") pod "5ea793b6-0aa0-47e2-8260-42daf9c84c96" (UID: "5ea793b6-0aa0-47e2-8260-42daf9c84c96"). InnerVolumeSpecName "kube-api-access-mh9n2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:46:53.770681 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.770605 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5ea793b6-0aa0-47e2-8260-42daf9c84c96" (UID: "5ea793b6-0aa0-47e2-8260-42daf9c84c96"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:46:53.770681 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.770616 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5ea793b6-0aa0-47e2-8260-42daf9c84c96" (UID: "5ea793b6-0aa0-47e2-8260-42daf9c84c96"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:46:53.869366 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.869268 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh9n2\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-kube-api-access-mh9n2\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:46:53.869366 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.869296 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-bound-sa-token\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:46:53.869366 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.869325 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-installation-pull-secrets\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:46:53.869366 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.869334 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-tls\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:46:53.869366 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.869343 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-registry-certificates\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:46:53.869366 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.869353 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ea793b6-0aa0-47e2-8260-42daf9c84c96-trusted-ca\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:46:53.869366 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.869363 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ea793b6-0aa0-47e2-8260-42daf9c84c96-image-registry-private-configuration\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:46:53.869366 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:53.869372 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ea793b6-0aa0-47e2-8260-42daf9c84c96-ca-trust-extracted\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:46:54.614609 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:54.614579 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f57fbcb78-zrskt" Jun 02 14:46:54.614609 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:54.614597 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hpbxk" event={"ID":"8e65c822-a96d-4055-b76e-96ae7610e9ed","Type":"ContainerStarted","Data":"9f4a3a1c4030e5014272033cd82fdde4851cd9925b7e3a95be273449ec4b6b6d"} Jun 02 14:46:54.645887 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:54.645853 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f57fbcb78-zrskt"] Jun 02 14:46:54.649113 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:54.649085 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f57fbcb78-zrskt"] Jun 02 14:46:55.083911 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:55.083874 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ea793b6-0aa0-47e2-8260-42daf9c84c96" path="/var/lib/kubelet/pods/5ea793b6-0aa0-47e2-8260-42daf9c84c96/volumes" Jun 02 14:46:56.621030 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:56.620998 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hpbxk" event={"ID":"8e65c822-a96d-4055-b76e-96ae7610e9ed","Type":"ContainerStarted","Data":"405530355f1d35376353dcab50992024ecaaa5500bba10eec50b87251a527c05"} Jun 02 14:46:56.638757 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:46:56.638715 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hpbxk" podStartSLOduration=2.238793393 podStartE2EDuration="4.638701799s" podCreationTimestamp="2026-06-02 14:46:52 +0000 UTC" firstStartedPulling="2026-06-02 14:46:53.335160122 +0000 UTC m=+134.843062740" lastFinishedPulling="2026-06-02 14:46:55.735068529 +0000 UTC m=+137.242971146" observedRunningTime="2026-06-02 14:46:56.638242548 +0000 UTC m=+138.146145190" watchObservedRunningTime="2026-06-02 14:46:56.638701799 +0000 UTC m=+138.146604488" Jun 02 14:47:02.196048 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:02.196007 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" podUID="abbd4674-6e5a-4ebb-9913-5519498b80a7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 14:47:05.624925 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.624890 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qkpwt"] Jun 02 14:47:05.628239 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.628218 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.631039 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.631001 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 14:47:05.631131 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.631051 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 14:47:05.631131 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.631085 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 14:47:05.631232 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.631129 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 14:47:05.631232 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.631143 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2fbq8\"" Jun 02 14:47:05.631232 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.631163 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 14:47:05.632039 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.632022 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 14:47:05.648525 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.648489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-root\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.648625 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.648562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsq57\" (UniqueName: \"kubernetes.io/projected/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-kube-api-access-jsq57\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.648625 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.648596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.648625 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.648618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-metrics-client-ca\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.648723 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.648643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-tls\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.648723 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.648680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.648723 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.648715 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-textfile\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.648812 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.648748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-sys\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.648812 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.648779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-wtmp\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.749807 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.749781 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsq57\" (UniqueName: \"kubernetes.io/projected/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-kube-api-access-jsq57\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.749977 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.749822 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.749977 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.749845 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-metrics-client-ca\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.749977 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.749903 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-tls\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.749977 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.749944 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.749977 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.749973 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-textfile\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.750215 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.750005 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-sys\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.750215 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.750039 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-wtmp\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.750215 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.750070 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-root\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.750215 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.750098 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-sys\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.750426 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.750218 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-root\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.750426 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.750255 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-wtmp\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.750494 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.750458 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-textfile\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.750537 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.750486 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-metrics-client-ca\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.750537 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.750523 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.752557 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.752526 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.752656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.752629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-node-exporter-tls\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.760449 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.760428 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsq57\" (UniqueName: \"kubernetes.io/projected/67de0abf-cb2e-4562-a98b-0f80fdc8b0bb-kube-api-access-jsq57\") pod \"node-exporter-qkpwt\" (UID: \"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb\") " pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.937013 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:05.936987 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qkpwt" Jun 02 14:47:05.945967 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:47:05.945940 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67de0abf_cb2e_4562_a98b_0f80fdc8b0bb.slice/crio-e05b6ef88bf84025215b61735abe632b817162cd397589a073f76e090e860ebb WatchSource:0}: Error finding container e05b6ef88bf84025215b61735abe632b817162cd397589a073f76e090e860ebb: Status 404 returned error can't find the container with id e05b6ef88bf84025215b61735abe632b817162cd397589a073f76e090e860ebb Jun 02 14:47:06.649377 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:06.648330 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkpwt" event={"ID":"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb","Type":"ContainerStarted","Data":"e05b6ef88bf84025215b61735abe632b817162cd397589a073f76e090e860ebb"} Jun 02 14:47:07.612579 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.612543 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59b657c57b-7q5t7"] Jun 02 14:47:07.615710 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.615694 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.619245 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.619225 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rqck5\"" Jun 02 14:47:07.619370 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.619233 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 14:47:07.620538 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.620518 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 14:47:07.620656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.620516 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-44s06gkjdi54g\"" Jun 02 14:47:07.620656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.620549 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 14:47:07.620656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.620555 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 14:47:07.620656 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.620549 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 14:47:07.632879 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.632841 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59b657c57b-7q5t7"] Jun 02 14:47:07.651523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.651494 2564 generic.go:358] "Generic (PLEG): container finished" podID="67de0abf-cb2e-4562-a98b-0f80fdc8b0bb" containerID="0c2658968aefaa627ae358325ca7326eed9b31986b54f6be3b96017a0a660440" exitCode=0 Jun 02 14:47:07.651829 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.651531 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkpwt" event={"ID":"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb","Type":"ContainerDied","Data":"0c2658968aefaa627ae358325ca7326eed9b31986b54f6be3b96017a0a660440"} Jun 02 14:47:07.665719 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.665243 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9slgx\" (UniqueName: \"kubernetes.io/projected/95a702ef-8e82-4d52-b28b-df156b9d7acc-kube-api-access-9slgx\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.665719 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.665359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.665719 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.665391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95a702ef-8e82-4d52-b28b-df156b9d7acc-metrics-client-ca\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.665719 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.665433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.665719 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.665461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-tls\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.665719 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.665486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.665719 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.665553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.665719 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.665598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-grpc-tls\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.766239 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.766213 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.766360 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.766254 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-grpc-tls\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.766360 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.766292 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9slgx\" (UniqueName: \"kubernetes.io/projected/95a702ef-8e82-4d52-b28b-df156b9d7acc-kube-api-access-9slgx\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.766478 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.766373 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.766478 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.766401 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95a702ef-8e82-4d52-b28b-df156b9d7acc-metrics-client-ca\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.766629 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.766594 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.766726 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.766647 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-tls\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.766726 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.766677 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.767344 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.767272 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95a702ef-8e82-4d52-b28b-df156b9d7acc-metrics-client-ca\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.769002 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.768968 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.769271 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.769246 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-grpc-tls\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.769549 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.769525 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.769685 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.769669 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.769769 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.769736 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-tls\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.769826 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.769789 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/95a702ef-8e82-4d52-b28b-df156b9d7acc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.777188 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.777168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9slgx\" (UniqueName: \"kubernetes.io/projected/95a702ef-8e82-4d52-b28b-df156b9d7acc-kube-api-access-9slgx\") pod \"thanos-querier-59b657c57b-7q5t7\" (UID: \"95a702ef-8e82-4d52-b28b-df156b9d7acc\") " pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:07.924860 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:07.924825 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:08.051521 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:08.051230 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59b657c57b-7q5t7"] Jun 02 14:47:08.053730 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:47:08.053704 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a702ef_8e82_4d52_b28b_df156b9d7acc.slice/crio-bf94ccfd27d009906a554f9e11d12b8509546bc57febc59ede530cbf21fab7f9 WatchSource:0}: Error finding container bf94ccfd27d009906a554f9e11d12b8509546bc57febc59ede530cbf21fab7f9: Status 404 returned error can't find the container with id bf94ccfd27d009906a554f9e11d12b8509546bc57febc59ede530cbf21fab7f9 Jun 02 14:47:08.656922 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:08.656887 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkpwt" event={"ID":"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb","Type":"ContainerStarted","Data":"efee4d040bed2994cf15e9c6152f4d65ad1dbf985e5ff7a171a1b10e575d8fbd"} Jun 02 14:47:08.656922 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:08.656928 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkpwt" event={"ID":"67de0abf-cb2e-4562-a98b-0f80fdc8b0bb","Type":"ContainerStarted","Data":"0f9dfb57b39514241a5cc7f509c8382f6f4ad51727c7b2732e0ed0e39bff9413"} Jun 02 14:47:08.658097 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:08.658072 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" event={"ID":"95a702ef-8e82-4d52-b28b-df156b9d7acc","Type":"ContainerStarted","Data":"bf94ccfd27d009906a554f9e11d12b8509546bc57febc59ede530cbf21fab7f9"} Jun 02 14:47:08.676249 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:08.676193 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qkpwt" podStartSLOduration=2.670393662 podStartE2EDuration="3.676176629s" podCreationTimestamp="2026-06-02 14:47:05 +0000 UTC" firstStartedPulling="2026-06-02 14:47:05.948033813 +0000 UTC m=+147.455936432" lastFinishedPulling="2026-06-02 14:47:06.953816781 +0000 UTC m=+148.461719399" observedRunningTime="2026-06-02 14:47:08.675114037 +0000 UTC m=+150.183016689" watchObservedRunningTime="2026-06-02 14:47:08.676176629 +0000 UTC m=+150.184079266" Jun 02 14:47:10.664724 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:10.664692 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" event={"ID":"95a702ef-8e82-4d52-b28b-df156b9d7acc","Type":"ContainerStarted","Data":"a9676bf9c9d76835bada576073feeae47003baf0a991292d802159b84c63fe89"} Jun 02 14:47:10.664724 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:10.664727 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" event={"ID":"95a702ef-8e82-4d52-b28b-df156b9d7acc","Type":"ContainerStarted","Data":"dc8de7c8be35eed0e614c0f0e6015a9020b5be60e0444b63da575a0722986ed8"} Jun 02 14:47:10.665144 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:10.664737 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" event={"ID":"95a702ef-8e82-4d52-b28b-df156b9d7acc","Type":"ContainerStarted","Data":"f09830b7b5e89dc27a9cbe402c93e65c1b6046d9c0937c9ab671ba7a36098def"} Jun 02 14:47:11.669922 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.669827 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" event={"ID":"95a702ef-8e82-4d52-b28b-df156b9d7acc","Type":"ContainerStarted","Data":"c2145cf2875e1e9cac07b2f5f673417998a6a4219ae0258c39b552f0985eff9c"} Jun 02 14:47:11.669922 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.669861 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" event={"ID":"95a702ef-8e82-4d52-b28b-df156b9d7acc","Type":"ContainerStarted","Data":"e743b1129670651cfb35dbe82f161d3d706543e154464a0371a3355d00faa06a"} Jun 02 14:47:11.669922 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.669871 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" event={"ID":"95a702ef-8e82-4d52-b28b-df156b9d7acc","Type":"ContainerStarted","Data":"cd7ab8c6eacb25d3533b2347418bcf2d3672a425e1e7bfa143056079ecd83710"} Jun 02 14:47:11.670507 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.669980 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:11.692730 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.692667 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" podStartSLOduration=1.545555045 podStartE2EDuration="4.69264788s" podCreationTimestamp="2026-06-02 14:47:07 +0000 UTC" firstStartedPulling="2026-06-02 14:47:08.055504432 +0000 UTC m=+149.563407050" lastFinishedPulling="2026-06-02 14:47:11.202597264 +0000 UTC m=+152.710499885" observedRunningTime="2026-06-02 14:47:11.690713333 +0000 UTC m=+153.198615974" watchObservedRunningTime="2026-06-02 14:47:11.69264788 +0000 UTC m=+153.200550521" Jun 02 14:47:11.811778 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.811748 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:47:11.815254 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.815238 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.818227 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.818207 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 14:47:11.818364 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.818255 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 14:47:11.818428 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.818381 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 14:47:11.819516 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.819491 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 14:47:11.819611 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.819520 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 14:47:11.819611 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.819530 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aciloc5gv6h82\"" Jun 02 14:47:11.819721 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.819702 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6wfwl\"" Jun 02 14:47:11.819927 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.819773 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 14:47:11.819927 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.819810 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 14:47:11.819927 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.819837 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 14:47:11.819927 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.819773 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 14:47:11.820160 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.820018 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 14:47:11.820382 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.820364 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 14:47:11.820382 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.820381 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 14:47:11.822060 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.822042 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 14:47:11.838322 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.829762 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:47:11.897851 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.897792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.897851 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.897857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-config\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898084 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.897884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-config-out\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898084 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.897910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898084 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.897933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898084 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898084 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898084 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898292 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898292 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898147 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898292 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898292 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898292 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898215 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898292 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898243 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898292 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898284 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-web-config\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.898520 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.898422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvsr5\" (UniqueName: \"kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-kube-api-access-fvsr5\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.999597 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.999562 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.999597 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.999599 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.999751 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.999618 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvsr5\" (UniqueName: \"kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-kube-api-access-fvsr5\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.999751 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.999648 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.999751 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.999687 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-config\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.999751 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.999712 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-config-out\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.999751 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.999736 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.999949 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.999758 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:11.999949 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:11.999786 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.000042 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.000019 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.000092 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.000037 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.000092 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.000059 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.000092 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.000086 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.000201 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.000139 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.000201 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.000176 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.000271 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.000205 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.000271 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.000236 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.000406 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.000285 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.000406 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.000344 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-web-config\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.002559 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.002527 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.002764 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.002735 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.003332 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.003266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.003870 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.003700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.003870 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.003820 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.004258 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.004237 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-config-out\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.004444 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.004272 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.004598 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.004577 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.004776 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.004732 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.004776 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.004764 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-config\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.005469 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.005445 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.005469 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.005502 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-web-config\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.005772 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.005751 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.005996 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.005971 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.006654 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.006632 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.007438 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.007413 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.008185 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.008166 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvsr5\" (UniqueName: \"kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-kube-api-access-fvsr5\") pod \"prometheus-k8s-0\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.125226 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.125189 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:12.196192 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.196158 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" podUID="abbd4674-6e5a-4ebb-9913-5519498b80a7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 14:47:12.196349 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.196226 2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" Jun 02 14:47:12.196731 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.196702 2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"99c167a40611bb4fc8c29198d7c6d55af0474360b874a89d125abb2d4ed54326"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 14:47:12.196785 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.196751 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" podUID="abbd4674-6e5a-4ebb-9913-5519498b80a7" containerName="service-proxy" containerID="cri-o://99c167a40611bb4fc8c29198d7c6d55af0474360b874a89d125abb2d4ed54326" gracePeriod=30 Jun 02 14:47:12.256164 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.256143 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:47:12.258096 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:47:12.258065 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273f8916_0850_4d18_858e_e7e701869740.slice/crio-90478b9165653e83e41073940bc61ce72c8fe0e197bfcd5b366f04f393f38de4 WatchSource:0}: Error finding container 90478b9165653e83e41073940bc61ce72c8fe0e197bfcd5b366f04f393f38de4: Status 404 returned error can't find the container with id 90478b9165653e83e41073940bc61ce72c8fe0e197bfcd5b366f04f393f38de4 Jun 02 14:47:12.675626 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.675587 2564 generic.go:358] "Generic (PLEG): container finished" podID="abbd4674-6e5a-4ebb-9913-5519498b80a7" containerID="99c167a40611bb4fc8c29198d7c6d55af0474360b874a89d125abb2d4ed54326" exitCode=2 Jun 02 14:47:12.676102 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.675670 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" event={"ID":"abbd4674-6e5a-4ebb-9913-5519498b80a7","Type":"ContainerDied","Data":"99c167a40611bb4fc8c29198d7c6d55af0474360b874a89d125abb2d4ed54326"} Jun 02 14:47:12.676102 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.675713 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-788b4877ff-wqk9c" event={"ID":"abbd4674-6e5a-4ebb-9913-5519498b80a7","Type":"ContainerStarted","Data":"fad3fa3f29cdb3721717f243f59edcd9609b07d9314e52b676072eca994cf0ab"} Jun 02 14:47:12.676985 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:12.676952 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerStarted","Data":"90478b9165653e83e41073940bc61ce72c8fe0e197bfcd5b366f04f393f38de4"} Jun 02 14:47:13.681338 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:13.681285 2564 generic.go:358] "Generic (PLEG): container finished" podID="273f8916-0850-4d18-858e-e7e701869740" containerID="a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d" exitCode=0 Jun 02 14:47:13.681693 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:13.681354 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerDied","Data":"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d"} Jun 02 14:47:16.692247 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:16.692145 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerStarted","Data":"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667"} Jun 02 14:47:16.692247 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:16.692189 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerStarted","Data":"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f"} Jun 02 14:47:16.692247 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:16.692206 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerStarted","Data":"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6"} Jun 02 14:47:16.692247 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:16.692222 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerStarted","Data":"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec"} Jun 02 14:47:17.357236 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:47:17.357143 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8vdkd" podUID="bad3a9fa-8660-4a5e-9a2f-1337fc62bae8" Jun 02 14:47:17.379366 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:47:17.379332 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-twx4g" podUID="0403ed56-b191-4b5c-9fe0-606899a8db88" Jun 02 14:47:17.686584 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:17.686558 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59b657c57b-7q5t7" Jun 02 14:47:17.697335 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:17.697285 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerStarted","Data":"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad"} Jun 02 14:47:17.697682 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:17.697342 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerStarted","Data":"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4"} Jun 02 14:47:17.697682 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:17.697343 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vdkd" Jun 02 14:47:17.747155 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:17.747100 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.706375052 podStartE2EDuration="6.747086548s" podCreationTimestamp="2026-06-02 14:47:11 +0000 UTC" firstStartedPulling="2026-06-02 14:47:12.301721049 +0000 UTC m=+153.809623667" lastFinishedPulling="2026-06-02 14:47:16.342432527 +0000 UTC m=+157.850335163" observedRunningTime="2026-06-02 14:47:17.745733997 +0000 UTC m=+159.253636637" watchObservedRunningTime="2026-06-02 14:47:17.747086548 +0000 UTC m=+159.254989187" Jun 02 14:47:22.125478 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:22.125416 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:47:22.289621 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:22.289577 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:47:22.291968 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:22.291936 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bad3a9fa-8660-4a5e-9a2f-1337fc62bae8-metrics-tls\") pod \"dns-default-8vdkd\" (UID: \"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8\") " pod="openshift-dns/dns-default-8vdkd" Jun 02 14:47:22.390609 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:22.390530 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:47:22.392960 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:22.392933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0403ed56-b191-4b5c-9fe0-606899a8db88-cert\") pod \"ingress-canary-twx4g\" (UID: \"0403ed56-b191-4b5c-9fe0-606899a8db88\") " pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:47:22.500534 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:22.500506 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rr6kw\"" Jun 02 14:47:22.507864 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:22.507845 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vdkd" Jun 02 14:47:22.632484 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:22.632365 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vdkd"] Jun 02 14:47:22.635013 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:47:22.634980 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad3a9fa_8660_4a5e_9a2f_1337fc62bae8.slice/crio-5eee64e3a28fa86cb1b768729b3a48ededba21dee19760baf0c76766c7622a25 WatchSource:0}: Error finding container 5eee64e3a28fa86cb1b768729b3a48ededba21dee19760baf0c76766c7622a25: Status 404 returned error can't find the container with id 5eee64e3a28fa86cb1b768729b3a48ededba21dee19760baf0c76766c7622a25 Jun 02 14:47:22.715712 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:22.715681 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vdkd" event={"ID":"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8","Type":"ContainerStarted","Data":"5eee64e3a28fa86cb1b768729b3a48ededba21dee19760baf0c76766c7622a25"} Jun 02 14:47:24.723572 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:24.723539 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vdkd" event={"ID":"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8","Type":"ContainerStarted","Data":"0ec6503446dd06201bef74f93a143c33d39bc3a3440e9e10d91c32646d39bd2c"} Jun 02 14:47:24.723572 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:24.723574 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vdkd" event={"ID":"bad3a9fa-8660-4a5e-9a2f-1337fc62bae8","Type":"ContainerStarted","Data":"322fb4926f1b86bc06931130fa3bda1ba0309d7e420d8bb8ab3e2b0af49434cc"} Jun 02 14:47:24.723994 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:24.723665 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8vdkd" Jun 02 14:47:24.741252 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:24.741213 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-8vdkd" podStartSLOduration=129.548100825 podStartE2EDuration="2m10.741199227s" podCreationTimestamp="2026-06-02 14:45:14 +0000 UTC" firstStartedPulling="2026-06-02 14:47:22.636812779 +0000 UTC m=+164.144715397" lastFinishedPulling="2026-06-02 14:47:23.829911161 +0000 UTC m=+165.337813799" observedRunningTime="2026-06-02 14:47:24.739681992 +0000 UTC m=+166.247584631" watchObservedRunningTime="2026-06-02 14:47:24.741199227 +0000 UTC m=+166.249101902" Jun 02 14:47:32.080413 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:32.080365 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:47:32.083399 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:32.083379 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hx8l9\"" Jun 02 14:47:32.091602 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:32.091584 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-twx4g" Jun 02 14:47:32.214717 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:32.214677 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-twx4g"] Jun 02 14:47:32.217674 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:47:32.217639 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0403ed56_b191_4b5c_9fe0_606899a8db88.slice/crio-6b8df62c16fd0f063d98ab6d6113f97ad938d4feffd9fbd177c24061e5b5edeb WatchSource:0}: Error finding container 6b8df62c16fd0f063d98ab6d6113f97ad938d4feffd9fbd177c24061e5b5edeb: Status 404 returned error can't find the container with id 6b8df62c16fd0f063d98ab6d6113f97ad938d4feffd9fbd177c24061e5b5edeb Jun 02 14:47:32.747285 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:32.747242 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-twx4g" event={"ID":"0403ed56-b191-4b5c-9fe0-606899a8db88","Type":"ContainerStarted","Data":"6b8df62c16fd0f063d98ab6d6113f97ad938d4feffd9fbd177c24061e5b5edeb"} Jun 02 14:47:34.728410 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:34.728383 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8vdkd" Jun 02 14:47:34.754354 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:34.754292 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-twx4g" event={"ID":"0403ed56-b191-4b5c-9fe0-606899a8db88","Type":"ContainerStarted","Data":"2df3519de1019b20ba150bd13eeeacb7210154c957aa71110be147224f89502f"} Jun 02 14:47:34.770067 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:34.770019 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-twx4g" podStartSLOduration=139.207605399 podStartE2EDuration="2m20.770003578s" podCreationTimestamp="2026-06-02 14:45:14 +0000 UTC" firstStartedPulling="2026-06-02 14:47:32.219440428 +0000 UTC m=+173.727343046" lastFinishedPulling="2026-06-02 14:47:33.781838607 +0000 UTC m=+175.289741225" observedRunningTime="2026-06-02 14:47:34.768486638 +0000 UTC m=+176.276389279" watchObservedRunningTime="2026-06-02 14:47:34.770003578 +0000 UTC m=+176.277906215" Jun 02 14:47:38.766383 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:38.766345 2564 generic.go:358] "Generic (PLEG): container finished" podID="3de22f5b-6efd-43c1-b69a-ee923a3160e4" containerID="aa2c6cc5aefa63b59828dc47cae1d708dbaa577d582444caaf05bf1fce9587ac" exitCode=1 Jun 02 14:47:38.766742 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:38.766416 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" event={"ID":"3de22f5b-6efd-43c1-b69a-ee923a3160e4","Type":"ContainerDied","Data":"aa2c6cc5aefa63b59828dc47cae1d708dbaa577d582444caaf05bf1fce9587ac"} Jun 02 14:47:38.766795 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:38.766763 2564 scope.go:117] "RemoveContainer" containerID="aa2c6cc5aefa63b59828dc47cae1d708dbaa577d582444caaf05bf1fce9587ac" Jun 02 14:47:39.430060 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:39.430027 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:47:39.771433 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:39.771344 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" event={"ID":"3de22f5b-6efd-43c1-b69a-ee923a3160e4","Type":"ContainerStarted","Data":"8cfe4ff7b9131e84b438ceffaefb5d804f8f9bc56eae1a562107a86033a89bde"} Jun 02 14:47:39.771786 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:39.771543 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:47:39.772168 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:39.772149 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756c47d7f7-dvd8p" Jun 02 14:47:44.937967 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:47:44.937937 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-twx4g_0403ed56-b191-4b5c-9fe0-606899a8db88/serve-healthcheck-canary/0.log" Jun 02 14:48:12.126071 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:12.126021 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:12.147926 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:12.147897 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:12.880503 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:12.880476 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:30.080546 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.080511 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:48:30.081161 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.080995 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy" containerID="cri-o://561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4" gracePeriod=600 Jun 02 14:48:30.081161 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.081026 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy-thanos" containerID="cri-o://230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad" gracePeriod=600 Jun 02 14:48:30.081161 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.081051 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy-web" containerID="cri-o://602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667" gracePeriod=600 Jun 02 14:48:30.081161 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.081072 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="thanos-sidecar" containerID="cri-o://e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f" gracePeriod=600 Jun 02 14:48:30.081390 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.081075 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="config-reloader" containerID="cri-o://63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6" gracePeriod=600 Jun 02 14:48:30.081390 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.080977 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="prometheus" containerID="cri-o://e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec" gracePeriod=600 Jun 02 14:48:30.316064 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.316042 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:30.426576 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.426548 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-kubelet-serving-ca-bundle\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.426735 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.426583 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.426735 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.426610 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-serving-certs-ca-bundle\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.426735 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.426637 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-db\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.426910 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.426773 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-metrics-client-ca\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.426910 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.426815 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-web-config\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.426910 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.426865 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-config-out\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.426910 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.426894 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-rulefiles-0\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.427093 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.426928 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-trusted-ca-bundle\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.427093 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.426951 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-kube-rbac-proxy\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.427093 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.426990 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-thanos-prometheus-http-client-file\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.427093 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.427017 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-tls\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.427093 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.427042 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-tls-assets\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.427093 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.427061 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:48:30.427093 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.427070 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:48:30.427478 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.427391 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:48:30.427598 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.427501 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvsr5\" (UniqueName: \"kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-kube-api-access-fvsr5\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.428740 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.427672 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-config\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.428740 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.427707 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.428740 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.427752 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-grpc-tls\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.428740 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.427780 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-metrics-client-certs\") pod \"273f8916-0850-4d18-858e-e7e701869740\" (UID: \"273f8916-0850-4d18-858e-e7e701869740\") " Jun 02 14:48:30.428740 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.428002 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.428740 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.428000 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 14:48:30.428740 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.428019 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.428740 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.428035 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.428740 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.428434 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:48:30.430054 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.429953 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:48:30.430054 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.430024 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:48:30.430268 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.430082 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:48:30.430711 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.430678 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:48:30.431347 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.431280 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-kube-api-access-fvsr5" (OuterVolumeSpecName: "kube-api-access-fvsr5") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "kube-api-access-fvsr5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:48:30.431462 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.431412 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:48:30.431638 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.431613 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:48:30.431733 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.431671 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:48:30.431840 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.431823 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-config" (OuterVolumeSpecName: "config") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:48:30.432342 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.432293 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:48:30.432443 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.432382 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:48:30.432753 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.432734 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-config-out" (OuterVolumeSpecName: "config-out") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 14:48:30.440552 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.440533 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-web-config" (OuterVolumeSpecName: "web-config") pod "273f8916-0850-4d18-858e-e7e701869740" (UID: "273f8916-0850-4d18-858e-e7e701869740"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:48:30.529107 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529063 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529107 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529101 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529107 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529113 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-tls-assets\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529107 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529124 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvsr5\" (UniqueName: \"kubernetes.io/projected/273f8916-0850-4d18-858e-e7e701869740-kube-api-access-fvsr5\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529381 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529133 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-config\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529381 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529142 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529381 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529152 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-grpc-tls\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529381 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529160 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-metrics-client-certs\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529381 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529169 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529381 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529179 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-db\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529381 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529187 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-configmap-metrics-client-ca\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529381 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529195 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-web-config\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529381 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529204 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/273f8916-0850-4d18-858e-e7e701869740-config-out\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529381 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529213 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/273f8916-0850-4d18-858e-e7e701869740-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.529381 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.529221 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/273f8916-0850-4d18-858e-e7e701869740-secret-kube-rbac-proxy\") on node \"ip-10-0-133-192.ec2.internal\" DevicePath \"\"" Jun 02 14:48:30.916364 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916259 2564 generic.go:358] "Generic (PLEG): container finished" podID="273f8916-0850-4d18-858e-e7e701869740" containerID="230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad" exitCode=0 Jun 02 14:48:30.916364 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916293 2564 generic.go:358] "Generic (PLEG): container finished" podID="273f8916-0850-4d18-858e-e7e701869740" containerID="561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4" exitCode=0 Jun 02 14:48:30.916364 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916321 2564 generic.go:358] "Generic (PLEG): container finished" podID="273f8916-0850-4d18-858e-e7e701869740" containerID="602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667" exitCode=0 Jun 02 14:48:30.916364 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916332 2564 generic.go:358] "Generic (PLEG): container finished" podID="273f8916-0850-4d18-858e-e7e701869740" containerID="e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f" exitCode=0 Jun 02 14:48:30.916364 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916340 2564 generic.go:358] "Generic (PLEG): container finished" podID="273f8916-0850-4d18-858e-e7e701869740" containerID="63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6" exitCode=0 Jun 02 14:48:30.916364 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916348 2564 generic.go:358] "Generic (PLEG): container finished" podID="273f8916-0850-4d18-858e-e7e701869740" containerID="e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec" exitCode=0 Jun 02 14:48:30.916364 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916345 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerDied","Data":"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad"} Jun 02 14:48:30.916689 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916386 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerDied","Data":"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4"} Jun 02 14:48:30.916689 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916398 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerDied","Data":"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667"} Jun 02 14:48:30.916689 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916407 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerDied","Data":"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f"} Jun 02 14:48:30.916689 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916420 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerDied","Data":"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6"} Jun 02 14:48:30.916689 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916427 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:30.916689 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916438 2564 scope.go:117] "RemoveContainer" containerID="230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad" Jun 02 14:48:30.916689 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916429 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerDied","Data":"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec"} Jun 02 14:48:30.916689 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.916535 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"273f8916-0850-4d18-858e-e7e701869740","Type":"ContainerDied","Data":"90478b9165653e83e41073940bc61ce72c8fe0e197bfcd5b366f04f393f38de4"} Jun 02 14:48:30.924263 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.924238 2564 scope.go:117] "RemoveContainer" containerID="561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4" Jun 02 14:48:30.931231 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.931214 2564 scope.go:117] "RemoveContainer" containerID="602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667" Jun 02 14:48:30.937572 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.937548 2564 scope.go:117] "RemoveContainer" containerID="e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f" Jun 02 14:48:30.940216 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.940196 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:48:30.944293 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.944269 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:48:30.944874 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.944853 2564 scope.go:117] "RemoveContainer" containerID="63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6" Jun 02 14:48:30.951427 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.951409 2564 scope.go:117] "RemoveContainer" containerID="e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec" Jun 02 14:48:30.958139 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.958110 2564 scope.go:117] "RemoveContainer" containerID="a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d" Jun 02 14:48:30.964691 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.964676 2564 scope.go:117] "RemoveContainer" containerID="230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad" Jun 02 14:48:30.964936 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:48:30.964920 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": container with ID starting with 230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad not found: ID does not exist" containerID="230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad" Jun 02 14:48:30.964982 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.964943 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad"} err="failed to get container status \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": rpc error: code = NotFound desc = could not find container \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": container with ID starting with 230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad not found: ID does not exist" Jun 02 14:48:30.964982 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.964961 2564 scope.go:117] "RemoveContainer" containerID="561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4" Jun 02 14:48:30.965180 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:48:30.965164 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": container with ID starting with 561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4 not found: ID does not exist" containerID="561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4" Jun 02 14:48:30.965219 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.965184 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4"} err="failed to get container status \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": rpc error: code = NotFound desc = could not find container \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": container with ID starting with 561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4 not found: ID does not exist" Jun 02 14:48:30.965219 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.965199 2564 scope.go:117] "RemoveContainer" containerID="602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667" Jun 02 14:48:30.965458 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:48:30.965442 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": container with ID starting with 602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667 not found: ID does not exist" containerID="602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667" Jun 02 14:48:30.965502 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.965462 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667"} err="failed to get container status \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": rpc error: code = NotFound desc = could not find container \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": container with ID starting with 602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667 not found: ID does not exist" Jun 02 14:48:30.965502 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.965475 2564 scope.go:117] "RemoveContainer" containerID="e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f" Jun 02 14:48:30.965677 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:48:30.965661 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": container with ID starting with e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f not found: ID does not exist" containerID="e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f" Jun 02 14:48:30.965716 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.965683 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f"} err="failed to get container status \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": rpc error: code = NotFound desc = could not find container \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": container with ID starting with e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f not found: ID does not exist" Jun 02 14:48:30.965716 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.965699 2564 scope.go:117] "RemoveContainer" containerID="63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6" Jun 02 14:48:30.965925 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:48:30.965910 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": container with ID starting with 63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6 not found: ID does not exist" containerID="63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6" Jun 02 14:48:30.965979 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.965927 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6"} err="failed to get container status \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": rpc error: code = NotFound desc = could not find container \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": container with ID starting with 63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6 not found: ID does not exist" Jun 02 14:48:30.965979 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.965940 2564 scope.go:117] "RemoveContainer" containerID="e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec" Jun 02 14:48:30.966139 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:48:30.966124 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": container with ID starting with e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec not found: ID does not exist" containerID="e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec" Jun 02 14:48:30.966189 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.966141 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec"} err="failed to get container status \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": rpc error: code = NotFound desc = could not find container \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": container with ID starting with e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec not found: ID does not exist" Jun 02 14:48:30.966232 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.966189 2564 scope.go:117] "RemoveContainer" containerID="a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d" Jun 02 14:48:30.966443 ip-10-0-133-192 kubenswrapper[2564]: E0602 14:48:30.966406 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": container with ID starting with a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d not found: ID does not exist" containerID="a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d" Jun 02 14:48:30.966538 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.966441 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d"} err="failed to get container status \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": rpc error: code = NotFound desc = could not find container \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": container with ID starting with a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d not found: ID does not exist" Jun 02 14:48:30.966538 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.966460 2564 scope.go:117] "RemoveContainer" containerID="230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad" Jun 02 14:48:30.966777 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.966753 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad"} err="failed to get container status \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": rpc error: code = NotFound desc = could not find container \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": container with ID starting with 230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad not found: ID does not exist" Jun 02 14:48:30.966870 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.966779 2564 scope.go:117] "RemoveContainer" containerID="561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4" Jun 02 14:48:30.967061 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.967032 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4"} err="failed to get container status \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": rpc error: code = NotFound desc = could not find container \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": container with ID starting with 561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4 not found: ID does not exist" Jun 02 14:48:30.967061 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.967060 2564 scope.go:117] "RemoveContainer" containerID="602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667" Jun 02 14:48:30.967380 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.967357 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667"} err="failed to get container status \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": rpc error: code = NotFound desc = could not find container \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": container with ID starting with 602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667 not found: ID does not exist" Jun 02 14:48:30.967380 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.967380 2564 scope.go:117] "RemoveContainer" containerID="e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f" Jun 02 14:48:30.967617 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.967600 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f"} err="failed to get container status \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": rpc error: code = NotFound desc = could not find container \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": container with ID starting with e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f not found: ID does not exist" Jun 02 14:48:30.967673 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.967618 2564 scope.go:117] "RemoveContainer" containerID="63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6" Jun 02 14:48:30.967872 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.967850 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6"} err="failed to get container status \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": rpc error: code = NotFound desc = could not find container \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": container with ID starting with 63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6 not found: ID does not exist" Jun 02 14:48:30.967953 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.967875 2564 scope.go:117] "RemoveContainer" containerID="e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec" Jun 02 14:48:30.968148 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968131 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec"} err="failed to get container status \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": rpc error: code = NotFound desc = could not find container \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": container with ID starting with e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec not found: ID does not exist" Jun 02 14:48:30.968148 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968148 2564 scope.go:117] "RemoveContainer" containerID="a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d" Jun 02 14:48:30.968347 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968326 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:48:30.968490 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968473 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d"} err="failed to get container status \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": rpc error: code = NotFound desc = could not find container \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": container with ID starting with a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d not found: ID does not exist" Jun 02 14:48:30.968543 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968492 2564 scope.go:117] "RemoveContainer" containerID="230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad" Jun 02 14:48:30.968617 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968605 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy-thanos" Jun 02 14:48:30.968653 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968620 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy-thanos" Jun 02 14:48:30.968653 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968630 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy" Jun 02 14:48:30.968653 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968635 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy" Jun 02 14:48:30.968653 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968646 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy-web" Jun 02 14:48:30.968794 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968655 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy-web" Jun 02 14:48:30.968794 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968670 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="config-reloader" Jun 02 14:48:30.968794 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968675 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="config-reloader" Jun 02 14:48:30.968794 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968688 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="thanos-sidecar" Jun 02 14:48:30.968794 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968696 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="thanos-sidecar" Jun 02 14:48:30.968794 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968709 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="prometheus" Jun 02 14:48:30.968794 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968717 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="prometheus" Jun 02 14:48:30.968794 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968750 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="init-config-reloader" Jun 02 14:48:30.968794 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968760 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="init-config-reloader" Jun 02 14:48:30.969130 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968810 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="config-reloader" Jun 02 14:48:30.969130 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968751 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad"} err="failed to get container status \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": rpc error: code = NotFound desc = could not find container \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": container with ID starting with 230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad not found: ID does not exist" Jun 02 14:48:30.969130 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968845 2564 scope.go:117] "RemoveContainer" containerID="561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4" Jun 02 14:48:30.969130 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968819 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="prometheus" Jun 02 14:48:30.969130 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968865 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="thanos-sidecar" Jun 02 14:48:30.969130 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968870 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy" Jun 02 14:48:30.969130 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968878 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy-thanos" Jun 02 14:48:30.969130 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.968885 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="273f8916-0850-4d18-858e-e7e701869740" containerName="kube-rbac-proxy-web" Jun 02 14:48:30.969130 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.969092 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4"} err="failed to get container status \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": rpc error: code = NotFound desc = could not find container \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": container with ID starting with 561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4 not found: ID does not exist" Jun 02 14:48:30.969130 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.969111 2564 scope.go:117] "RemoveContainer" containerID="602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667" Jun 02 14:48:30.969505 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.969368 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667"} err="failed to get container status \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": rpc error: code = NotFound desc = could not find container \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": container with ID starting with 602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667 not found: ID does not exist" Jun 02 14:48:30.969505 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.969383 2564 scope.go:117] "RemoveContainer" containerID="e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f" Jun 02 14:48:30.969619 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.969599 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f"} err="failed to get container status \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": rpc error: code = NotFound desc = could not find container \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": container with ID starting with e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f not found: ID does not exist" Jun 02 14:48:30.969655 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.969628 2564 scope.go:117] "RemoveContainer" containerID="63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6" Jun 02 14:48:30.969847 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.969833 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6"} err="failed to get container status \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": rpc error: code = NotFound desc = could not find container \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": container with ID starting with 63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6 not found: ID does not exist" Jun 02 14:48:30.969890 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.969847 2564 scope.go:117] "RemoveContainer" containerID="e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec" Jun 02 14:48:30.970052 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970037 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec"} err="failed to get container status \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": rpc error: code = NotFound desc = could not find container \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": container with ID starting with e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec not found: ID does not exist" Jun 02 14:48:30.970052 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970052 2564 scope.go:117] "RemoveContainer" containerID="a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d" Jun 02 14:48:30.970239 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970225 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d"} err="failed to get container status \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": rpc error: code = NotFound desc = could not find container \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": container with ID starting with a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d not found: ID does not exist" Jun 02 14:48:30.970274 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970244 2564 scope.go:117] "RemoveContainer" containerID="230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad" Jun 02 14:48:30.970446 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970432 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad"} err="failed to get container status \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": rpc error: code = NotFound desc = could not find container \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": container with ID starting with 230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad not found: ID does not exist" Jun 02 14:48:30.970490 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970448 2564 scope.go:117] "RemoveContainer" containerID="561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4" Jun 02 14:48:30.970625 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970612 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4"} err="failed to get container status \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": rpc error: code = NotFound desc = could not find container \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": container with ID starting with 561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4 not found: ID does not exist" Jun 02 14:48:30.970661 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970626 2564 scope.go:117] "RemoveContainer" containerID="602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667" Jun 02 14:48:30.970818 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970804 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667"} err="failed to get container status \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": rpc error: code = NotFound desc = could not find container \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": container with ID starting with 602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667 not found: ID does not exist" Jun 02 14:48:30.970851 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970819 2564 scope.go:117] "RemoveContainer" containerID="e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f" Jun 02 14:48:30.970974 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970960 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f"} err="failed to get container status \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": rpc error: code = NotFound desc = could not find container \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": container with ID starting with e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f not found: ID does not exist" Jun 02 14:48:30.971014 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.970974 2564 scope.go:117] "RemoveContainer" containerID="63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6" Jun 02 14:48:30.971161 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.971143 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6"} err="failed to get container status \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": rpc error: code = NotFound desc = could not find container \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": container with ID starting with 63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6 not found: ID does not exist" Jun 02 14:48:30.971196 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.971163 2564 scope.go:117] "RemoveContainer" containerID="e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec" Jun 02 14:48:30.971385 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.971370 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec"} err="failed to get container status \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": rpc error: code = NotFound desc = could not find container \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": container with ID starting with e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec not found: ID does not exist" Jun 02 14:48:30.971385 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.971384 2564 scope.go:117] "RemoveContainer" containerID="a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d" Jun 02 14:48:30.971586 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.971571 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d"} err="failed to get container status \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": rpc error: code = NotFound desc = could not find container \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": container with ID starting with a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d not found: ID does not exist" Jun 02 14:48:30.971632 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.971587 2564 scope.go:117] "RemoveContainer" containerID="230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad" Jun 02 14:48:30.971807 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.971789 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad"} err="failed to get container status \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": rpc error: code = NotFound desc = could not find container \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": container with ID starting with 230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad not found: ID does not exist" Jun 02 14:48:30.971864 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.971807 2564 scope.go:117] "RemoveContainer" containerID="561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4" Jun 02 14:48:30.972001 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.971985 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4"} err="failed to get container status \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": rpc error: code = NotFound desc = could not find container \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": container with ID starting with 561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4 not found: ID does not exist" Jun 02 14:48:30.972041 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.972001 2564 scope.go:117] "RemoveContainer" containerID="602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667" Jun 02 14:48:30.972193 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.972177 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667"} err="failed to get container status \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": rpc error: code = NotFound desc = could not find container \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": container with ID starting with 602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667 not found: ID does not exist" Jun 02 14:48:30.972234 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.972194 2564 scope.go:117] "RemoveContainer" containerID="e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f" Jun 02 14:48:30.972424 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.972403 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f"} err="failed to get container status \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": rpc error: code = NotFound desc = could not find container \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": container with ID starting with e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f not found: ID does not exist" Jun 02 14:48:30.972496 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.972425 2564 scope.go:117] "RemoveContainer" containerID="63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6" Jun 02 14:48:30.972669 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.972651 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6"} err="failed to get container status \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": rpc error: code = NotFound desc = could not find container \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": container with ID starting with 63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6 not found: ID does not exist" Jun 02 14:48:30.972722 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.972671 2564 scope.go:117] "RemoveContainer" containerID="e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec" Jun 02 14:48:30.972868 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.972850 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec"} err="failed to get container status \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": rpc error: code = NotFound desc = could not find container \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": container with ID starting with e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec not found: ID does not exist" Jun 02 14:48:30.972936 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.972869 2564 scope.go:117] "RemoveContainer" containerID="a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d" Jun 02 14:48:30.973087 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.973069 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d"} err="failed to get container status \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": rpc error: code = NotFound desc = could not find container \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": container with ID starting with a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d not found: ID does not exist" Jun 02 14:48:30.973133 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.973088 2564 scope.go:117] "RemoveContainer" containerID="230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad" Jun 02 14:48:30.973274 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.973256 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad"} err="failed to get container status \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": rpc error: code = NotFound desc = could not find container \"230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad\": container with ID starting with 230fa710139b3b87f47042919e3475e975ef464e495538cfcbdd94673a7b94ad not found: ID does not exist" Jun 02 14:48:30.973399 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.973275 2564 scope.go:117] "RemoveContainer" containerID="561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4" Jun 02 14:48:30.973510 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.973496 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4"} err="failed to get container status \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": rpc error: code = NotFound desc = could not find container \"561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4\": container with ID starting with 561e63f7b56e6dfa9e64249a9a4f3120c46f289d08a1a940f725a5e7ca164cc4 not found: ID does not exist" Jun 02 14:48:30.973555 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.973510 2564 scope.go:117] "RemoveContainer" containerID="602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667" Jun 02 14:48:30.973701 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.973683 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667"} err="failed to get container status \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": rpc error: code = NotFound desc = could not find container \"602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667\": container with ID starting with 602084a58ff3e5329184007dfdd81b9ccd8f1fd68d8beff934acf5b8ea08c667 not found: ID does not exist" Jun 02 14:48:30.973765 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.973702 2564 scope.go:117] "RemoveContainer" containerID="e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f" Jun 02 14:48:30.973905 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.973886 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f"} err="failed to get container status \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": rpc error: code = NotFound desc = could not find container \"e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f\": container with ID starting with e44c854be287b4aa840037ee586ca0ee57aaac910fad8b53065fabf720825a9f not found: ID does not exist" Jun 02 14:48:30.973948 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.973907 2564 scope.go:117] "RemoveContainer" containerID="63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6" Jun 02 14:48:30.973948 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.973933 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:30.974272 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.974114 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6"} err="failed to get container status \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": rpc error: code = NotFound desc = could not find container \"63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6\": container with ID starting with 63f67dcd75cb9d25e845ae4210829e651d20c6623b6d4fe2700328edbb8208f6 not found: ID does not exist" Jun 02 14:48:30.974272 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.974135 2564 scope.go:117] "RemoveContainer" containerID="e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec" Jun 02 14:48:30.977523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.974982 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec"} err="failed to get container status \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": rpc error: code = NotFound desc = could not find container \"e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec\": container with ID starting with e78a67fc0b460591bf337de8d0c73d9d2ee7459334f741be37f6960be44b05ec not found: ID does not exist" Jun 02 14:48:30.977523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.975017 2564 scope.go:117] "RemoveContainer" containerID="a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d" Jun 02 14:48:30.977523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.976705 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 14:48:30.977737 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.977553 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d"} err="failed to get container status \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": rpc error: code = NotFound desc = could not find container \"a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d\": container with ID starting with a308134d16863dc33e752a65fe255794d70027678791f1a2a41d9807c653397d not found: ID does not exist" Jun 02 14:48:30.979138 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.978710 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 14:48:30.979138 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.978734 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 14:48:30.979138 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.978774 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 14:48:30.979138 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.978902 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 14:48:30.979138 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.978926 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 14:48:30.979138 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.978979 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 14:48:30.979138 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.979000 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6wfwl\"" Jun 02 14:48:30.979138 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.979027 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 14:48:30.979138 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.978710 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 14:48:30.979138 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.979080 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 14:48:30.979673 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.978928 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 14:48:30.979673 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.979477 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aciloc5gv6h82\"" Jun 02 14:48:30.982083 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.982064 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 14:48:30.984805 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.984765 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:48:30.985029 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:30.985008 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 14:48:31.033207 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033176 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033207 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033395 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033229 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033395 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033395 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033395 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033377 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v5m9\" (UniqueName: \"kubernetes.io/projected/be824809-6cad-4403-8d8d-7dd849208568-kube-api-access-9v5m9\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033523 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033668 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033534 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be824809-6cad-4403-8d8d-7dd849208568-config-out\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033668 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be824809-6cad-4403-8d8d-7dd849208568-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033668 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-config\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033668 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033668 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be824809-6cad-4403-8d8d-7dd849208568-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033668 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-web-config\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.033841 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.033687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.084101 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.084064 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="273f8916-0850-4d18-858e-e7e701869740" path="/var/lib/kubelet/pods/273f8916-0850-4d18-858e-e7e701869740/volumes" Jun 02 14:48:31.134859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.134817 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.134859 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.134863 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135007 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.134887 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135007 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.134905 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9v5m9\" (UniqueName: \"kubernetes.io/projected/be824809-6cad-4403-8d8d-7dd849208568-kube-api-access-9v5m9\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135002 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135038 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135081 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135070 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135230 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135094 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135230 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135138 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be824809-6cad-4403-8d8d-7dd849208568-config-out\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135230 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135162 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be824809-6cad-4403-8d8d-7dd849208568-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135230 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135190 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-config\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135230 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135216 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135521 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135247 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be824809-6cad-4403-8d8d-7dd849208568-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135521 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135277 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-web-config\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135521 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135334 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135521 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135381 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135521 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135411 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.135521 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.135435 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.136375 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.136037 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.136375 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.136363 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be824809-6cad-4403-8d8d-7dd849208568-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.137021 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.136989 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.137109 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.137070 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.138008 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.137986 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.138867 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.138820 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.138964 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.138873 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.139514 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.139492 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be824809-6cad-4403-8d8d-7dd849208568-config-out\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.139824 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.139805 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.139906 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.139838 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.139906 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.139875 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.140242 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.140202 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be824809-6cad-4403-8d8d-7dd849208568-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.140439 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.140420 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-config\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.140581 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.140559 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be824809-6cad-4403-8d8d-7dd849208568-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.141472 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.141451 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.141756 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.141738 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-web-config\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.141824 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.141804 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be824809-6cad-4403-8d8d-7dd849208568-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.143249 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.143229 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v5m9\" (UniqueName: \"kubernetes.io/projected/be824809-6cad-4403-8d8d-7dd849208568-kube-api-access-9v5m9\") pod \"prometheus-k8s-0\" (UID: \"be824809-6cad-4403-8d8d-7dd849208568\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.289233 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.289188 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:48:31.422277 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.422259 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:48:31.424803 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:48:31.424773 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe824809_6cad_4403_8d8d_7dd849208568.slice/crio-50614aa7759c7bafdbfde0e342fe2272d03ae0f884a78df40641d36cfc24c03a WatchSource:0}: Error finding container 50614aa7759c7bafdbfde0e342fe2272d03ae0f884a78df40641d36cfc24c03a: Status 404 returned error can't find the container with id 50614aa7759c7bafdbfde0e342fe2272d03ae0f884a78df40641d36cfc24c03a Jun 02 14:48:31.921637 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.921601 2564 generic.go:358] "Generic (PLEG): container finished" podID="be824809-6cad-4403-8d8d-7dd849208568" containerID="c8183ee46ce6692653bee97eb38a8dd4ec57099a61e1753cce5e1fd4919001a3" exitCode=0 Jun 02 14:48:31.921822 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.921672 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be824809-6cad-4403-8d8d-7dd849208568","Type":"ContainerDied","Data":"c8183ee46ce6692653bee97eb38a8dd4ec57099a61e1753cce5e1fd4919001a3"} Jun 02 14:48:31.921822 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:31.921697 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be824809-6cad-4403-8d8d-7dd849208568","Type":"ContainerStarted","Data":"50614aa7759c7bafdbfde0e342fe2272d03ae0f884a78df40641d36cfc24c03a"} Jun 02 14:48:32.927316 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:32.927281 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be824809-6cad-4403-8d8d-7dd849208568","Type":"ContainerStarted","Data":"7cb1b49be1609149e28e159cc9c2dd1a942c05f8cf9d91e7071fc28d39a8ca49"} Jun 02 14:48:32.927690 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:32.927337 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be824809-6cad-4403-8d8d-7dd849208568","Type":"ContainerStarted","Data":"697af59947348cdde47a66818c66ab0b1e0f316742f7b0a6a2af22e0bb075ae5"} Jun 02 14:48:32.927690 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:32.927347 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be824809-6cad-4403-8d8d-7dd849208568","Type":"ContainerStarted","Data":"944cbfbb0fac35d7f3dba3203f715d22a85c5f10a172093be942c80052b7ce19"} Jun 02 14:48:32.927690 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:32.927355 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be824809-6cad-4403-8d8d-7dd849208568","Type":"ContainerStarted","Data":"9954259f38191a28178888cb9c13da3b0e3509b62b90a26f7759fe8e3c15ce6a"} Jun 02 14:48:32.927690 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:32.927362 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be824809-6cad-4403-8d8d-7dd849208568","Type":"ContainerStarted","Data":"837cbe7f0314c2de79b38f312577a19269280774dafc60dad0fa8db300746424"} Jun 02 14:48:32.927690 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:32.927370 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be824809-6cad-4403-8d8d-7dd849208568","Type":"ContainerStarted","Data":"9e568879fb2c239d8286e4099eb5178fb14e4c9f11b21cd427829a9aa7ef4479"} Jun 02 14:48:32.956830 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:32.956775 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.956757329 podStartE2EDuration="2.956757329s" podCreationTimestamp="2026-06-02 14:48:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 14:48:32.954208694 +0000 UTC m=+234.462111326" watchObservedRunningTime="2026-06-02 14:48:32.956757329 +0000 UTC m=+234.464659977" Jun 02 14:48:36.290194 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:48:36.290153 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:49:31.289879 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:49:31.289831 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:49:31.305743 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:49:31.305717 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:49:32.121882 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:49:32.121574 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:49:38.975809 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:49:38.975783 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/0.log" Jun 02 14:49:38.976222 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:49:38.976170 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/0.log" Jun 02 14:49:38.979052 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:49:38.979031 2564 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 14:50:58.220793 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.220757 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5"] Jun 02 14:50:58.223946 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.223930 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:50:58.226649 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.226621 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 02 14:50:58.226775 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.226679 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 14:50:58.226775 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.226710 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 02 14:50:58.226775 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.226749 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 14:50:58.227873 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.227855 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-rcstt\"" Jun 02 14:50:58.231461 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.231442 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5"] Jun 02 14:50:58.259147 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.259116 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p7nd\" (UniqueName: \"kubernetes.io/projected/ef9c7dc2-e274-44be-b690-0cba56c28cbf-kube-api-access-8p7nd\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5\" (UID: \"ef9c7dc2-e274-44be-b690-0cba56c28cbf\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:50:58.259254 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.259153 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef9c7dc2-e274-44be-b690-0cba56c28cbf-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5\" (UID: \"ef9c7dc2-e274-44be-b690-0cba56c28cbf\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:50:58.259254 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.259186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/ef9c7dc2-e274-44be-b690-0cba56c28cbf-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5\" (UID: \"ef9c7dc2-e274-44be-b690-0cba56c28cbf\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:50:58.359777 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.359736 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8p7nd\" (UniqueName: \"kubernetes.io/projected/ef9c7dc2-e274-44be-b690-0cba56c28cbf-kube-api-access-8p7nd\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5\" (UID: \"ef9c7dc2-e274-44be-b690-0cba56c28cbf\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:50:58.359942 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.359781 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef9c7dc2-e274-44be-b690-0cba56c28cbf-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5\" (UID: \"ef9c7dc2-e274-44be-b690-0cba56c28cbf\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:50:58.359942 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.359818 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/ef9c7dc2-e274-44be-b690-0cba56c28cbf-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5\" (UID: \"ef9c7dc2-e274-44be-b690-0cba56c28cbf\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:50:58.360562 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.360531 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/ef9c7dc2-e274-44be-b690-0cba56c28cbf-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5\" (UID: \"ef9c7dc2-e274-44be-b690-0cba56c28cbf\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:50:58.362200 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.362182 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef9c7dc2-e274-44be-b690-0cba56c28cbf-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5\" (UID: \"ef9c7dc2-e274-44be-b690-0cba56c28cbf\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:50:58.372003 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.371977 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p7nd\" (UniqueName: \"kubernetes.io/projected/ef9c7dc2-e274-44be-b690-0cba56c28cbf-kube-api-access-8p7nd\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5\" (UID: \"ef9c7dc2-e274-44be-b690-0cba56c28cbf\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:50:58.533359 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.533241 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:50:58.662165 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.662126 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5"] Jun 02 14:50:58.666056 ip-10-0-133-192 kubenswrapper[2564]: W0602 14:50:58.666025 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef9c7dc2_e274_44be_b690_0cba56c28cbf.slice/crio-d5eec4981c0eeaff7c56e1e6181cd5ea357759743b53ae035e6e89d79361588d WatchSource:0}: Error finding container d5eec4981c0eeaff7c56e1e6181cd5ea357759743b53ae035e6e89d79361588d: Status 404 returned error can't find the container with id d5eec4981c0eeaff7c56e1e6181cd5ea357759743b53ae035e6e89d79361588d Jun 02 14:50:58.667739 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:58.667721 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 14:50:59.321710 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:50:59.321672 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" event={"ID":"ef9c7dc2-e274-44be-b690-0cba56c28cbf","Type":"ContainerStarted","Data":"d5eec4981c0eeaff7c56e1e6181cd5ea357759743b53ae035e6e89d79361588d"} Jun 02 14:51:01.329275 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:51:01.329171 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" event={"ID":"ef9c7dc2-e274-44be-b690-0cba56c28cbf","Type":"ContainerStarted","Data":"20cff0e2d051bdc300a5e6e8c9518dc40ec29dc511fc7ced51e30501d8f7ca83"} Jun 02 14:51:01.329650 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:51:01.329280 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:51:01.350345 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:51:01.350250 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" podStartSLOduration=1.033647901 podStartE2EDuration="3.350232781s" podCreationTimestamp="2026-06-02 14:50:58 +0000 UTC" firstStartedPulling="2026-06-02 14:50:58.667855514 +0000 UTC m=+380.175758135" lastFinishedPulling="2026-06-02 14:51:00.984440397 +0000 UTC m=+382.492343015" observedRunningTime="2026-06-02 14:51:01.348331648 +0000 UTC m=+382.856234290" watchObservedRunningTime="2026-06-02 14:51:01.350232781 +0000 UTC m=+382.858135422" Jun 02 14:51:17.337120 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:51:17.337081 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5" Jun 02 14:54:38.996400 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:54:38.996373 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/0.log" Jun 02 14:54:38.997110 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:54:38.997094 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/0.log" Jun 02 14:59:39.015563 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:59:39.015533 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/0.log" Jun 02 14:59:39.017559 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:59:39.017534 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/0.log" Jun 02 14:59:43.800964 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:59:43.800911 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5_ef9c7dc2-e274-44be-b690-0cba56c28cbf/manager/0.log" Jun 02 14:59:44.268673 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:59:44.268644 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5_ef9c7dc2-e274-44be-b690-0cba56c28cbf/manager/0.log" Jun 02 14:59:44.708663 ip-10-0-133-192 kubenswrapper[2564]: I0602 14:59:44.708640 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-fs2w5_ef9c7dc2-e274-44be-b690-0cba56c28cbf/manager/0.log" Jun 02 15:00:25.688146 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.688103 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bv8bp/must-gather-lktkl"] Jun 02 15:00:25.691420 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.691397 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bv8bp/must-gather-lktkl" Jun 02 15:00:25.693961 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.693930 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bv8bp\"/\"openshift-service-ca.crt\"" Jun 02 15:00:25.693961 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.693947 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bv8bp\"/\"kube-root-ca.crt\"" Jun 02 15:00:25.694159 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.693947 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bv8bp\"/\"default-dockercfg-848xq\"" Jun 02 15:00:25.698879 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.698853 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bv8bp/must-gather-lktkl"] Jun 02 15:00:25.738505 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.738478 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89ktg\" (UniqueName: \"kubernetes.io/projected/5475e740-f736-4f0e-aa0f-4517b881c899-kube-api-access-89ktg\") pod \"must-gather-lktkl\" (UID: \"5475e740-f736-4f0e-aa0f-4517b881c899\") " pod="openshift-must-gather-bv8bp/must-gather-lktkl" Jun 02 15:00:25.738672 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.738528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5475e740-f736-4f0e-aa0f-4517b881c899-must-gather-output\") pod \"must-gather-lktkl\" (UID: \"5475e740-f736-4f0e-aa0f-4517b881c899\") " pod="openshift-must-gather-bv8bp/must-gather-lktkl" Jun 02 15:00:25.839858 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.839823 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5475e740-f736-4f0e-aa0f-4517b881c899-must-gather-output\") pod \"must-gather-lktkl\" (UID: \"5475e740-f736-4f0e-aa0f-4517b881c899\") " pod="openshift-must-gather-bv8bp/must-gather-lktkl" Jun 02 15:00:25.840000 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.839901 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89ktg\" (UniqueName: \"kubernetes.io/projected/5475e740-f736-4f0e-aa0f-4517b881c899-kube-api-access-89ktg\") pod \"must-gather-lktkl\" (UID: \"5475e740-f736-4f0e-aa0f-4517b881c899\") " pod="openshift-must-gather-bv8bp/must-gather-lktkl" Jun 02 15:00:25.840234 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.840212 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5475e740-f736-4f0e-aa0f-4517b881c899-must-gather-output\") pod \"must-gather-lktkl\" (UID: \"5475e740-f736-4f0e-aa0f-4517b881c899\") " pod="openshift-must-gather-bv8bp/must-gather-lktkl" Jun 02 15:00:25.848682 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:25.848657 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89ktg\" (UniqueName: \"kubernetes.io/projected/5475e740-f736-4f0e-aa0f-4517b881c899-kube-api-access-89ktg\") pod \"must-gather-lktkl\" (UID: \"5475e740-f736-4f0e-aa0f-4517b881c899\") " pod="openshift-must-gather-bv8bp/must-gather-lktkl" Jun 02 15:00:26.001106 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:26.001012 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bv8bp/must-gather-lktkl" Jun 02 15:00:26.129745 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:26.129713 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bv8bp/must-gather-lktkl"] Jun 02 15:00:26.132876 ip-10-0-133-192 kubenswrapper[2564]: W0602 15:00:26.132844 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5475e740_f736_4f0e_aa0f_4517b881c899.slice/crio-262e52e949148241343769a4f2f5cd8d0363bdd31669aedf5c8a22873712058a WatchSource:0}: Error finding container 262e52e949148241343769a4f2f5cd8d0363bdd31669aedf5c8a22873712058a: Status 404 returned error can't find the container with id 262e52e949148241343769a4f2f5cd8d0363bdd31669aedf5c8a22873712058a Jun 02 15:00:26.134922 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:26.134907 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:00:26.870835 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:26.870799 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bv8bp/must-gather-lktkl" event={"ID":"5475e740-f736-4f0e-aa0f-4517b881c899","Type":"ContainerStarted","Data":"262e52e949148241343769a4f2f5cd8d0363bdd31669aedf5c8a22873712058a"} Jun 02 15:00:27.876730 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:27.876632 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bv8bp/must-gather-lktkl" event={"ID":"5475e740-f736-4f0e-aa0f-4517b881c899","Type":"ContainerStarted","Data":"14ab6c99593f2666eae1286369155643af865d0461ec9d6c0c4a335fc181b5ad"} Jun 02 15:00:27.876730 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:27.876679 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bv8bp/must-gather-lktkl" event={"ID":"5475e740-f736-4f0e-aa0f-4517b881c899","Type":"ContainerStarted","Data":"02cb97f2ca83eb2ef140916bcf9ac2ea1b9010ff69ee34f481ab6ef30409fdf0"} Jun 02 15:00:27.892797 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:27.892736 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bv8bp/must-gather-lktkl" podStartSLOduration=1.5629352989999998 podStartE2EDuration="2.892715663s" podCreationTimestamp="2026-06-02 15:00:25 +0000 UTC" firstStartedPulling="2026-06-02 15:00:26.135028506 +0000 UTC m=+947.642931123" lastFinishedPulling="2026-06-02 15:00:27.464808864 +0000 UTC m=+948.972711487" observedRunningTime="2026-06-02 15:00:27.890697708 +0000 UTC m=+949.398600350" watchObservedRunningTime="2026-06-02 15:00:27.892715663 +0000 UTC m=+949.400618304" Jun 02 15:00:28.763743 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:28.763712 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cqkg2_8d3634eb-c8b9-4ee4-9a34-0865f33b9ed2/global-pull-secret-syncer/0.log" Jun 02 15:00:28.879831 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:28.879798 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wn6xc_40a50a59-49da-4034-af9a-15a13dd4084d/konnectivity-agent/0.log" Jun 02 15:00:28.921880 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:28.921849 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-192.ec2.internal_3b2ad47d5e6987ad43e3dd52c6b00aa3/haproxy/0.log" Jun 02 15:00:32.452173 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.452117 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qkpwt_67de0abf-cb2e-4562-a98b-0f80fdc8b0bb/node-exporter/0.log" Jun 02 15:00:32.476636 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.476585 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qkpwt_67de0abf-cb2e-4562-a98b-0f80fdc8b0bb/kube-rbac-proxy/0.log" Jun 02 15:00:32.496439 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.496409 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qkpwt_67de0abf-cb2e-4562-a98b-0f80fdc8b0bb/init-textfile/0.log" Jun 02 15:00:32.594956 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.594922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be824809-6cad-4403-8d8d-7dd849208568/prometheus/0.log" Jun 02 15:00:32.613393 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.613356 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be824809-6cad-4403-8d8d-7dd849208568/config-reloader/0.log" Jun 02 15:00:32.630930 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.630894 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be824809-6cad-4403-8d8d-7dd849208568/thanos-sidecar/0.log" Jun 02 15:00:32.653580 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.653551 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be824809-6cad-4403-8d8d-7dd849208568/kube-rbac-proxy-web/0.log" Jun 02 15:00:32.671497 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.671420 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be824809-6cad-4403-8d8d-7dd849208568/kube-rbac-proxy/0.log" Jun 02 15:00:32.692711 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.692680 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be824809-6cad-4403-8d8d-7dd849208568/kube-rbac-proxy-thanos/0.log" Jun 02 15:00:32.709374 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.709278 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be824809-6cad-4403-8d8d-7dd849208568/init-config-reloader/0.log" Jun 02 15:00:32.861142 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.861108 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b657c57b-7q5t7_95a702ef-8e82-4d52-b28b-df156b9d7acc/thanos-query/0.log" Jun 02 15:00:32.880452 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.880414 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b657c57b-7q5t7_95a702ef-8e82-4d52-b28b-df156b9d7acc/kube-rbac-proxy-web/0.log" Jun 02 15:00:32.903086 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.903053 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b657c57b-7q5t7_95a702ef-8e82-4d52-b28b-df156b9d7acc/kube-rbac-proxy/0.log" Jun 02 15:00:32.925991 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.925966 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b657c57b-7q5t7_95a702ef-8e82-4d52-b28b-df156b9d7acc/prom-label-proxy/0.log" Jun 02 15:00:32.944506 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.944475 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b657c57b-7q5t7_95a702ef-8e82-4d52-b28b-df156b9d7acc/kube-rbac-proxy-rules/0.log" Jun 02 15:00:32.969059 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:32.968973 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b657c57b-7q5t7_95a702ef-8e82-4d52-b28b-df156b9d7acc/kube-rbac-proxy-metrics/0.log" Jun 02 15:00:35.817950 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:35.817914 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vdkd_bad3a9fa-8660-4a5e-9a2f-1337fc62bae8/dns/0.log" Jun 02 15:00:35.876890 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:35.876842 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vdkd_bad3a9fa-8660-4a5e-9a2f-1337fc62bae8/kube-rbac-proxy/0.log" Jun 02 15:00:35.975048 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:35.974964 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z"] Jun 02 15:00:35.981550 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:35.981521 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:35.986029 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:35.985984 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z"] Jun 02 15:00:36.010652 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.010624 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k6sqt_10109fca-6b44-4d66-8efd-269151775e41/dns-node-resolver/0.log" Jun 02 15:00:36.138911 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.138875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-proc\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.139096 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.138928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kkgh\" (UniqueName: \"kubernetes.io/projected/3681fddf-7c79-49df-8611-1451e47b9a8b-kube-api-access-7kkgh\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.139096 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.139013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-lib-modules\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.139096 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.139031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-podres\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.139222 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.139093 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-sys\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.240401 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.240258 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-podres\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.240563 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.240543 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-sys\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.240626 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.240447 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-podres\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.240626 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.240572 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-proc\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.240727 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.240632 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-sys\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.240727 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.240645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-proc\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.240727 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.240634 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kkgh\" (UniqueName: \"kubernetes.io/projected/3681fddf-7c79-49df-8611-1451e47b9a8b-kube-api-access-7kkgh\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.240857 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.240730 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-lib-modules\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.240857 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.240815 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3681fddf-7c79-49df-8611-1451e47b9a8b-lib-modules\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.248970 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.248938 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kkgh\" (UniqueName: \"kubernetes.io/projected/3681fddf-7c79-49df-8611-1451e47b9a8b-kube-api-access-7kkgh\") pod \"perf-node-gather-daemonset-tcw6z\" (UID: \"3681fddf-7c79-49df-8611-1451e47b9a8b\") " pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.293540 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.293507 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.421545 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.421513 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7987p_8f958cf4-1e44-4c9a-8dcd-1fec1aa04671/node-ca/0.log" Jun 02 15:00:36.444333 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.444285 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z"] Jun 02 15:00:36.448367 ip-10-0-133-192 kubenswrapper[2564]: W0602 15:00:36.448335 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3681fddf_7c79_49df_8611_1451e47b9a8b.slice/crio-50bfb8fed84ddd18ac3aeb36f87c3aaf6d82a3bfe4e8523ef35ddf20d5a1ebd3 WatchSource:0}: Error finding container 50bfb8fed84ddd18ac3aeb36f87c3aaf6d82a3bfe4e8523ef35ddf20d5a1ebd3: Status 404 returned error can't find the container with id 50bfb8fed84ddd18ac3aeb36f87c3aaf6d82a3bfe4e8523ef35ddf20d5a1ebd3 Jun 02 15:00:36.914973 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.914880 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" event={"ID":"3681fddf-7c79-49df-8611-1451e47b9a8b","Type":"ContainerStarted","Data":"e572061c10f62ae6f5d4859e4d38362a2434ce8b336596d967a0b152bb039e1c"} Jun 02 15:00:36.914973 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.914922 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" event={"ID":"3681fddf-7c79-49df-8611-1451e47b9a8b","Type":"ContainerStarted","Data":"50bfb8fed84ddd18ac3aeb36f87c3aaf6d82a3bfe4e8523ef35ddf20d5a1ebd3"} Jun 02 15:00:36.915390 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.915026 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:36.930129 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:36.930082 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" podStartSLOduration=1.930068392 podStartE2EDuration="1.930068392s" podCreationTimestamp="2026-06-02 15:00:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:00:36.927981737 +0000 UTC m=+958.435884381" watchObservedRunningTime="2026-06-02 15:00:36.930068392 +0000 UTC m=+958.437971031" Jun 02 15:00:37.390892 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:37.390864 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-twx4g_0403ed56-b191-4b5c-9fe0-606899a8db88/serve-healthcheck-canary/0.log" Jun 02 15:00:37.750082 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:37.750053 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hpbxk_8e65c822-a96d-4055-b76e-96ae7610e9ed/kube-rbac-proxy/0.log" Jun 02 15:00:37.764887 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:37.764847 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hpbxk_8e65c822-a96d-4055-b76e-96ae7610e9ed/exporter/0.log" Jun 02 15:00:37.784179 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:37.784157 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hpbxk_8e65c822-a96d-4055-b76e-96ae7610e9ed/extractor/0.log" Jun 02 15:00:42.931239 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:42.931197 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bv8bp/perf-node-gather-daemonset-tcw6z" Jun 02 15:00:43.472517 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:43.472490 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vp9n_16039595-d233-421f-a7ac-dc51ff2b230a/kube-multus-additional-cni-plugins/0.log" Jun 02 15:00:43.489876 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:43.489847 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vp9n_16039595-d233-421f-a7ac-dc51ff2b230a/egress-router-binary-copy/0.log" Jun 02 15:00:43.506159 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:43.506129 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vp9n_16039595-d233-421f-a7ac-dc51ff2b230a/cni-plugins/0.log" Jun 02 15:00:43.522713 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:43.522688 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vp9n_16039595-d233-421f-a7ac-dc51ff2b230a/bond-cni-plugin/0.log" Jun 02 15:00:43.539770 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:43.539742 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vp9n_16039595-d233-421f-a7ac-dc51ff2b230a/routeoverride-cni/0.log" Jun 02 15:00:43.556471 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:43.556446 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vp9n_16039595-d233-421f-a7ac-dc51ff2b230a/whereabouts-cni-bincopy/0.log" Jun 02 15:00:43.573847 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:43.573817 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vp9n_16039595-d233-421f-a7ac-dc51ff2b230a/whereabouts-cni/0.log" Jun 02 15:00:43.716826 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:43.716789 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b68xm_bfc3d843-a7f0-40fa-9142-ce5f5a06aa9c/kube-multus/0.log" Jun 02 15:00:43.794692 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:43.794595 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2p9gp_77654ab6-6b10-4650-8a14-0001fcd9eb85/network-metrics-daemon/0.log" Jun 02 15:00:43.813924 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:43.813889 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2p9gp_77654ab6-6b10-4650-8a14-0001fcd9eb85/kube-rbac-proxy/0.log" Jun 02 15:00:45.182328 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:45.180433 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-controller/0.log" Jun 02 15:00:45.199078 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:45.199045 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/0.log" Jun 02 15:00:45.209567 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:45.209525 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovn-acl-logging/1.log" Jun 02 15:00:45.231175 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:45.231140 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/kube-rbac-proxy-node/0.log" Jun 02 15:00:45.253425 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:45.253391 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 15:00:45.268508 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:45.268473 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/northd/0.log" Jun 02 15:00:45.287173 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:45.287141 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/nbdb/0.log" Jun 02 15:00:45.306640 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:45.306607 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/sbdb/0.log" Jun 02 15:00:45.472599 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:45.472568 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjh6n_97cfdf33-ab98-4e07-a458-a3266fac0eb5/ovnkube-controller/0.log" Jun 02 15:00:46.483259 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:46.483232 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-f4q6p_276ea801-82c9-4207-bc13-1bd3174c4629/network-check-target-container/0.log" Jun 02 15:00:47.388485 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:47.388456 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8qq9p_b54104a8-2be1-44c9-bed2-d8fbafd191f5/iptables-alerter/0.log" Jun 02 15:00:47.947550 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:47.947524 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-rthgk_662bb68f-e9d1-42ba-865e-07085a1e8ba0/tuned/0.log" Jun 02 15:00:50.975080 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:50.975052 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hbcvr_068d069e-b79f-4012-a06a-e54f48e699b9/csi-driver/0.log" Jun 02 15:00:50.990546 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:50.990520 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hbcvr_068d069e-b79f-4012-a06a-e54f48e699b9/csi-node-driver-registrar/0.log" Jun 02 15:00:51.008593 ip-10-0-133-192 kubenswrapper[2564]: I0602 15:00:51.008575 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hbcvr_068d069e-b79f-4012-a06a-e54f48e699b9/csi-liveness-probe/0.log"