Jun 08 10:16:39.242631 ip-10-0-132-117 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 10:16:39.242648 ip-10-0-132-117 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 10:16:39.242657 ip-10-0-132-117 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 10:16:39.243113 ip-10-0-132-117 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 10:16:50.408148 ip-10-0-132-117 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 10:16:50.408167 ip-10-0-132-117 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b8cf747d197c4170a41cee4da37c3e0a -- Jun 08 10:19:30.036118 ip-10-0-132-117 systemd[1]: Starting Kubernetes Kubelet... Jun 08 10:19:30.455678 ip-10-0-132-117 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 10:19:30.455678 ip-10-0-132-117 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 10:19:30.455678 ip-10-0-132-117 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 10:19:30.455678 ip-10-0-132-117 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 10:19:30.455678 ip-10-0-132-117 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 10:19:30.458426 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.458335 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 10:19:30.461972 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.461945 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 10:19:30.461972 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.461972 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 10:19:30.461972 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.461976 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 10:19:30.461972 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.461979 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 10:19:30.461972 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.461983 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.461986 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.461989 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.461992 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.461997 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462000 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462003 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462006 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462008 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462011 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462014 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462016 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462021 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462025 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462030 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462033 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462036 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462039 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462041 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 10:19:30.462114 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462044 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462047 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462049 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462052 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462055 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462057 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462060 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462063 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462066 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462069 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462071 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462074 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462076 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462079 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462082 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462085 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462088 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462091 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462094 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462097 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 10:19:30.462559 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462100 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462103 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462105 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462108 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462111 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462113 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462116 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462118 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462121 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462123 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462126 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462129 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462131 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462134 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462136 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462139 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462141 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462144 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462146 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 10:19:30.463059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462149 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462151 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462154 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462156 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462160 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462163 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462165 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462168 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462171 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462174 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462177 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462179 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462181 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462184 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462186 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462189 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462191 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462194 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462198 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 10:19:30.463527 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462202 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462205 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462208 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462210 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462213 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462215 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462218 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462221 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462223 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462227 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462229 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462232 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462235 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462238 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462241 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462245 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462248 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462251 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.462994 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463002 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 10:19:30.464094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463006 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463011 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463016 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463020 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463023 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463026 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463029 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463032 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463035 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463038 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463040 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463043 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463046 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463049 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463052 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463054 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463057 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463060 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463063 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 10:19:30.464580 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463065 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463068 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463071 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463074 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463076 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463079 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463081 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463084 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463087 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463089 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463092 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463094 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463097 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463100 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463103 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463107 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463110 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463113 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463116 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463119 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 10:19:30.465077 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463121 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463123 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463126 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463129 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463131 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463134 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463136 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463139 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463142 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463144 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463147 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463152 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463155 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463158 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463161 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463164 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463166 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463169 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463171 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463174 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 10:19:30.465585 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463176 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463179 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463181 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463184 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463188 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463192 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463196 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463198 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463201 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463204 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463206 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463209 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463211 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463214 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463216 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463219 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463222 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463224 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463227 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463229 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 10:19:30.466094 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463231 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463234 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463237 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463240 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463242 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463245 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463248 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463250 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463253 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463255 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463258 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463260 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463263 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463265 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463267 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463270 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463272 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463278 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463653 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463658 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 10:19:30.466601 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463662 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463665 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463668 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463670 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463673 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463676 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463678 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463681 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463683 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463686 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463688 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463691 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463695 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463698 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463702 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463704 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463707 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463710 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463712 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463715 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 10:19:30.467113 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463717 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463720 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463722 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463725 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463727 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463730 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463733 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463735 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463738 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463742 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463745 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463747 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463750 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463753 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463756 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463759 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463761 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463766 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463769 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463772 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 10:19:30.467609 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463774 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463777 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463780 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463782 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463784 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463787 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463789 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463792 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463795 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463797 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463800 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463802 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463804 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463807 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463810 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463812 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463832 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463837 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463842 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 10:19:30.468181 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463845 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463849 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463853 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463856 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463859 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463862 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463864 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463868 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463870 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463873 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463876 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463878 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463881 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463883 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463886 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463889 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463891 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463894 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463896 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463899 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 10:19:30.468650 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463902 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463904 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463907 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463909 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463912 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463914 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463917 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463919 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463921 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463924 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463926 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463929 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463931 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463934 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463937 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463940 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463943 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.463945 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464043 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464053 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464063 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 10:19:30.469153 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464068 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464073 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464076 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464080 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464084 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464088 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464091 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464095 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464098 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464102 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464105 2577 flags.go:64] FLAG: --cgroup-root="" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464108 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464111 2577 flags.go:64] FLAG: --client-ca-file="" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464114 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464117 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464122 2577 flags.go:64] FLAG: --cluster-domain="" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464125 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464128 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464131 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464135 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464139 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464142 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464145 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 10:19:30.469653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464148 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464151 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464155 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464159 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464162 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464165 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464169 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464172 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464175 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464179 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464182 2577 flags.go:64] FLAG: --enable-server="true" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464185 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464189 2577 flags.go:64] FLAG: --event-burst="100" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464192 2577 flags.go:64] FLAG: --event-qps="50" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464195 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464197 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464200 2577 flags.go:64] FLAG: --eviction-hard="" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464204 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464207 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464211 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464214 2577 flags.go:64] FLAG: --eviction-soft="" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464217 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464219 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464223 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464226 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 10:19:30.470225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464229 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464232 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464235 2577 flags.go:64] FLAG: --feature-gates="" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464239 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464242 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464245 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464248 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464251 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464254 2577 flags.go:64] FLAG: --help="false" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464257 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464261 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464264 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464266 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464270 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464274 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464276 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464279 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464283 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464286 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464289 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464292 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464295 2577 flags.go:64] FLAG: --kube-reserved="" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464298 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464301 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 10:19:30.470910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464304 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464307 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464310 2577 flags.go:64] FLAG: --lock-file="" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464313 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464316 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464319 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464325 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464328 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464331 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464333 2577 flags.go:64] FLAG: --logging-format="text" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464336 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464340 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464343 2577 flags.go:64] FLAG: --manifest-url="" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464346 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464350 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464352 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464357 2577 flags.go:64] FLAG: --max-pods="110" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464360 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464363 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464366 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464369 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464372 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464375 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464378 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464385 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 10:19:30.471495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464388 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464391 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464394 2577 flags.go:64] FLAG: --pod-cidr="" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464398 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464404 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464407 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464410 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464413 2577 flags.go:64] FLAG: --port="10250" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464416 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464419 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f65983283f7e2f2e" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464422 2577 flags.go:64] FLAG: --qos-reserved="" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464425 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464428 2577 flags.go:64] FLAG: --register-node="true" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464431 2577 flags.go:64] FLAG: --register-with-taints="" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464435 2577 flags.go:64] FLAG: --registry-burst="10" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464438 2577 flags.go:64] FLAG: --registry-qps="5" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464441 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464443 2577 flags.go:64] FLAG: --reserved-memory="" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464447 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464450 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464453 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464455 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464458 2577 flags.go:64] FLAG: --runonce="false" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464461 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464464 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 10:19:30.472151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464467 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464470 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464473 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464476 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464479 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464482 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464485 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464488 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464491 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464494 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464497 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464500 2577 flags.go:64] FLAG: --system-cgroups="" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464503 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464508 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464511 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464514 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464518 2577 flags.go:64] FLAG: --tls-min-version="" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464521 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464524 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464527 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464530 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464533 2577 flags.go:64] FLAG: --v="2" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464537 2577 flags.go:64] FLAG: --version="false" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464541 2577 flags.go:64] FLAG: --vmodule="" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464545 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 10:19:30.472782 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.464548 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464660 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464663 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464667 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464669 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464672 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464677 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464680 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464683 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464685 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464688 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464691 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464694 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464696 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464699 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464702 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464705 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464708 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464710 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464713 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464715 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 10:19:30.473742 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464719 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464721 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464725 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464728 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464731 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464733 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464736 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464739 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464741 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464743 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464746 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464748 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464751 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464753 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464756 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464758 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464762 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464767 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464770 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 10:19:30.474354 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464773 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464776 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464779 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464781 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464784 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464786 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464789 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464792 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464794 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464797 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464802 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464805 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464808 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464811 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464813 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464836 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464840 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464845 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464847 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 10:19:30.474859 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464850 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464854 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464858 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464861 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464864 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464867 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464870 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464872 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464875 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464878 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464880 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464884 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464887 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464889 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464892 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464894 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464897 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464900 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464902 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 10:19:30.475351 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464905 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464907 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464910 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464912 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464915 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464918 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464921 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464924 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464927 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464931 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464933 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464936 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464938 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464941 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464943 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464946 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464948 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464951 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464954 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464957 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 10:19:30.475834 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464959 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.464962 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.465591 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.474235 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.474254 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.475174 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.475183 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475243 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475249 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475253 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475256 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475259 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475262 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475266 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 10:19:30.476330 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475269 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475272 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475275 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475279 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475282 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475285 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475288 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475290 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475293 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475296 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475299 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475302 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475305 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475307 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475310 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475312 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475315 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475318 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475321 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475324 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 10:19:30.476672 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475326 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475329 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475333 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475336 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475338 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475341 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475344 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475347 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475349 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475352 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475355 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475357 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475360 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475363 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475365 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475368 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475370 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475373 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475376 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475378 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 10:19:30.477178 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475381 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475384 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475387 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475389 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475392 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475394 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475397 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475399 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475402 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475404 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475407 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475412 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475416 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475419 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475423 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475427 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475431 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475436 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475439 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 10:19:30.477675 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475442 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475445 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475448 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475451 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475454 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475456 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475459 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475462 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475464 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475467 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475469 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475472 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475474 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475478 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475481 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475484 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475486 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475489 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475491 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475494 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 10:19:30.478160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475497 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475499 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475502 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475504 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475507 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475510 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475512 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475516 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475518 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475521 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475523 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475526 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475529 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.475534 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475650 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 10:19:30.478641 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475655 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475658 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475661 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475664 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475667 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475670 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475673 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475675 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475678 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475680 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475683 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475686 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475689 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475692 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475694 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475697 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475699 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475702 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475705 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 10:19:30.479198 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475708 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475712 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475714 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475717 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475720 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475722 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475725 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475728 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475731 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475733 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475736 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475739 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475741 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475744 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475746 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475749 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475751 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475754 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475756 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475759 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 10:19:30.479699 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475761 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475764 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475766 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475769 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475772 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475775 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475777 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475780 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475782 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475785 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475787 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475790 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475792 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475795 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475797 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475800 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475802 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475805 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475808 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 10:19:30.480218 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475811 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475813 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475830 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475833 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475838 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475842 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475845 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475848 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475851 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475854 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475857 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475860 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475863 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475865 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475868 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475870 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475874 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475877 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475880 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 10:19:30.480992 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475884 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475887 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475890 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475893 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475895 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475898 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475901 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475904 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475906 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475909 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475912 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475914 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475918 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475920 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475923 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475925 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475928 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475931 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475933 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475936 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 10:19:30.481640 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:30.475938 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 10:19:30.482162 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.475943 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 10:19:30.482162 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.476054 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 10:19:30.482162 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.478859 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 10:19:30.482162 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.480177 2577 server.go:1019] "Starting client certificate rotation" Jun 08 10:19:30.482162 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.480300 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 10:19:30.482162 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.480353 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 10:19:30.482928 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.482913 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 10:19:30.486188 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.486171 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 10:19:30.499985 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.499968 2577 log.go:25] "Validated CRI v1 runtime API" Jun 08 10:19:30.502701 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.502682 2577 log.go:25] "Validated CRI v1 image API" Jun 08 10:19:30.504211 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.504192 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 10:19:30.507570 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.507546 2577 fs.go:135] Filesystem UUIDs: map[1181e631-d7d6-41dc-af49-83dcbbcdda12:/dev/nvme0n1p4 3524c4a3-5946-4d6e-acd6-7ce3c8a9e8cb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 08 10:19:30.507621 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.507571 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 10:19:30.514400 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.514280 2577 manager.go:216] Machine: {Timestamp:2026-06-08 10:19:30.513034446 +0000 UTC m=+0.357236811 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3122640 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e128d764bbdc1d868967523e0fd28 SystemUUID:ec2e128d-764b-bdc1-d868-967523e0fd28 BootID:b8cf747d-197c-4170-a41c-ee4da37c3e0a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:07:d6:dc:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:07:d6:dc:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:9c:77:dc:7e:81 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 10:19:30.514400 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.514396 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 10:19:30.514517 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.514477 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 10:19:30.517036 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.517013 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 10:19:30.517174 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.517039 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 10:19:30.517896 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.517885 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 10:19:30.517929 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.517898 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 10:19:30.517929 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.517906 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 10:19:30.519382 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.519371 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 10:19:30.520211 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.520201 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 10:19:30.523224 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.523211 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 08 10:19:30.523528 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.523518 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 10:19:30.523569 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.523562 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 08 10:19:30.523598 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.523573 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 10:19:30.523629 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.523610 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 10:19:30.523656 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.523635 2577 kubelet.go:398] "Adding apiserver pod source" Jun 08 10:19:30.523686 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.523661 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 10:19:30.525342 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.525315 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 10:19:30.525860 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.525840 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 10:19:30.525935 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.525896 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 10:19:30.528798 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.528783 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 10:19:30.530744 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.530731 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 10:19:30.530794 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.530770 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 10:19:30.532070 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532057 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 10:19:30.532124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532074 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 10:19:30.532124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532080 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 10:19:30.532124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532085 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 10:19:30.532124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532094 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 10:19:30.532124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532099 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 10:19:30.532124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532107 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 10:19:30.532124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532113 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 10:19:30.532124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532120 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 10:19:30.532124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532126 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 10:19:30.532346 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532135 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 10:19:30.532346 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.532140 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 10:19:30.533549 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.533536 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 10:19:30.533610 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.533558 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 10:19:30.533655 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.533616 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 10:19:30.533712 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.533669 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 10:19:30.536009 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.535993 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 10:19:30.536922 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.536909 2577 server.go:1268] "Started kubelet" Jun 08 10:19:30.536994 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.536963 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 10:19:30.537042 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.536993 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 10:19:30.537221 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.537083 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 10:19:30.537750 ip-10-0-132-117 systemd[1]: Started Kubernetes Kubelet. Jun 08 10:19:30.538776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.538723 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 10:19:30.538776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.538730 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 08 10:19:30.543872 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.543840 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 10:19:30.544587 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.544567 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 10:19:30.544671 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.544588 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 10:19:30.544738 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.544670 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 08 10:19:30.545486 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.544512 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-117.ec2.internal.18b713d20d619500 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-117.ec2.internal,UID:ip-10-0-132-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-117.ec2.internal,},FirstTimestamp:2026-06-08 10:19:30.53687936 +0000 UTC m=+0.381081723,LastTimestamp:2026-06-08 10:19:30.53687936 +0000 UTC m=+0.381081723,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-117.ec2.internal,}" Jun 08 10:19:30.545594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.545488 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 10:19:30.545594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.545503 2577 factory.go:55] Registering systemd factory Jun 08 10:19:30.545594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.545511 2577 factory.go:223] Registration of the systemd container factory successfully Jun 08 10:19:30.545594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.545518 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 10:19:30.545594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.545548 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 10:19:30.545594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.545562 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 10:19:30.545875 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.545766 2577 factory.go:153] Registering CRI-O factory Jun 08 10:19:30.545875 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.545781 2577 factory.go:223] Registration of the crio container factory successfully Jun 08 10:19:30.545875 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.545801 2577 factory.go:103] Registering Raw factory Jun 08 10:19:30.545875 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.545813 2577 manager.go:1196] Started watching for new ooms in manager Jun 08 10:19:30.546448 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.546428 2577 manager.go:349] Starting recovery of all containers Jun 08 10:19:30.546726 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.546710 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 08 10:19:30.546726 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.546726 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 08 10:19:30.552206 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.552179 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 10:19:30.552309 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.552226 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 10:19:30.558050 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.557909 2577 manager.go:354] Recovery completed Jun 08 10:19:30.559341 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.559315 2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 08 10:19:30.562468 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.562452 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 10:19:30.565545 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.565528 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 08 10:19:30.565626 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.565557 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 10:19:30.565626 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.565568 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 08 10:19:30.566077 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.566061 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 10:19:30.566077 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.566071 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 10:19:30.566077 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.566078 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 10:19:30.566250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.566101 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 08 10:19:30.566843 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.566828 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 08 10:19:30.566948 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.566856 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 10:19:30.566948 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.566869 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 08 10:19:30.567762 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.567749 2577 policy_none.go:49] "None policy: Start" Jun 08 10:19:30.567808 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.567769 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 10:19:30.567808 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.567783 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 10:19:30.567987 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.567916 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-117.ec2.internal.18b713d20f16f5d2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-117.ec2.internal,UID:ip-10-0-132-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-117.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-117.ec2.internal,},FirstTimestamp:2026-06-08 10:19:30.565543378 +0000 UTC m=+0.409745740,LastTimestamp:2026-06-08 10:19:30.565543378 +0000 UTC m=+0.409745740,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-117.ec2.internal,}" Jun 08 10:19:30.568969 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.568954 2577 policy_none.go:47] "Start" Jun 08 10:19:30.574812 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.574735 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-117.ec2.internal.18b713d20f173f3b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-117.ec2.internal,UID:ip-10-0-132-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-117.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-117.ec2.internal,},FirstTimestamp:2026-06-08 10:19:30.565562171 +0000 UTC m=+0.409764533,LastTimestamp:2026-06-08 10:19:30.565562171 +0000 UTC m=+0.409764533,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-117.ec2.internal,}" Jun 08 10:19:30.576711 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.576648 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-117.ec2.internal.18b713d20f176976 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-117.ec2.internal,UID:ip-10-0-132-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-117.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-117.ec2.internal,},FirstTimestamp:2026-06-08 10:19:30.565572982 +0000 UTC m=+0.409775345,LastTimestamp:2026-06-08 10:19:30.565572982 +0000 UTC m=+0.409775345,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-117.ec2.internal,}" Jun 08 10:19:30.586440 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.586358 2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-117.ec2.internal.18b713d20f16f5d2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-117.ec2.internal.18b713d20f16f5d2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-117.ec2.internal,UID:ip-10-0-132-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-117.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-117.ec2.internal,},FirstTimestamp:2026-06-08 10:19:30.565543378 +0000 UTC m=+0.409745740,LastTimestamp:2026-06-08 10:19:30.566842793 +0000 UTC m=+0.411045160,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-117.ec2.internal,}" Jun 08 10:19:30.596977 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.596915 2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-117.ec2.internal.18b713d20f173f3b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-117.ec2.internal.18b713d20f173f3b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-117.ec2.internal,UID:ip-10-0-132-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-117.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-117.ec2.internal,},FirstTimestamp:2026-06-08 10:19:30.565562171 +0000 UTC m=+0.409764533,LastTimestamp:2026-06-08 10:19:30.566862134 +0000 UTC m=+0.411064499,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-117.ec2.internal,}" Jun 08 10:19:30.604876 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.604859 2577 manager.go:337] "Starting Device Plugin manager" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.604893 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.604902 2577 server.go:87] "Starting device plugin registration server" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.605151 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.605161 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.605271 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.605368 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.605376 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.606002 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.606051 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-117.ec2.internal\" not found" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.607181 2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-117.ec2.internal.18b713d20f176976\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-117.ec2.internal.18b713d20f176976 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-117.ec2.internal,UID:ip-10-0-132-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-117.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-117.ec2.internal,},FirstTimestamp:2026-06-08 10:19:30.565572982 +0000 UTC m=+0.409775345,LastTimestamp:2026-06-08 10:19:30.566875258 +0000 UTC m=+0.411077622,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-117.ec2.internal,}" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.613069 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.614265 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.614302 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.614331 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.614383 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.616221 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 08 10:19:30.618011 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.616278 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-117.ec2.internal.18b713d211914605 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-117.ec2.internal,UID:ip-10-0-132-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-132-117.ec2.internal,},FirstTimestamp:2026-06-08 10:19:30.607113733 +0000 UTC m=+0.451316091,LastTimestamp:2026-06-08 10:19:30.607113733 +0000 UTC m=+0.451316091,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-117.ec2.internal,}" Jun 08 10:19:30.630381 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.630363 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wqd8w" Jun 08 10:19:30.641143 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.641126 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wqd8w" Jun 08 10:19:30.705653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.705627 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 10:19:30.706806 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.706745 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 08 10:19:30.706806 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.706790 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 10:19:30.706806 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.706805 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 08 10:19:30.706948 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.706844 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.714669 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.714638 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal"] Jun 08 10:19:30.714776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.714706 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 10:19:30.718022 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.718005 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 08 10:19:30.718116 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.718039 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 10:19:30.718116 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.718053 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 08 10:19:30.719533 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.719518 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 10:19:30.719630 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.719614 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.719686 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.719657 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 10:19:30.720243 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.720227 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 08 10:19:30.720312 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.720253 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 10:19:30.720312 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.720263 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 08 10:19:30.720312 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.720232 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 08 10:19:30.720452 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.720324 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 10:19:30.720452 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.720339 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 08 10:19:30.721616 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.721602 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.721671 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.721627 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 10:19:30.722263 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.722248 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 08 10:19:30.722363 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.722277 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 10:19:30.722363 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.722290 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 08 10:19:30.728978 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.728962 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.729048 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.728983 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-117.ec2.internal\": node \"ip-10-0-132-117.ec2.internal\" not found" Jun 08 10:19:30.747870 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.747812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c31271bbde5f4411a9e783b19068f04-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"9c31271bbde5f4411a9e783b19068f04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.747968 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.747870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.747968 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.747893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.749680 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.749664 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-117.ec2.internal\" not found" node="ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.753200 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.753182 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-117.ec2.internal\" not found" node="ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.761050 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.761034 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 08 10:19:30.848587 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.848557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c31271bbde5f4411a9e783b19068f04-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"9c31271bbde5f4411a9e783b19068f04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.848587 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.848590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.848734 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.848606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.848734 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.848645 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c31271bbde5f4411a9e783b19068f04-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"9c31271bbde5f4411a9e783b19068f04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.848734 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.848706 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.848846 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:30.848747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 08 10:19:30.861712 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.861683 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 08 10:19:30.962261 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:30.962176 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 08 10:19:31.053940 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.053912 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 08 10:19:31.058059 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.058029 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 08 10:19:31.062969 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.062954 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 08 10:19:31.163614 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.163569 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 08 10:19:31.264107 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.264035 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 08 10:19:31.364753 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.364713 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 08 10:19:31.369397 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.369379 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 10:19:31.428648 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.428615 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 10:19:31.445330 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.445300 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 08 10:19:31.455861 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.455837 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 10:19:31.456610 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.456591 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 08 10:19:31.467612 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.467589 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 10:19:31.479741 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.479722 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 10:19:31.479923 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.479905 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 10:19:31.479971 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.479915 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 10:19:31.525113 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.525047 2577 apiserver.go:52] "Watching apiserver" Jun 08 10:19:31.541327 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.541296 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 10:19:31.541697 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.541676 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-84tx9","kube-system/konnectivity-agent-dm92z","kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal","openshift-dns/node-resolver-r52bt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal","openshift-multus/multus-fbj9v","openshift-multus/network-metrics-daemon-hzg8m","openshift-network-operator/iptables-alerter-xc5j5","openshift-ovn-kubernetes/ovnkube-node-7s4qb","kube-system/global-pull-secret-syncer-lcwbh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b","openshift-cluster-node-tuning-operator/tuned-cslrb","openshift-image-registry/node-ca-g4ksc","openshift-multus/multus-additional-cni-plugins-rx6rw"] Jun 08 10:19:31.543242 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.543221 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:31.543333 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.543304 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:31.544700 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.544681 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 10:19:31.544784 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.544713 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.545934 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.545916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.546926 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.546908 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 10:19:31.547054 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.547037 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r52bt" Jun 08 10:19:31.547054 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.547048 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 10:19:31.547165 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.547096 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bxklg\"" Jun 08 10:19:31.547595 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.547579 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 10:19:31.548232 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.548215 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 10:19:31.548354 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.548338 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xc5j5" Jun 08 10:19:31.548414 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.548375 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 10:19:31.548414 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.548381 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 10:19:31.548508 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.548417 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bm6f6\"" Jun 08 10:19:31.548508 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.548484 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 10:19:31.548908 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.548889 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 10:19:31.549599 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.549531 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l57p9\"" Jun 08 10:19:31.549681 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.549597 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 10:19:31.550145 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.550120 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.550244 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.550126 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 10:19:31.552054 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.552150 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-os-release\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.552150 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.552150 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552077 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 10:19:31.552150 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlspt\" (UniqueName: \"kubernetes.io/projected/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-kube-api-access-tlspt\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.552375 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng84n\" (UniqueName: \"kubernetes.io/projected/90295d28-34ba-447d-9517-0520ee42f937-kube-api-access-ng84n\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:31.552375 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552265 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 10:19:31.552375 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552267 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-socket-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.552518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-device-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.552518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-etc-selinux\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.552518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552431 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 10:19:31.552518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-642vt\" (UniqueName: \"kubernetes.io/projected/3329197c-0b71-4332-9684-a73656d1868a-kube-api-access-642vt\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.552715 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-system-cni-dir\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.552715 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.552715 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552592 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bkz5t\"" Jun 08 10:19:31.552715 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-registration-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.552924 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-sys-fs\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.552924 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-cnibin\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.552924 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-cni-binary-copy\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.552924 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.552924 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.552873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:31.553151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.553018 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cdkzl\"" Jun 08 10:19:31.553151 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.553062 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 10:19:31.553531 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.553516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.554228 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.554211 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g4ksc" Jun 08 10:19:31.555914 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.555895 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:19:31.556496 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.556476 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 10:19:31.556878 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.556854 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 10:19:31.557552 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.557268 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:31.557552 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.557345 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:31.557787 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.557766 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 10:19:31.558050 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.558014 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 10:19:31.558050 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.558021 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 10:19:31.558183 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.558081 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 10:19:31.558183 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.558121 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 10:19:31.558280 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.558189 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 10:19:31.558280 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.558193 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tb68k\"" Jun 08 10:19:31.558475 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.558456 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 10:19:31.558561 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.558516 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wvrwx\"" Jun 08 10:19:31.558894 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.558878 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 10:19:31.558981 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.558956 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bpd8b\"" Jun 08 10:19:31.559080 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.559065 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 10:19:31.559239 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.559225 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:31.559302 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.559286 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:31.560643 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.560628 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.569676 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.569661 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 10:19:31.569901 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.569888 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-frzg8\"" Jun 08 10:19:31.569952 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.569910 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 10:19:31.571120 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.571106 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 10:19:31.575579 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:31.575542 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747a1ff862514f63c638769a18b3468e.slice/crio-a59186995e89fd473657fccbf8567f9311371980486f3cdfe8d201a31091c5a6 WatchSource:0}: Error finding container a59186995e89fd473657fccbf8567f9311371980486f3cdfe8d201a31091c5a6: Status 404 returned error can't find the container with id a59186995e89fd473657fccbf8567f9311371980486f3cdfe8d201a31091c5a6 Jun 08 10:19:31.576162 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:31.576144 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c31271bbde5f4411a9e783b19068f04.slice/crio-6cb368b14064893a8f42a216a72fb8cc26e324646b89fa7c1149a8f4c62d3d9f WatchSource:0}: Error finding container 6cb368b14064893a8f42a216a72fb8cc26e324646b89fa7c1149a8f4c62d3d9f: Status 404 returned error can't find the container with id 6cb368b14064893a8f42a216a72fb8cc26e324646b89fa7c1149a8f4c62d3d9f Jun 08 10:19:31.579184 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.579169 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 10:19:31.581214 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.581198 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 10:19:31.616707 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.616641 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9c6b" Jun 08 10:19:31.618473 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.618428 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" event={"ID":"9c31271bbde5f4411a9e783b19068f04","Type":"ContainerStarted","Data":"6cb368b14064893a8f42a216a72fb8cc26e324646b89fa7c1149a8f4c62d3d9f"} Jun 08 10:19:31.619528 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.619511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"747a1ff862514f63c638769a18b3468e","Type":"ContainerStarted","Data":"a59186995e89fd473657fccbf8567f9311371980486f3cdfe8d201a31091c5a6"} Jun 08 10:19:31.628802 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.628787 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 10:19:31.630980 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.630966 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9c6b" Jun 08 10:19:31.643669 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.643633 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 10:14:30 +0000 UTC" deadline="2028-02-24 00:16:27.25657101 +0000 UTC" Jun 08 10:19:31.643728 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.643668 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15013h56m55.61290526s" Jun 08 10:19:31.647942 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.647800 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 10:19:31.653983 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.653961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-cnibin\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.654065 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.653991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-cni-binary-copy\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.654065 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e17377ad-cffa-42a7-bb74-fa2e7a3feb7a-host-slash\") pod \"iptables-alerter-xc5j5\" (UID: \"e17377ad-cffa-42a7-bb74-fa2e7a3feb7a\") " pod="openshift-network-operator/iptables-alerter-xc5j5" Jun 08 10:19:31.654065 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-var-lib-cni-bin\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.654065 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-sysctl-conf\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.654202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-systemd\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.654202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-cnibin\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.654202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwf92\" (UniqueName: \"kubernetes.io/projected/af413261-7dd4-4de4-a0a9-e308dd3b437b-kube-api-access-cwf92\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.654202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnb7t\" (UniqueName: \"kubernetes.io/projected/e17377ad-cffa-42a7-bb74-fa2e7a3feb7a-kube-api-access-tnb7t\") pod \"iptables-alerter-xc5j5\" (UID: \"e17377ad-cffa-42a7-bb74-fa2e7a3feb7a\") " pod="openshift-network-operator/iptables-alerter-xc5j5" Jun 08 10:19:31.654202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-var-lib-cni-multus\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.654202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/389cee50-7051-4bd9-b037-49c40f04eacc-multus-daemon-config\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.654392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-run-systemd\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.654392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqcn9\" (UniqueName: \"kubernetes.io/projected/439e2bac-1174-41b6-9418-9091f93effba-kube-api-access-jqcn9\") pod \"node-ca-g4ksc\" (UID: \"439e2bac-1174-41b6-9418-9091f93effba\") " pod="openshift-image-registry/node-ca-g4ksc" Jun 08 10:19:31.654392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-642vt\" (UniqueName: \"kubernetes.io/projected/3329197c-0b71-4332-9684-a73656d1868a-kube-api-access-642vt\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.654392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654263 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-system-cni-dir\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.654392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-cnibin\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.654392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-etc-kubernetes\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.654392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-run-ovn\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.654392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e436b793-82b9-4abe-9697-4ee2c4ba471c-ovn-node-metrics-cert\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.654392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654375 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-tuned\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.654392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af413261-7dd4-4de4-a0a9-e308dd3b437b-tmp\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654413 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-run-k8s-cni-cncf-io\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d221238c-1f7d-4b43-9e5b-30a88c8f9685-konnectivity-ca\") pod \"konnectivity-agent-dm92z\" (UID: \"d221238c-1f7d-4b43-9e5b-30a88c8f9685\") " pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-registration-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654517 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-cni-binary-copy\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654558 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-registration-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-sys\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng84n\" (UniqueName: \"kubernetes.io/projected/90295d28-34ba-447d-9517-0520ee42f937-kube-api-access-ng84n\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.654607 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654614 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-hostroot\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-kubelet\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-cni-bin\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9crl\" (UniqueName: \"kubernetes.io/projected/e436b793-82b9-4abe-9697-4ee2c4ba471c-kube-api-access-m9crl\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.654693 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs podName:90295d28-34ba-447d-9517-0520ee42f937 nodeName:}" failed. No retries permitted until 2026-06-08 10:19:32.154671625 +0000 UTC m=+1.998873998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs") pod "network-metrics-daemon-hzg8m" (UID: "90295d28-34ba-447d-9517-0520ee42f937") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.654906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-var-lib-kubelet\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-run-netns\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-modprobe-d\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654882 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-run\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654904 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42ab1983-d354-4c86-813c-cdc7b031523d-tmp-dir\") pod \"node-resolver-r52bt\" (UID: \"42ab1983-d354-4c86-813c-cdc7b031523d\") " pod="openshift-dns/node-resolver-r52bt" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/389cee50-7051-4bd9-b037-49c40f04eacc-cni-binary-copy\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.654968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-sys-fs\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655026 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-sys-fs\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-run-netns\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e436b793-82b9-4abe-9697-4ee2c4ba471c-env-overrides\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/439e2bac-1174-41b6-9418-9091f93effba-serviceca\") pod \"node-ca-g4ksc\" (UID: \"439e2bac-1174-41b6-9418-9091f93effba\") " pod="openshift-image-registry/node-ca-g4ksc" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d314f158-a213-4ad2-b9a8-66df7dee61f6-kubelet-config\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655167 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-kubernetes\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.655594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e17377ad-cffa-42a7-bb74-fa2e7a3feb7a-iptables-alerter-script\") pod \"iptables-alerter-xc5j5\" (UID: \"e17377ad-cffa-42a7-bb74-fa2e7a3feb7a\") " pod="openshift-network-operator/iptables-alerter-xc5j5" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-multus-socket-dir-parent\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-multus-conf-dir\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-systemd-units\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655361 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d314f158-a213-4ad2-b9a8-66df7dee61f6-dbus\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655392 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-etc-selinux\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-system-cni-dir\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655477 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-multus-cni-dir\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-log-socket\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655507 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-etc-selinux\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.656238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e436b793-82b9-4abe-9697-4ee2c4ba471c-ovnkube-script-lib\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-run-multus-certs\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655540 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-system-cni-dir\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-run-openvswitch\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42ab1983-d354-4c86-813c-cdc7b031523d-hosts-file\") pod \"node-resolver-r52bt\" (UID: \"42ab1983-d354-4c86-813c-cdc7b031523d\") " pod="openshift-dns/node-resolver-r52bt" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv5ls\" (UniqueName: \"kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls\") pod \"network-check-target-84tx9\" (UID: \"640d0bde-0a46-4cd1-b802-31336f4f618d\") " pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-lib-modules\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-var-lib-kubelet\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-var-lib-openvswitch\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-os-release\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlspt\" (UniqueName: \"kubernetes.io/projected/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-kube-api-access-tlspt\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655754 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-etc-openvswitch\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-os-release\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-cni-netd\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655804 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/439e2bac-1174-41b6-9418-9091f93effba-host\") pod \"node-ca-g4ksc\" (UID: \"439e2bac-1174-41b6-9418-9091f93effba\") " pod="openshift-image-registry/node-ca-g4ksc" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655836 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d221238c-1f7d-4b43-9e5b-30a88c8f9685-agent-certs\") pod \"konnectivity-agent-dm92z\" (UID: \"d221238c-1f7d-4b43-9e5b-30a88c8f9685\") " pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:19:31.656675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-sysctl-d\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-socket-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-device-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655919 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-slash\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-run-ovn-kubernetes\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655962 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-device-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655968 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3329197c-0b71-4332-9684-a73656d1868a-socket-dir\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.655969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e436b793-82b9-4abe-9697-4ee2c4ba471c-ovnkube-config\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.656024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2slww\" (UniqueName: \"kubernetes.io/projected/42ab1983-d354-4c86-813c-cdc7b031523d-kube-api-access-2slww\") pod \"node-resolver-r52bt\" (UID: \"42ab1983-d354-4c86-813c-cdc7b031523d\") " pod="openshift-dns/node-resolver-r52bt" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.656045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-host\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.656059 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-os-release\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.656074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dghr5\" (UniqueName: \"kubernetes.io/projected/389cee50-7051-4bd9-b037-49c40f04eacc-kube-api-access-dghr5\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.656092 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-node-log\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.657129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.656105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-sysconfig\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.664515 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.664493 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 10:19:31.667496 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.667467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlspt\" (UniqueName: \"kubernetes.io/projected/736829ca-c2c8-4a61-a598-2cdda4ff0ea5-kube-api-access-tlspt\") pod \"multus-additional-cni-plugins-rx6rw\" (UID: \"736829ca-c2c8-4a61-a598-2cdda4ff0ea5\") " pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.667496 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.667481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-642vt\" (UniqueName: \"kubernetes.io/projected/3329197c-0b71-4332-9684-a73656d1868a-kube-api-access-642vt\") pod \"aws-ebs-csi-driver-node-bgn2b\" (UID: \"3329197c-0b71-4332-9684-a73656d1868a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.667496 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.667487 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng84n\" (UniqueName: \"kubernetes.io/projected/90295d28-34ba-447d-9517-0520ee42f937-kube-api-access-ng84n\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:31.756489 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e17377ad-cffa-42a7-bb74-fa2e7a3feb7a-host-slash\") pod \"iptables-alerter-xc5j5\" (UID: \"e17377ad-cffa-42a7-bb74-fa2e7a3feb7a\") " pod="openshift-network-operator/iptables-alerter-xc5j5" Jun 08 10:19:31.756489 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-var-lib-cni-bin\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-sysctl-conf\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756523 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-systemd\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwf92\" (UniqueName: \"kubernetes.io/projected/af413261-7dd4-4de4-a0a9-e308dd3b437b-kube-api-access-cwf92\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756588 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e17377ad-cffa-42a7-bb74-fa2e7a3feb7a-host-slash\") pod \"iptables-alerter-xc5j5\" (UID: \"e17377ad-cffa-42a7-bb74-fa2e7a3feb7a\") " pod="openshift-network-operator/iptables-alerter-xc5j5" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnb7t\" (UniqueName: \"kubernetes.io/projected/e17377ad-cffa-42a7-bb74-fa2e7a3feb7a-kube-api-access-tnb7t\") pod \"iptables-alerter-xc5j5\" (UID: \"e17377ad-cffa-42a7-bb74-fa2e7a3feb7a\") " pod="openshift-network-operator/iptables-alerter-xc5j5" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756624 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-systemd\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-var-lib-cni-multus\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756655 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-sysctl-conf\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756656 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-var-lib-cni-multus\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-var-lib-cni-bin\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/389cee50-7051-4bd9-b037-49c40f04eacc-multus-daemon-config\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.756718 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-run-systemd\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqcn9\" (UniqueName: \"kubernetes.io/projected/439e2bac-1174-41b6-9418-9091f93effba-kube-api-access-jqcn9\") pod \"node-ca-g4ksc\" (UID: \"439e2bac-1174-41b6-9418-9091f93effba\") " pod="openshift-image-registry/node-ca-g4ksc" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-system-cni-dir\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756766 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-run-systemd\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-cnibin\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-etc-kubernetes\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-run-ovn\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-cnibin\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756891 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-etc-kubernetes\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e436b793-82b9-4abe-9697-4ee2c4ba471c-ovn-node-metrics-cert\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-tuned\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756945 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-run-ovn\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756952 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-system-cni-dir\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af413261-7dd4-4de4-a0a9-e308dd3b437b-tmp\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.756986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-run-k8s-cni-cncf-io\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d221238c-1f7d-4b43-9e5b-30a88c8f9685-konnectivity-ca\") pod \"konnectivity-agent-dm92z\" (UID: \"d221238c-1f7d-4b43-9e5b-30a88c8f9685\") " pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-sys\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-hostroot\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.757284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-run-k8s-cni-cncf-io\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757107 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-sys\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-kubelet\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-cni-bin\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757147 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-hostroot\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9crl\" (UniqueName: \"kubernetes.io/projected/e436b793-82b9-4abe-9697-4ee2c4ba471c-kube-api-access-m9crl\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757186 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-kubelet\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757196 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-var-lib-kubelet\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-run-netns\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-var-lib-kubelet\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-modprobe-d\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757296 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/389cee50-7051-4bd9-b037-49c40f04eacc-multus-daemon-config\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757296 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-run-netns\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757221 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-cni-bin\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-run\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757375 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-run\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.758138 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42ab1983-d354-4c86-813c-cdc7b031523d-tmp-dir\") pod \"node-resolver-r52bt\" (UID: \"42ab1983-d354-4c86-813c-cdc7b031523d\") " pod="openshift-dns/node-resolver-r52bt" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757525 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-modprobe-d\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/389cee50-7051-4bd9-b037-49c40f04eacc-cni-binary-copy\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-run-netns\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d221238c-1f7d-4b43-9e5b-30a88c8f9685-konnectivity-ca\") pod \"konnectivity-agent-dm92z\" (UID: \"d221238c-1f7d-4b43-9e5b-30a88c8f9685\") " pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-run-netns\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e436b793-82b9-4abe-9697-4ee2c4ba471c-env-overrides\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/439e2bac-1174-41b6-9418-9091f93effba-serviceca\") pod \"node-ca-g4ksc\" (UID: \"439e2bac-1174-41b6-9418-9091f93effba\") " pod="openshift-image-registry/node-ca-g4ksc" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42ab1983-d354-4c86-813c-cdc7b031523d-tmp-dir\") pod \"node-resolver-r52bt\" (UID: \"42ab1983-d354-4c86-813c-cdc7b031523d\") " pod="openshift-dns/node-resolver-r52bt" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d314f158-a213-4ad2-b9a8-66df7dee61f6-kubelet-config\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d314f158-a213-4ad2-b9a8-66df7dee61f6-kubelet-config\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757886 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-kubernetes\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e17377ad-cffa-42a7-bb74-fa2e7a3feb7a-iptables-alerter-script\") pod \"iptables-alerter-xc5j5\" (UID: \"e17377ad-cffa-42a7-bb74-fa2e7a3feb7a\") " pod="openshift-network-operator/iptables-alerter-xc5j5" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-multus-socket-dir-parent\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757972 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-multus-conf-dir\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.757997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-systemd-units\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d314f158-a213-4ad2-b9a8-66df7dee61f6-dbus\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758046 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/389cee50-7051-4bd9-b037-49c40f04eacc-cni-binary-copy\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.759055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-kubernetes\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.758135 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.758198 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret podName:d314f158-a213-4ad2-b9a8-66df7dee61f6 nodeName:}" failed. No retries permitted until 2026-06-08 10:19:32.2581822 +0000 UTC m=+2.102384563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret") pod "global-pull-secret-syncer-lcwbh" (UID: "d314f158-a213-4ad2-b9a8-66df7dee61f6") : object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/439e2bac-1174-41b6-9418-9091f93effba-serviceca\") pod \"node-ca-g4ksc\" (UID: \"439e2bac-1174-41b6-9418-9091f93effba\") " pod="openshift-image-registry/node-ca-g4ksc" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e436b793-82b9-4abe-9697-4ee2c4ba471c-env-overrides\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-multus-cni-dir\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758290 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-multus-socket-dir-parent\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-log-socket\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758327 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-multus-conf-dir\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e436b793-82b9-4abe-9697-4ee2c4ba471c-ovnkube-script-lib\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-run-multus-certs\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-run-openvswitch\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758406 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-multus-cni-dir\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42ab1983-d354-4c86-813c-cdc7b031523d-hosts-file\") pod \"node-resolver-r52bt\" (UID: \"42ab1983-d354-4c86-813c-cdc7b031523d\") " pod="openshift-dns/node-resolver-r52bt" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5ls\" (UniqueName: \"kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls\") pod \"network-check-target-84tx9\" (UID: \"640d0bde-0a46-4cd1-b802-31336f4f618d\") " pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758450 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-log-socket\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.759783 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-lib-modules\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-run-openvswitch\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-var-lib-kubelet\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-var-lib-openvswitch\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758526 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-host-run-multus-certs\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758546 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-etc-openvswitch\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-cni-netd\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758580 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-systemd-units\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/439e2bac-1174-41b6-9418-9091f93effba-host\") pod \"node-ca-g4ksc\" (UID: \"439e2bac-1174-41b6-9418-9091f93effba\") " pod="openshift-image-registry/node-ca-g4ksc" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d221238c-1f7d-4b43-9e5b-30a88c8f9685-agent-certs\") pod \"konnectivity-agent-dm92z\" (UID: \"d221238c-1f7d-4b43-9e5b-30a88c8f9685\") " pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e17377ad-cffa-42a7-bb74-fa2e7a3feb7a-iptables-alerter-script\") pod \"iptables-alerter-xc5j5\" (UID: \"e17377ad-cffa-42a7-bb74-fa2e7a3feb7a\") " pod="openshift-network-operator/iptables-alerter-xc5j5" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758629 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-var-lib-kubelet\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-sysctl-d\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-slash\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758693 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-var-lib-openvswitch\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-run-ovn-kubernetes\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758742 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-etc-openvswitch\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d314f158-a213-4ad2-b9a8-66df7dee61f6-dbus\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758792 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-run-ovn-kubernetes\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e436b793-82b9-4abe-9697-4ee2c4ba471c-ovnkube-script-lib\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/439e2bac-1174-41b6-9418-9091f93effba-host\") pod \"node-ca-g4ksc\" (UID: \"439e2bac-1174-41b6-9418-9091f93effba\") " pod="openshift-image-registry/node-ca-g4ksc" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758851 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-cni-netd\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42ab1983-d354-4c86-813c-cdc7b031523d-hosts-file\") pod \"node-resolver-r52bt\" (UID: \"42ab1983-d354-4c86-813c-cdc7b031523d\") " pod="openshift-dns/node-resolver-r52bt" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e436b793-82b9-4abe-9697-4ee2c4ba471c-ovnkube-config\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2slww\" (UniqueName: \"kubernetes.io/projected/42ab1983-d354-4c86-813c-cdc7b031523d-kube-api-access-2slww\") pod \"node-resolver-r52bt\" (UID: \"42ab1983-d354-4c86-813c-cdc7b031523d\") " pod="openshift-dns/node-resolver-r52bt" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-host\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-host-slash\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.758981 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-sysctl-d\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759028 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-lib-modules\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759269 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-host\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-os-release\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dghr5\" (UniqueName: \"kubernetes.io/projected/389cee50-7051-4bd9-b037-49c40f04eacc-kube-api-access-dghr5\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759454 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/389cee50-7051-4bd9-b037-49c40f04eacc-os-release\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-node-log\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-sysconfig\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.760746 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759635 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-sysconfig\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.761262 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759649 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af413261-7dd4-4de4-a0a9-e308dd3b437b-etc-tuned\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.761262 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759676 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af413261-7dd4-4de4-a0a9-e308dd3b437b-tmp\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.761262 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759694 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e436b793-82b9-4abe-9697-4ee2c4ba471c-node-log\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.761262 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.759716 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e436b793-82b9-4abe-9697-4ee2c4ba471c-ovn-node-metrics-cert\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.761262 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.760168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e436b793-82b9-4abe-9697-4ee2c4ba471c-ovnkube-config\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.761262 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.761039 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d221238c-1f7d-4b43-9e5b-30a88c8f9685-agent-certs\") pod \"konnectivity-agent-dm92z\" (UID: \"d221238c-1f7d-4b43-9e5b-30a88c8f9685\") " pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:19:31.774537 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.774506 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 10:19:31.774537 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.774532 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 10:19:31.774537 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.774545 2577 projected.go:196] Error preparing data for projected volume kube-api-access-pv5ls for pod openshift-network-diagnostics/network-check-target-84tx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:31.774781 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:31.774610 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls podName:640d0bde-0a46-4cd1-b802-31336f4f618d nodeName:}" failed. No retries permitted until 2026-06-08 10:19:32.27459276 +0000 UTC m=+2.118795112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pv5ls" (UniqueName: "kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls") pod "network-check-target-84tx9" (UID: "640d0bde-0a46-4cd1-b802-31336f4f618d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:31.775178 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.775129 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqcn9\" (UniqueName: \"kubernetes.io/projected/439e2bac-1174-41b6-9418-9091f93effba-kube-api-access-jqcn9\") pod \"node-ca-g4ksc\" (UID: \"439e2bac-1174-41b6-9418-9091f93effba\") " pod="openshift-image-registry/node-ca-g4ksc" Jun 08 10:19:31.775896 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.775845 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwf92\" (UniqueName: \"kubernetes.io/projected/af413261-7dd4-4de4-a0a9-e308dd3b437b-kube-api-access-cwf92\") pod \"tuned-cslrb\" (UID: \"af413261-7dd4-4de4-a0a9-e308dd3b437b\") " pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.776958 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.776939 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2slww\" (UniqueName: \"kubernetes.io/projected/42ab1983-d354-4c86-813c-cdc7b031523d-kube-api-access-2slww\") pod \"node-resolver-r52bt\" (UID: \"42ab1983-d354-4c86-813c-cdc7b031523d\") " pod="openshift-dns/node-resolver-r52bt" Jun 08 10:19:31.776958 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.776943 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnb7t\" (UniqueName: \"kubernetes.io/projected/e17377ad-cffa-42a7-bb74-fa2e7a3feb7a-kube-api-access-tnb7t\") pod \"iptables-alerter-xc5j5\" (UID: \"e17377ad-cffa-42a7-bb74-fa2e7a3feb7a\") " pod="openshift-network-operator/iptables-alerter-xc5j5" Jun 08 10:19:31.777573 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.777558 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dghr5\" (UniqueName: \"kubernetes.io/projected/389cee50-7051-4bd9-b037-49c40f04eacc-kube-api-access-dghr5\") pod \"multus-fbj9v\" (UID: \"389cee50-7051-4bd9-b037-49c40f04eacc\") " pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.777642 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.777628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9crl\" (UniqueName: \"kubernetes.io/projected/e436b793-82b9-4abe-9697-4ee2c4ba471c-kube-api-access-m9crl\") pod \"ovnkube-node-7s4qb\" (UID: \"e436b793-82b9-4abe-9697-4ee2c4ba471c\") " pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.860578 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.860549 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" Jun 08 10:19:31.869079 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:31.869057 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3329197c_0b71_4332_9684_a73656d1868a.slice/crio-22cbc659513aba1c5b721dc2a72f369a4358192612139414ddbe701233356af9 WatchSource:0}: Error finding container 22cbc659513aba1c5b721dc2a72f369a4358192612139414ddbe701233356af9: Status 404 returned error can't find the container with id 22cbc659513aba1c5b721dc2a72f369a4358192612139414ddbe701233356af9 Jun 08 10:19:31.881753 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.881734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rx6rw" Jun 08 10:19:31.888675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.888654 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r52bt" Jun 08 10:19:31.890882 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:31.890801 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736829ca_c2c8_4a61_a598_2cdda4ff0ea5.slice/crio-2e4ae177f074a0fbec6634967b8c394aef208dde42f0617c33d40cbd90358816 WatchSource:0}: Error finding container 2e4ae177f074a0fbec6634967b8c394aef208dde42f0617c33d40cbd90358816: Status 404 returned error can't find the container with id 2e4ae177f074a0fbec6634967b8c394aef208dde42f0617c33d40cbd90358816 Jun 08 10:19:31.892648 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.892626 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xc5j5" Jun 08 10:19:31.895789 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:31.895766 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ab1983_d354_4c86_813c_cdc7b031523d.slice/crio-221c00044705f5d208fa21ae0bf6bae29f341f7310cad269e12de89e09be0b0e WatchSource:0}: Error finding container 221c00044705f5d208fa21ae0bf6bae29f341f7310cad269e12de89e09be0b0e: Status 404 returned error can't find the container with id 221c00044705f5d208fa21ae0bf6bae29f341f7310cad269e12de89e09be0b0e Jun 08 10:19:31.897790 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.897769 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fbj9v" Jun 08 10:19:31.902058 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:31.902037 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17377ad_cffa_42a7_bb74_fa2e7a3feb7a.slice/crio-8af327aeb9f4e1bbbb3554e3bf1f25a38a7334baf94ddc64b70f6cdfedf0e0da WatchSource:0}: Error finding container 8af327aeb9f4e1bbbb3554e3bf1f25a38a7334baf94ddc64b70f6cdfedf0e0da: Status 404 returned error can't find the container with id 8af327aeb9f4e1bbbb3554e3bf1f25a38a7334baf94ddc64b70f6cdfedf0e0da Jun 08 10:19:31.903166 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.903148 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:31.908938 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.908917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g4ksc" Jun 08 10:19:31.909712 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:31.909686 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389cee50_7051_4bd9_b037_49c40f04eacc.slice/crio-977e6e0b07eaee5f4933011ba6e6982204df045b12ae1503fb76ae0ff170a654 WatchSource:0}: Error finding container 977e6e0b07eaee5f4933011ba6e6982204df045b12ae1503fb76ae0ff170a654: Status 404 returned error can't find the container with id 977e6e0b07eaee5f4933011ba6e6982204df045b12ae1503fb76ae0ff170a654 Jun 08 10:19:31.913179 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:31.913153 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode436b793_82b9_4abe_9697_4ee2c4ba471c.slice/crio-e42a3e9aad3fd3a39eb1cc65a1e35ddb3c038c87ecbd0cc3d25fbd65fcdbc7c5 WatchSource:0}: Error finding container e42a3e9aad3fd3a39eb1cc65a1e35ddb3c038c87ecbd0cc3d25fbd65fcdbc7c5: Status 404 returned error can't find the container with id e42a3e9aad3fd3a39eb1cc65a1e35ddb3c038c87ecbd0cc3d25fbd65fcdbc7c5 Jun 08 10:19:31.914300 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.914279 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:19:31.919003 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:31.918974 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cslrb" Jun 08 10:19:31.919151 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:31.919133 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439e2bac_1174_41b6_9418_9091f93effba.slice/crio-46150ae59d7a414917bb3bcdb94d6ee33b3cb156abd44ea3a66dc247998dd503 WatchSource:0}: Error finding container 46150ae59d7a414917bb3bcdb94d6ee33b3cb156abd44ea3a66dc247998dd503: Status 404 returned error can't find the container with id 46150ae59d7a414917bb3bcdb94d6ee33b3cb156abd44ea3a66dc247998dd503 Jun 08 10:19:31.929091 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:19:31.929068 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf413261_7dd4_4de4_a0a9_e308dd3b437b.slice/crio-d1c213661947717d5035d9bb981a2439ede9a094b4f74f340efa497072b2a931 WatchSource:0}: Error finding container d1c213661947717d5035d9bb981a2439ede9a094b4f74f340efa497072b2a931: Status 404 returned error can't find the container with id d1c213661947717d5035d9bb981a2439ede9a094b4f74f340efa497072b2a931 Jun 08 10:19:32.162792 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.162691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:32.162997 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:32.162913 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:32.162997 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:32.162982 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs podName:90295d28-34ba-447d-9517-0520ee42f937 nodeName:}" failed. No retries permitted until 2026-06-08 10:19:33.162962961 +0000 UTC m=+3.007165317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs") pod "network-metrics-daemon-hzg8m" (UID: "90295d28-34ba-447d-9517-0520ee42f937") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:32.264278 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.264245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:32.264435 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:32.264417 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:32.264533 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:32.264521 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret podName:d314f158-a213-4ad2-b9a8-66df7dee61f6 nodeName:}" failed. No retries permitted until 2026-06-08 10:19:33.264498782 +0000 UTC m=+3.108701147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret") pod "global-pull-secret-syncer-lcwbh" (UID: "d314f158-a213-4ad2-b9a8-66df7dee61f6") : object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:32.365187 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.365146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5ls\" (UniqueName: \"kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls\") pod \"network-check-target-84tx9\" (UID: \"640d0bde-0a46-4cd1-b802-31336f4f618d\") " pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:32.365404 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:32.365387 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 10:19:32.365472 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:32.365412 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 10:19:32.365472 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:32.365426 2577 projected.go:196] Error preparing data for projected volume kube-api-access-pv5ls for pod openshift-network-diagnostics/network-check-target-84tx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:32.365574 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:32.365487 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls podName:640d0bde-0a46-4cd1-b802-31336f4f618d nodeName:}" failed. No retries permitted until 2026-06-08 10:19:33.365468117 +0000 UTC m=+3.209670469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv5ls" (UniqueName: "kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls") pod "network-check-target-84tx9" (UID: "640d0bde-0a46-4cd1-b802-31336f4f618d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:32.634509 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.634399 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 10:14:31 +0000 UTC" deadline="2028-01-30 10:36:06.25413391 +0000 UTC" Jun 08 10:19:32.634509 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.634462 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14424h16m33.619676092s" Jun 08 10:19:32.649216 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.649179 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cslrb" event={"ID":"af413261-7dd4-4de4-a0a9-e308dd3b437b","Type":"ContainerStarted","Data":"d1c213661947717d5035d9bb981a2439ede9a094b4f74f340efa497072b2a931"} Jun 08 10:19:32.670467 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.670205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dm92z" event={"ID":"d221238c-1f7d-4b43-9e5b-30a88c8f9685","Type":"ContainerStarted","Data":"ca7edfe19a9beafcc2e9df0c3c5d45e37bde1918c0b5fbb6dd89bc5cf980f7d7"} Jun 08 10:19:32.687226 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.687186 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g4ksc" event={"ID":"439e2bac-1174-41b6-9418-9091f93effba","Type":"ContainerStarted","Data":"46150ae59d7a414917bb3bcdb94d6ee33b3cb156abd44ea3a66dc247998dd503"} Jun 08 10:19:32.696321 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.696282 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xc5j5" event={"ID":"e17377ad-cffa-42a7-bb74-fa2e7a3feb7a","Type":"ContainerStarted","Data":"8af327aeb9f4e1bbbb3554e3bf1f25a38a7334baf94ddc64b70f6cdfedf0e0da"} Jun 08 10:19:32.713701 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.713668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r52bt" event={"ID":"42ab1983-d354-4c86-813c-cdc7b031523d","Type":"ContainerStarted","Data":"221c00044705f5d208fa21ae0bf6bae29f341f7310cad269e12de89e09be0b0e"} Jun 08 10:19:32.719412 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.719376 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx6rw" event={"ID":"736829ca-c2c8-4a61-a598-2cdda4ff0ea5","Type":"ContainerStarted","Data":"2e4ae177f074a0fbec6634967b8c394aef208dde42f0617c33d40cbd90358816"} Jun 08 10:19:32.722011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.721985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" event={"ID":"e436b793-82b9-4abe-9697-4ee2c4ba471c","Type":"ContainerStarted","Data":"e42a3e9aad3fd3a39eb1cc65a1e35ddb3c038c87ecbd0cc3d25fbd65fcdbc7c5"} Jun 08 10:19:32.730182 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.730153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fbj9v" event={"ID":"389cee50-7051-4bd9-b037-49c40f04eacc","Type":"ContainerStarted","Data":"977e6e0b07eaee5f4933011ba6e6982204df045b12ae1503fb76ae0ff170a654"} Jun 08 10:19:32.753457 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:32.753416 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" event={"ID":"3329197c-0b71-4332-9684-a73656d1868a","Type":"ContainerStarted","Data":"22cbc659513aba1c5b721dc2a72f369a4358192612139414ddbe701233356af9"} Jun 08 10:19:33.172872 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:33.172231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:33.172872 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:33.172437 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:33.172872 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:33.172500 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs podName:90295d28-34ba-447d-9517-0520ee42f937 nodeName:}" failed. No retries permitted until 2026-06-08 10:19:35.172481885 +0000 UTC m=+5.016684239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs") pod "network-metrics-daemon-hzg8m" (UID: "90295d28-34ba-447d-9517-0520ee42f937") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:33.273763 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:33.273155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:33.273763 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:33.273369 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:33.273763 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:33.273431 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret podName:d314f158-a213-4ad2-b9a8-66df7dee61f6 nodeName:}" failed. No retries permitted until 2026-06-08 10:19:35.273413938 +0000 UTC m=+5.117616292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret") pod "global-pull-secret-syncer-lcwbh" (UID: "d314f158-a213-4ad2-b9a8-66df7dee61f6") : object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:33.374469 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:33.374425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5ls\" (UniqueName: \"kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls\") pod \"network-check-target-84tx9\" (UID: \"640d0bde-0a46-4cd1-b802-31336f4f618d\") " pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:33.374852 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:33.374799 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 10:19:33.374852 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:33.374837 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 10:19:33.374852 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:33.374851 2577 projected.go:196] Error preparing data for projected volume kube-api-access-pv5ls for pod openshift-network-diagnostics/network-check-target-84tx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:33.375071 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:33.374915 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls podName:640d0bde-0a46-4cd1-b802-31336f4f618d nodeName:}" failed. No retries permitted until 2026-06-08 10:19:35.374894679 +0000 UTC m=+5.219097035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv5ls" (UniqueName: "kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls") pod "network-check-target-84tx9" (UID: "640d0bde-0a46-4cd1-b802-31336f4f618d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:33.618119 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:33.618037 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:33.618294 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:33.618166 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:33.618294 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:33.618253 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:33.618405 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:33.618341 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:33.618770 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:33.618734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:33.618899 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:33.618881 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:33.635433 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:33.635369 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 10:14:31 +0000 UTC" deadline="2028-03-18 20:24:05.922953392 +0000 UTC" Jun 08 10:19:33.635433 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:33.635432 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15586h4m32.28752706s" Jun 08 10:19:34.067146 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:34.066992 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 10:19:34.479393 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:34.479311 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 10:19:35.190099 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:35.189943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:35.190530 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:35.190109 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:35.190530 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:35.190189 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs podName:90295d28-34ba-447d-9517-0520ee42f937 nodeName:}" failed. No retries permitted until 2026-06-08 10:19:39.190168658 +0000 UTC m=+9.034371012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs") pod "network-metrics-daemon-hzg8m" (UID: "90295d28-34ba-447d-9517-0520ee42f937") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:35.290589 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:35.290341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:35.290589 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:35.290541 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:35.290790 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:35.290618 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret podName:d314f158-a213-4ad2-b9a8-66df7dee61f6 nodeName:}" failed. No retries permitted until 2026-06-08 10:19:39.290597068 +0000 UTC m=+9.134799417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret") pod "global-pull-secret-syncer-lcwbh" (UID: "d314f158-a213-4ad2-b9a8-66df7dee61f6") : object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:35.391666 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:35.391577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5ls\" (UniqueName: \"kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls\") pod \"network-check-target-84tx9\" (UID: \"640d0bde-0a46-4cd1-b802-31336f4f618d\") " pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:35.391879 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:35.391747 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 10:19:35.391879 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:35.391769 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 10:19:35.391879 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:35.391782 2577 projected.go:196] Error preparing data for projected volume kube-api-access-pv5ls for pod openshift-network-diagnostics/network-check-target-84tx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:35.391879 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:35.391871 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls podName:640d0bde-0a46-4cd1-b802-31336f4f618d nodeName:}" failed. No retries permitted until 2026-06-08 10:19:39.39184447 +0000 UTC m=+9.236046834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv5ls" (UniqueName: "kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls") pod "network-check-target-84tx9" (UID: "640d0bde-0a46-4cd1-b802-31336f4f618d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:35.615534 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:35.615452 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:35.615697 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:35.615590 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:35.616016 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:35.615997 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:35.616118 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:35.616090 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:35.616181 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:35.616142 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:35.616245 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:35.616212 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:37.615250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:37.615209 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:37.615250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:37.615239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:37.615764 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:37.615210 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:37.615764 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:37.615334 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:37.615764 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:37.615443 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:37.615764 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:37.615524 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:39.224008 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:39.223897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:39.224494 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:39.224020 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:39.224494 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:39.224100 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs podName:90295d28-34ba-447d-9517-0520ee42f937 nodeName:}" failed. No retries permitted until 2026-06-08 10:19:47.224078732 +0000 UTC m=+17.068281082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs") pod "network-metrics-daemon-hzg8m" (UID: "90295d28-34ba-447d-9517-0520ee42f937") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:39.324957 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:39.324803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:39.324957 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:39.324950 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:39.325201 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:39.325029 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret podName:d314f158-a213-4ad2-b9a8-66df7dee61f6 nodeName:}" failed. No retries permitted until 2026-06-08 10:19:47.325012356 +0000 UTC m=+17.169214709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret") pod "global-pull-secret-syncer-lcwbh" (UID: "d314f158-a213-4ad2-b9a8-66df7dee61f6") : object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:39.425612 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:39.425573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5ls\" (UniqueName: \"kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls\") pod \"network-check-target-84tx9\" (UID: \"640d0bde-0a46-4cd1-b802-31336f4f618d\") " pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:39.425793 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:39.425756 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 10:19:39.425793 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:39.425783 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 10:19:39.425793 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:39.425795 2577 projected.go:196] Error preparing data for projected volume kube-api-access-pv5ls for pod openshift-network-diagnostics/network-check-target-84tx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:39.426007 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:39.425876 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls podName:640d0bde-0a46-4cd1-b802-31336f4f618d nodeName:}" failed. No retries permitted until 2026-06-08 10:19:47.425857654 +0000 UTC m=+17.270060018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv5ls" (UniqueName: "kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls") pod "network-check-target-84tx9" (UID: "640d0bde-0a46-4cd1-b802-31336f4f618d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:39.615004 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:39.614740 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:39.615004 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:39.614780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:39.615004 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:39.614780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:39.615004 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:39.614904 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:39.615326 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:39.615036 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:39.615326 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:39.615120 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:41.615650 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:41.615535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:41.615650 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:41.615563 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:41.616178 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:41.615669 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:41.616178 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:41.615677 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:41.616178 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:41.615783 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:41.616178 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:41.615950 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:43.615201 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:43.614967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:43.615632 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:43.614967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:43.615632 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:43.615257 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:43.615632 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:43.615342 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:43.615632 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:43.614968 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:43.615632 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:43.615428 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:45.615384 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:45.615344 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:45.615384 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:45.615376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:45.615844 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:45.615391 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:45.615844 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:45.615480 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:45.615844 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:45.615606 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:45.615844 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:45.615683 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:47.282632 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:47.282598 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:47.283103 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:47.282734 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:47.283103 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:47.282832 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs podName:90295d28-34ba-447d-9517-0520ee42f937 nodeName:}" failed. No retries permitted until 2026-06-08 10:20:03.282795421 +0000 UTC m=+33.126997788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs") pod "network-metrics-daemon-hzg8m" (UID: "90295d28-34ba-447d-9517-0520ee42f937") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:19:47.383333 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:47.383294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:47.383533 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:47.383459 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:47.383533 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:47.383526 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret podName:d314f158-a213-4ad2-b9a8-66df7dee61f6 nodeName:}" failed. No retries permitted until 2026-06-08 10:20:03.38350999 +0000 UTC m=+33.227712559 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret") pod "global-pull-secret-syncer-lcwbh" (UID: "d314f158-a213-4ad2-b9a8-66df7dee61f6") : object "kube-system"/"original-pull-secret" not registered Jun 08 10:19:47.484120 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:47.484080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5ls\" (UniqueName: \"kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls\") pod \"network-check-target-84tx9\" (UID: \"640d0bde-0a46-4cd1-b802-31336f4f618d\") " pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:47.484358 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:47.484243 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 10:19:47.484358 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:47.484265 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 10:19:47.484358 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:47.484277 2577 projected.go:196] Error preparing data for projected volume kube-api-access-pv5ls for pod openshift-network-diagnostics/network-check-target-84tx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:47.484358 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:47.484338 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls podName:640d0bde-0a46-4cd1-b802-31336f4f618d nodeName:}" failed. No retries permitted until 2026-06-08 10:20:03.484317944 +0000 UTC m=+33.328520305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv5ls" (UniqueName: "kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls") pod "network-check-target-84tx9" (UID: "640d0bde-0a46-4cd1-b802-31336f4f618d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:19:47.615583 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:47.615469 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:47.615583 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:47.615496 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:47.615583 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:47.615503 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:47.615884 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:47.615601 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:47.615884 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:47.615675 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:47.615884 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:47.615746 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:49.615098 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:49.615040 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:49.615098 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:49.615076 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:49.615098 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:49.615076 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:49.615726 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:49.615181 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:49.615726 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:49.615263 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:49.615726 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:49.615375 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:51.614775 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:51.614740 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:51.614775 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:51.614763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:51.615181 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:51.614760 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:51.615181 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:51.614884 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:51.615181 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:51.614957 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:51.615181 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:51.615085 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:52.806179 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.805768 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r52bt" event={"ID":"42ab1983-d354-4c86-813c-cdc7b031523d","Type":"ContainerStarted","Data":"585459020fea1e09b53254e4269326dc31a560646cf1caf78840347182b02e87"} Jun 08 10:19:52.807289 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.807268 2577 generic.go:356] "Generic (PLEG): container finished" podID="736829ca-c2c8-4a61-a598-2cdda4ff0ea5" containerID="f4f69e1b9edc7796a8fe344573483d15473cae87fe54de5a2636205f7700db13" exitCode=0 Jun 08 10:19:52.807361 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.807339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx6rw" event={"ID":"736829ca-c2c8-4a61-a598-2cdda4ff0ea5","Type":"ContainerDied","Data":"f4f69e1b9edc7796a8fe344573483d15473cae87fe54de5a2636205f7700db13"} Jun 08 10:19:52.810140 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.810064 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/0.log" Jun 08 10:19:52.810432 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.810410 2577 generic.go:356] "Generic (PLEG): container finished" podID="e436b793-82b9-4abe-9697-4ee2c4ba471c" containerID="5a85e6c197fb6fbf1600bc8df0f1d14f06707457ac46778da3bb314a2e51b5d2" exitCode=1 Jun 08 10:19:52.810528 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.810478 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" event={"ID":"e436b793-82b9-4abe-9697-4ee2c4ba471c","Type":"ContainerStarted","Data":"fcf843a70696cc3cb973f3894930fb7adf9fabcf02539ca8081250698aaa308f"} Jun 08 10:19:52.810586 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.810549 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" event={"ID":"e436b793-82b9-4abe-9697-4ee2c4ba471c","Type":"ContainerStarted","Data":"55d99e616a7183f188baf09ba39fa161f769407c7b754ccce12cbd866b6abb23"} Jun 08 10:19:52.810632 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.810606 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" event={"ID":"e436b793-82b9-4abe-9697-4ee2c4ba471c","Type":"ContainerStarted","Data":"adc4ea7d6ab9fc3311872b28822d765dc53b007b356fcf3773b753824d2199eb"} Jun 08 10:19:52.810669 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.810655 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" event={"ID":"e436b793-82b9-4abe-9697-4ee2c4ba471c","Type":"ContainerStarted","Data":"2f2df790987bafc14575e1ea3818eb20e1f3211a21ff40cbe79206a9ba2128e1"} Jun 08 10:19:52.810721 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.810704 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" event={"ID":"e436b793-82b9-4abe-9697-4ee2c4ba471c","Type":"ContainerDied","Data":"5a85e6c197fb6fbf1600bc8df0f1d14f06707457ac46778da3bb314a2e51b5d2"} Jun 08 10:19:52.810794 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.810763 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" event={"ID":"e436b793-82b9-4abe-9697-4ee2c4ba471c","Type":"ContainerStarted","Data":"69aa454d9beb4d4fdfa72be860f3ae391a69c3a0c1da06af0f5a28714177ecda"} Jun 08 10:19:52.811994 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.811976 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fbj9v" event={"ID":"389cee50-7051-4bd9-b037-49c40f04eacc","Type":"ContainerStarted","Data":"ebe6210cec87d62456d81ebe872c1ac389046ca93706666df99ac25859c09f1e"} Jun 08 10:19:52.813363 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.813343 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" event={"ID":"3329197c-0b71-4332-9684-a73656d1868a","Type":"ContainerStarted","Data":"444bc26e8c7ff8e1d0f9fd0921218645b759de8a3c63749053665e1d16c4e321"} Jun 08 10:19:52.814624 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.814607 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" event={"ID":"9c31271bbde5f4411a9e783b19068f04","Type":"ContainerStarted","Data":"10c05ee26e1f6763b83a4dbb5742c375bd26e7bf9f5cd26ecf5ab1d599b761c0"} Jun 08 10:19:52.815935 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.815918 2577 generic.go:356] "Generic (PLEG): container finished" podID="747a1ff862514f63c638769a18b3468e" containerID="4c713dd3beae9b0807394f9f760406519a556506dbc9efe44af4bbc0b06e4c87" exitCode=0 Jun 08 10:19:52.816035 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.815978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"747a1ff862514f63c638769a18b3468e","Type":"ContainerDied","Data":"4c713dd3beae9b0807394f9f760406519a556506dbc9efe44af4bbc0b06e4c87"} Jun 08 10:19:52.817317 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.817294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cslrb" event={"ID":"af413261-7dd4-4de4-a0a9-e308dd3b437b","Type":"ContainerStarted","Data":"d93b61c34b6af55e6afd34e9414e1117b06fd07754856fadc62baf8bcafea29d"} Jun 08 10:19:52.818640 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.818622 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dm92z" event={"ID":"d221238c-1f7d-4b43-9e5b-30a88c8f9685","Type":"ContainerStarted","Data":"3244c6bb86e4b11dcddb64d8f37d343062ff41215096156c1958b289a2365891"} Jun 08 10:19:52.819896 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.819877 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g4ksc" event={"ID":"439e2bac-1174-41b6-9418-9091f93effba","Type":"ContainerStarted","Data":"fdab0cecd235c4e9b1771d8b513d36a849657671fd76f527d707aa703d03e3be"} Jun 08 10:19:52.849217 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.849155 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r52bt" podStartSLOduration=3.187742097 podStartE2EDuration="22.849143515s" totalImagesPullingTime="19.661401418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:19:52.824147715 +0000 UTC m=+22.668350105" watchObservedRunningTime="2026-06-08 10:19:52.849143515 +0000 UTC m=+22.693345887" Jun 08 10:19:52.871913 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.871869 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fbj9v" podStartSLOduration=2.739278473 podStartE2EDuration="22.871856173s" totalImagesPullingTime="20.1325777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:19:52.870912256 +0000 UTC m=+22.715114629" watchObservedRunningTime="2026-06-08 10:19:52.871856173 +0000 UTC m=+22.716058544" Jun 08 10:19:52.906007 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.905961 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g4ksc" podStartSLOduration=3.3190682750000002 podStartE2EDuration="22.905947631s" totalImagesPullingTime="19.586879356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:19:52.905920812 +0000 UTC m=+22.750123204" watchObservedRunningTime="2026-06-08 10:19:52.905947631 +0000 UTC m=+22.750150003" Jun 08 10:19:52.906270 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.906242 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" podStartSLOduration=21.906234508 podStartE2EDuration="21.906234508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:19:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:19:52.886992349 +0000 UTC m=+22.731194734" watchObservedRunningTime="2026-06-08 10:19:52.906234508 +0000 UTC m=+22.750436880" Jun 08 10:19:52.925011 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.924954 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dm92z" podStartSLOduration=7.841417112 podStartE2EDuration="22.924932893s" totalImagesPullingTime="15.083515781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:19:52.923984191 +0000 UTC m=+22.768186585" watchObservedRunningTime="2026-06-08 10:19:52.924932893 +0000 UTC m=+22.769135270" Jun 08 10:19:52.944305 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:52.944267 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cslrb" podStartSLOduration=3.3148635730000002 podStartE2EDuration="22.944250279s" totalImagesPullingTime="19.629386706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:19:52.943693413 +0000 UTC m=+22.787895784" watchObservedRunningTime="2026-06-08 10:19:52.944250279 +0000 UTC m=+22.788452652" Jun 08 10:19:53.466832 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:53.466789 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:19:53.467375 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:53.467355 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:19:53.615562 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:53.615135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:53.615562 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:53.615259 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:53.615871 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:53.615658 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:53.615871 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:53.615758 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:53.615871 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:53.615842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:53.616038 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:53.615916 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:53.727699 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:53.727675 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 10:19:53.824255 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:53.824107 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xc5j5" event={"ID":"e17377ad-cffa-42a7-bb74-fa2e7a3feb7a","Type":"ContainerStarted","Data":"85e6fb8c1fce59426d1c8f22548c2aa55002b7a05b3527bdbdbeff99e0d386df"} Jun 08 10:19:53.826266 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:53.826236 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" event={"ID":"3329197c-0b71-4332-9684-a73656d1868a","Type":"ContainerStarted","Data":"ba58fdf6b3eed1b1cfa6ef2a923cfa53431d3e0215edc2e7757d31e43ceed344"} Jun 08 10:19:53.859065 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:53.859012 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xc5j5" podStartSLOduration=4.204012768 podStartE2EDuration="23.858992474s" totalImagesPullingTime="19.654979706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:19:53.84238391 +0000 UTC m=+23.686586281" watchObservedRunningTime="2026-06-08 10:19:53.858992474 +0000 UTC m=+23.703194847" Jun 08 10:19:54.617426 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:54.617321 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T10:19:53.727696348Z","UUID":"cd3486af-00a2-497b-a806-6892aa953328","Handler":null,"Name":"","Endpoint":""} Jun 08 10:19:54.621727 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:54.621700 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 10:19:54.621906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:54.621752 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 10:19:54.831845 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:54.831805 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/0.log" Jun 08 10:19:54.832639 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:54.832601 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" event={"ID":"e436b793-82b9-4abe-9697-4ee2c4ba471c","Type":"ContainerStarted","Data":"39e338907481101f747e86a7fb5eb709c7caf25b9efaf44369f7ef8416720fb5"} Jun 08 10:19:54.834982 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:54.834871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"747a1ff862514f63c638769a18b3468e","Type":"ContainerStarted","Data":"73015fc7c38eb56123b1724f12c61d5b9c58c2c3bc02616fef0cd43949502aba"} Jun 08 10:19:54.834982 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:54.834932 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 10:19:54.855124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:54.855088 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" podStartSLOduration=23.855073433 podStartE2EDuration="23.855073433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:19:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:19:54.854304363 +0000 UTC m=+24.698506736" watchObservedRunningTime="2026-06-08 10:19:54.855073433 +0000 UTC m=+24.699275806" Jun 08 10:19:55.614955 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:55.614748 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:55.615136 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:55.614803 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:55.615136 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:55.615039 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:55.615136 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:55.614837 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:55.615136 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:55.615124 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:55.615338 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:55.615216 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:55.839885 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:55.839837 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" event={"ID":"3329197c-0b71-4332-9684-a73656d1868a","Type":"ContainerStarted","Data":"d87d018fa239fea9f05faecbe7b592d7a05bc411410b565bc5905c2503b1388a"} Jun 08 10:19:55.859977 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:55.859913 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bgn2b" podStartSLOduration=4.007147254 podStartE2EDuration="25.859891996s" totalImagesPullingTime="21.852744742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:19:55.859429794 +0000 UTC m=+25.703632186" watchObservedRunningTime="2026-06-08 10:19:55.859891996 +0000 UTC m=+25.704094367" Jun 08 10:19:57.615142 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:57.614958 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:57.615879 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:57.615006 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:57.615879 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:57.615220 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:57.615879 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:57.615014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:57.615879 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:57.615297 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:57.615879 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:57.615371 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:57.845720 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:57.845690 2577 generic.go:356] "Generic (PLEG): container finished" podID="736829ca-c2c8-4a61-a598-2cdda4ff0ea5" containerID="dfb54f88c541b12aa2201cf8e17ece2ebde8349b642416dd030ef41ea1399841" exitCode=0 Jun 08 10:19:57.846394 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:57.846077 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx6rw" event={"ID":"736829ca-c2c8-4a61-a598-2cdda4ff0ea5","Type":"ContainerDied","Data":"dfb54f88c541b12aa2201cf8e17ece2ebde8349b642416dd030ef41ea1399841"} Jun 08 10:19:57.852239 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:57.852221 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/0.log" Jun 08 10:19:57.852589 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:57.852569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" event={"ID":"e436b793-82b9-4abe-9697-4ee2c4ba471c","Type":"ContainerStarted","Data":"6580015f688936c22697c99dcd872e35e4a5a7c6745c224495896da25f522493"} Jun 08 10:19:57.852784 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:57.852774 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:57.852991 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:57.852972 2577 scope.go:117] "RemoveContainer" containerID="5a85e6c197fb6fbf1600bc8df0f1d14f06707457ac46778da3bb314a2e51b5d2" Jun 08 10:19:57.871008 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:57.870985 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:58.832274 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.832247 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lcwbh"] Jun 08 10:19:58.832743 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.832361 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:19:58.832743 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:58.832483 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:19:58.833124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.833102 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-84tx9"] Jun 08 10:19:58.833254 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.833237 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:19:58.833358 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:58.833337 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:19:58.833941 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.833915 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hzg8m"] Jun 08 10:19:58.834037 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.834018 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:19:58.834135 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:19:58.834113 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:19:58.861317 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.861234 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/0.log" Jun 08 10:19:58.861871 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.861629 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" event={"ID":"e436b793-82b9-4abe-9697-4ee2c4ba471c","Type":"ContainerStarted","Data":"1755fb8b28fa3229dfda230081437475d9e87ec2b7d4a0c190fc63be8cffb2ca"} Jun 08 10:19:58.862593 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.862530 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:58.862699 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.862631 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:58.885145 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.884945 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:19:58.893337 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:58.893283 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" podStartSLOduration=9.029307516 podStartE2EDuration="28.893262597s" totalImagesPullingTime="19.863955081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:19:58.891765161 +0000 UTC m=+28.735967533" watchObservedRunningTime="2026-06-08 10:19:58.893262597 +0000 UTC m=+28.737464964" Jun 08 10:19:59.865861 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:59.865811 2577 generic.go:356] "Generic (PLEG): container finished" podID="736829ca-c2c8-4a61-a598-2cdda4ff0ea5" containerID="06192f9d1bafb3420cfda86a7bddeeb274b44733140005570ad68ce80096957c" exitCode=0 Jun 08 10:19:59.866344 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:19:59.865914 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx6rw" event={"ID":"736829ca-c2c8-4a61-a598-2cdda4ff0ea5","Type":"ContainerDied","Data":"06192f9d1bafb3420cfda86a7bddeeb274b44733140005570ad68ce80096957c"} Jun 08 10:20:00.515744 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:00.515705 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:20:00.515940 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:00.515850 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 10:20:00.516306 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:00.516285 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dm92z" Jun 08 10:20:00.610437 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:00.610395 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:00.615811 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:00.615786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:20:00.615980 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:00.615889 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:20:00.615980 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:00.615932 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:20:00.615980 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:00.615931 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:20:00.616133 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:00.616014 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:20:00.616133 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:00.616091 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:20:00.716659 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:00.716622 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:00.872707 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:00.872676 2577 generic.go:356] "Generic (PLEG): container finished" podID="736829ca-c2c8-4a61-a598-2cdda4ff0ea5" containerID="2471e5551e43ef014cc7fa8a6e6659c7fa7b980d031eed7f7f2029e7a6dc3564" exitCode=0 Jun 08 10:20:00.873194 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:00.872754 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx6rw" event={"ID":"736829ca-c2c8-4a61-a598-2cdda4ff0ea5","Type":"ContainerDied","Data":"2471e5551e43ef014cc7fa8a6e6659c7fa7b980d031eed7f7f2029e7a6dc3564"} Jun 08 10:20:02.614670 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:02.614638 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:20:02.615341 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:02.614638 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:20:02.615341 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:02.614786 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:20:02.615341 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:02.614639 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:20:02.615341 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:02.614874 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:20:02.615341 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:02.614945 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:20:03.311614 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:03.311570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:20:03.311763 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:03.311697 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:20:03.311763 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:03.311751 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs podName:90295d28-34ba-447d-9517-0520ee42f937 nodeName:}" failed. No retries permitted until 2026-06-08 10:20:35.311738021 +0000 UTC m=+65.155940372 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs") pod "network-metrics-daemon-hzg8m" (UID: "90295d28-34ba-447d-9517-0520ee42f937") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 10:20:03.412835 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:03.412775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:20:03.413009 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:03.412941 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 10:20:03.413009 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:03.413008 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret podName:d314f158-a213-4ad2-b9a8-66df7dee61f6 nodeName:}" failed. No retries permitted until 2026-06-08 10:20:35.412992425 +0000 UTC m=+65.257194780 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret") pod "global-pull-secret-syncer-lcwbh" (UID: "d314f158-a213-4ad2-b9a8-66df7dee61f6") : object "kube-system"/"original-pull-secret" not registered Jun 08 10:20:03.514055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:03.514014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5ls\" (UniqueName: \"kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls\") pod \"network-check-target-84tx9\" (UID: \"640d0bde-0a46-4cd1-b802-31336f4f618d\") " pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:20:03.514242 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:03.514215 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 10:20:03.514302 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:03.514244 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 10:20:03.514302 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:03.514260 2577 projected.go:196] Error preparing data for projected volume kube-api-access-pv5ls for pod openshift-network-diagnostics/network-check-target-84tx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:20:03.514392 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:03.514327 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls podName:640d0bde-0a46-4cd1-b802-31336f4f618d nodeName:}" failed. No retries permitted until 2026-06-08 10:20:35.514308311 +0000 UTC m=+65.358510676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv5ls" (UniqueName: "kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls") pod "network-check-target-84tx9" (UID: "640d0bde-0a46-4cd1-b802-31336f4f618d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 10:20:04.615687 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:04.615653 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:20:04.616162 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:04.615651 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:20:04.616162 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:04.615784 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84tx9" podUID="640d0bde-0a46-4cd1-b802-31336f4f618d" Jun 08 10:20:04.616162 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:04.615651 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:20:04.616162 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:04.615883 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcwbh" podUID="d314f158-a213-4ad2-b9a8-66df7dee61f6" Jun 08 10:20:04.616162 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:04.615928 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:20:04.943707 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:04.943674 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeReady" Jun 08 10:20:04.943947 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:04.943837 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 10:20:04.991767 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:04.991736 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x85w7"] Jun 08 10:20:05.004357 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.004331 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8cwp2"] Jun 08 10:20:05.004477 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.004464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.007236 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.007213 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-db48d\"" Jun 08 10:20:05.007341 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.007240 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 10:20:05.007481 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.007467 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 10:20:05.020813 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.020790 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x85w7"] Jun 08 10:20:05.020939 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.020854 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8cwp2"] Jun 08 10:20:05.020939 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.020933 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8cwp2" Jun 08 10:20:05.023669 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.023641 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-98nrh\"" Jun 08 10:20:05.023768 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.023717 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 10:20:05.023768 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.023721 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 10:20:05.024075 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.024059 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 10:20:05.124864 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.124808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-config-volume\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.125024 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.124872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4722055d-0c45-410e-82c8-6d87030a7019-cert\") pod \"ingress-canary-8cwp2\" (UID: \"4722055d-0c45-410e-82c8-6d87030a7019\") " pod="openshift-ingress-canary/ingress-canary-8cwp2" Jun 08 10:20:05.125024 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.124899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npfwx\" (UniqueName: \"kubernetes.io/projected/4722055d-0c45-410e-82c8-6d87030a7019-kube-api-access-npfwx\") pod \"ingress-canary-8cwp2\" (UID: \"4722055d-0c45-410e-82c8-6d87030a7019\") " pod="openshift-ingress-canary/ingress-canary-8cwp2" Jun 08 10:20:05.125024 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.124924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmw29\" (UniqueName: \"kubernetes.io/projected/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-kube-api-access-pmw29\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.125125 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.125015 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.125125 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.125042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-tmp-dir\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.226018 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.225984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.226018 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.226019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-tmp-dir\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.226195 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.226075 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-config-volume\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.226195 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.226093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4722055d-0c45-410e-82c8-6d87030a7019-cert\") pod \"ingress-canary-8cwp2\" (UID: \"4722055d-0c45-410e-82c8-6d87030a7019\") " pod="openshift-ingress-canary/ingress-canary-8cwp2" Jun 08 10:20:05.226195 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.226111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npfwx\" (UniqueName: \"kubernetes.io/projected/4722055d-0c45-410e-82c8-6d87030a7019-kube-api-access-npfwx\") pod \"ingress-canary-8cwp2\" (UID: \"4722055d-0c45-410e-82c8-6d87030a7019\") " pod="openshift-ingress-canary/ingress-canary-8cwp2" Jun 08 10:20:05.226195 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.226131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmw29\" (UniqueName: \"kubernetes.io/projected/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-kube-api-access-pmw29\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.226195 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:05.226132 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 10:20:05.226399 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:05.226209 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls podName:89312fba-4c4a-47f7-9d9a-2fdeebe84c7e nodeName:}" failed. No retries permitted until 2026-06-08 10:20:05.726187881 +0000 UTC m=+35.570390293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls") pod "dns-default-x85w7" (UID: "89312fba-4c4a-47f7-9d9a-2fdeebe84c7e") : secret "dns-default-metrics-tls" not found Jun 08 10:20:05.226462 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.226412 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-tmp-dir\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.226699 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.226680 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-config-volume\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.230374 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.230246 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4722055d-0c45-410e-82c8-6d87030a7019-cert\") pod \"ingress-canary-8cwp2\" (UID: \"4722055d-0c45-410e-82c8-6d87030a7019\") " pod="openshift-ingress-canary/ingress-canary-8cwp2" Jun 08 10:20:05.237773 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.237750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmw29\" (UniqueName: \"kubernetes.io/projected/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-kube-api-access-pmw29\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.238402 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.238382 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npfwx\" (UniqueName: \"kubernetes.io/projected/4722055d-0c45-410e-82c8-6d87030a7019-kube-api-access-npfwx\") pod \"ingress-canary-8cwp2\" (UID: \"4722055d-0c45-410e-82c8-6d87030a7019\") " pod="openshift-ingress-canary/ingress-canary-8cwp2" Jun 08 10:20:05.329007 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.328970 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8cwp2" Jun 08 10:20:05.505237 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.505198 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8cwp2"] Jun 08 10:20:05.510719 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:20:05.510693 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4722055d_0c45_410e_82c8_6d87030a7019.slice/crio-6a6c2cf359720776f6597b9cb70b89aa14895a494acbc30b88bac65051e5740b WatchSource:0}: Error finding container 6a6c2cf359720776f6597b9cb70b89aa14895a494acbc30b88bac65051e5740b: Status 404 returned error can't find the container with id 6a6c2cf359720776f6597b9cb70b89aa14895a494acbc30b88bac65051e5740b Jun 08 10:20:05.729884 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.729765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:05.730246 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:05.729914 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 10:20:05.730246 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:05.729978 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls podName:89312fba-4c4a-47f7-9d9a-2fdeebe84c7e nodeName:}" failed. No retries permitted until 2026-06-08 10:20:06.729961515 +0000 UTC m=+36.574163865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls") pod "dns-default-x85w7" (UID: "89312fba-4c4a-47f7-9d9a-2fdeebe84c7e") : secret "dns-default-metrics-tls" not found Jun 08 10:20:05.785958 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.785926 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:05.841352 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.841323 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:05.887383 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.887354 2577 generic.go:356] "Generic (PLEG): container finished" podID="736829ca-c2c8-4a61-a598-2cdda4ff0ea5" containerID="1fc19443b219c15f471018e350e4f98471d917fe012a1a11dd8880d18d18f5cb" exitCode=0 Jun 08 10:20:05.887536 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.887434 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx6rw" event={"ID":"736829ca-c2c8-4a61-a598-2cdda4ff0ea5","Type":"ContainerDied","Data":"1fc19443b219c15f471018e350e4f98471d917fe012a1a11dd8880d18d18f5cb"} Jun 08 10:20:05.888520 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:05.888491 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8cwp2" event={"ID":"4722055d-0c45-410e-82c8-6d87030a7019","Type":"ContainerStarted","Data":"6a6c2cf359720776f6597b9cb70b89aa14895a494acbc30b88bac65051e5740b"} Jun 08 10:20:06.615411 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.615198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:20:06.615600 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.615198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:20:06.615785 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.615199 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:20:06.618667 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.618648 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 10:20:06.618774 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.618666 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 10:20:06.618774 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.618683 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z72dv\"" Jun 08 10:20:06.618896 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.618648 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 10:20:06.619714 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.619696 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 10:20:06.619832 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.619800 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cfhpm\"" Jun 08 10:20:06.738239 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.738204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:06.738698 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:06.738324 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 10:20:06.738698 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:06.738382 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls podName:89312fba-4c4a-47f7-9d9a-2fdeebe84c7e nodeName:}" failed. No retries permitted until 2026-06-08 10:20:08.738365602 +0000 UTC m=+38.582567974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls") pod "dns-default-x85w7" (UID: "89312fba-4c4a-47f7-9d9a-2fdeebe84c7e") : secret "dns-default-metrics-tls" not found Jun 08 10:20:06.895142 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.895059 2577 generic.go:356] "Generic (PLEG): container finished" podID="736829ca-c2c8-4a61-a598-2cdda4ff0ea5" containerID="ff410fe09110af3607f7c5c0daf8bd3cd04e2e52b88a934fd8f24c9b80d7dc4d" exitCode=0 Jun 08 10:20:06.895142 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:06.895106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx6rw" event={"ID":"736829ca-c2c8-4a61-a598-2cdda4ff0ea5","Type":"ContainerDied","Data":"ff410fe09110af3607f7c5c0daf8bd3cd04e2e52b88a934fd8f24c9b80d7dc4d"} Jun 08 10:20:07.001625 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:07.001589 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:07.067517 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:07.067482 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:07.847400 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:07.847364 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:07.900304 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:07.900266 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx6rw" event={"ID":"736829ca-c2c8-4a61-a598-2cdda4ff0ea5","Type":"ContainerStarted","Data":"889e81dfcbfc36091091f25bd196ea88d6d7a9a6cf37112c3b9e8ec9ec68b36c"} Jun 08 10:20:07.901727 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:07.901708 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8cwp2" event={"ID":"4722055d-0c45-410e-82c8-6d87030a7019","Type":"ContainerStarted","Data":"fcf6ebbc1e69bb7995ea226c49faa8a1ae921cbcee96340e7d81ec2fb2e73288"} Jun 08 10:20:07.933981 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:07.933939 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rx6rw" podStartSLOduration=7.997868469 podStartE2EDuration="37.933927503s" totalImagesPullingTime="29.936059034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:20:07.933704989 +0000 UTC m=+37.777907366" watchObservedRunningTime="2026-06-08 10:20:07.933927503 +0000 UTC m=+37.778129874" Jun 08 10:20:07.938150 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:07.938129 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:07.970346 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:07.970304 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8cwp2" podStartSLOduration=2.336510293 podStartE2EDuration="3.970289955s" totalImagesPullingTime="1.633779662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:20:07.969879831 +0000 UTC m=+37.814082204" watchObservedRunningTime="2026-06-08 10:20:07.970289955 +0000 UTC m=+37.814492324" Jun 08 10:20:08.059804 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:08.059767 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:08.153395 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:08.153314 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:08.349411 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:08.349368 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:08.449736 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:08.449656 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:08.756933 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:08.756898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:08.757090 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:08.757050 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 10:20:08.757160 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:08.757116 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls podName:89312fba-4c4a-47f7-9d9a-2fdeebe84c7e nodeName:}" failed. No retries permitted until 2026-06-08 10:20:12.757099001 +0000 UTC m=+42.601301352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls") pod "dns-default-x85w7" (UID: "89312fba-4c4a-47f7-9d9a-2fdeebe84c7e") : secret "dns-default-metrics-tls" not found Jun 08 10:20:08.822288 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:08.822254 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:08.897079 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:08.897047 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:09.566257 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.566221 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp"] Jun 08 10:20:09.568193 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.568172 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" Jun 08 10:20:09.571270 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.571252 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9tx7g\"" Jun 08 10:20:09.571355 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.571298 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 10:20:09.571355 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.571326 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 10:20:09.572505 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.572481 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 10:20:09.572560 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.572514 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 08 10:20:09.579722 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.579702 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp"] Jun 08 10:20:09.664391 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.664364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e088f1-2a79-484e-bb36-299dcd719e90-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp\" (UID: \"a8e088f1-2a79-484e-bb36-299dcd719e90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" Jun 08 10:20:09.664542 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.664417 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2hb5\" (UniqueName: \"kubernetes.io/projected/a8e088f1-2a79-484e-bb36-299dcd719e90-kube-api-access-g2hb5\") pod \"managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp\" (UID: \"a8e088f1-2a79-484e-bb36-299dcd719e90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" Jun 08 10:20:09.718345 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.718314 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:09.765434 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.765407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e088f1-2a79-484e-bb36-299dcd719e90-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp\" (UID: \"a8e088f1-2a79-484e-bb36-299dcd719e90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" Jun 08 10:20:09.765505 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.765458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2hb5\" (UniqueName: \"kubernetes.io/projected/a8e088f1-2a79-484e-bb36-299dcd719e90-kube-api-access-g2hb5\") pod \"managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp\" (UID: \"a8e088f1-2a79-484e-bb36-299dcd719e90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" Jun 08 10:20:09.769156 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.769135 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e088f1-2a79-484e-bb36-299dcd719e90-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp\" (UID: \"a8e088f1-2a79-484e-bb36-299dcd719e90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" Jun 08 10:20:09.773855 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.773811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2hb5\" (UniqueName: \"kubernetes.io/projected/a8e088f1-2a79-484e-bb36-299dcd719e90-kube-api-access-g2hb5\") pod \"managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp\" (UID: \"a8e088f1-2a79-484e-bb36-299dcd719e90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" Jun 08 10:20:09.774621 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.774590 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:09.887984 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:09.887895 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" Jun 08 10:20:10.008271 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:10.008242 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp"] Jun 08 10:20:10.011551 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:20:10.011518 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8e088f1_2a79_484e_bb36_299dcd719e90.slice/crio-546037718bfff26f57cddd3c187470ec1da6c25db355a96da4b4a5a63d8ec091 WatchSource:0}: Error finding container 546037718bfff26f57cddd3c187470ec1da6c25db355a96da4b4a5a63d8ec091: Status 404 returned error can't find the container with id 546037718bfff26f57cddd3c187470ec1da6c25db355a96da4b4a5a63d8ec091 Jun 08 10:20:10.910831 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:10.910773 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" event={"ID":"a8e088f1-2a79-484e-bb36-299dcd719e90","Type":"ContainerStarted","Data":"546037718bfff26f57cddd3c187470ec1da6c25db355a96da4b4a5a63d8ec091"} Jun 08 10:20:12.787706 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:12.787678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:12.788031 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:12.787864 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 10:20:12.788031 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:12.787936 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls podName:89312fba-4c4a-47f7-9d9a-2fdeebe84c7e nodeName:}" failed. No retries permitted until 2026-06-08 10:20:20.787917344 +0000 UTC m=+50.632119713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls") pod "dns-default-x85w7" (UID: "89312fba-4c4a-47f7-9d9a-2fdeebe84c7e") : secret "dns-default-metrics-tls" not found Jun 08 10:20:12.916734 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:12.916703 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" event={"ID":"a8e088f1-2a79-484e-bb36-299dcd719e90","Type":"ContainerStarted","Data":"f4653ebe39422993002ff945f1b8b4daa4603ef4d47e728979dc88d7fbd4051f"} Jun 08 10:20:20.841449 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:20.841408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:20.842008 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:20.841527 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 10:20:20.842008 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:20.841578 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls podName:89312fba-4c4a-47f7-9d9a-2fdeebe84c7e nodeName:}" failed. No retries permitted until 2026-06-08 10:20:36.841565699 +0000 UTC m=+66.685768049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls") pod "dns-default-x85w7" (UID: "89312fba-4c4a-47f7-9d9a-2fdeebe84c7e") : secret "dns-default-metrics-tls" not found Jun 08 10:20:27.972040 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:27.971990 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:28.072268 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:28.072230 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:30.102045 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:30.102010 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:30.167062 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:30.167032 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:30.887184 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:30.887158 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7s4qb" Jun 08 10:20:30.917337 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:30.917278 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" podStartSLOduration=19.190621159 podStartE2EDuration="21.917260472s" totalImagesPullingTime="2.726639313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:20:12.941121689 +0000 UTC m=+42.785324062" watchObservedRunningTime="2026-06-08 10:20:30.917260472 +0000 UTC m=+60.761462881" Jun 08 10:20:31.004416 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:31.004382 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:31.059594 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:31.059561 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:31.122382 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:31.122350 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:35.337888 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.337851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:20:35.341062 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.341033 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 10:20:35.348804 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:35.348779 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 10:20:35.348939 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:35.348865 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs podName:90295d28-34ba-447d-9517-0520ee42f937 nodeName:}" failed. No retries permitted until 2026-06-08 10:21:39.348849214 +0000 UTC m=+129.193051564 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs") pod "network-metrics-daemon-hzg8m" (UID: "90295d28-34ba-447d-9517-0520ee42f937") : secret "metrics-daemon-secret" not found Jun 08 10:20:35.438800 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.438772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:20:35.441791 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.441773 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 10:20:35.451536 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.451518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d314f158-a213-4ad2-b9a8-66df7dee61f6-original-pull-secret\") pod \"global-pull-secret-syncer-lcwbh\" (UID: \"d314f158-a213-4ad2-b9a8-66df7dee61f6\") " pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:20:35.539345 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.539318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5ls\" (UniqueName: \"kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls\") pod \"network-check-target-84tx9\" (UID: \"640d0bde-0a46-4cd1-b802-31336f4f618d\") " pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:20:35.542257 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.542239 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 10:20:35.552255 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.552237 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 10:20:35.562779 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.562748 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv5ls\" (UniqueName: \"kubernetes.io/projected/640d0bde-0a46-4cd1-b802-31336f4f618d-kube-api-access-pv5ls\") pod \"network-check-target-84tx9\" (UID: \"640d0bde-0a46-4cd1-b802-31336f4f618d\") " pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:20:35.729032 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.728955 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cfhpm\"" Jun 08 10:20:35.730987 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.730970 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcwbh" Jun 08 10:20:35.736512 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.736496 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:20:35.877073 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.876992 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lcwbh"] Jun 08 10:20:35.879503 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:20:35.879476 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd314f158_a213_4ad2_b9a8_66df7dee61f6.slice/crio-a898529f5448950f93b016e7acc1b901cea1f9f79c7da060a411487afe66ce45 WatchSource:0}: Error finding container a898529f5448950f93b016e7acc1b901cea1f9f79c7da060a411487afe66ce45: Status 404 returned error can't find the container with id a898529f5448950f93b016e7acc1b901cea1f9f79c7da060a411487afe66ce45 Jun 08 10:20:35.893582 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.893559 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-84tx9"] Jun 08 10:20:35.896294 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:20:35.896270 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640d0bde_0a46_4cd1_b802_31336f4f618d.slice/crio-9723a7ef3e6c6ed85a17941137c225ef7075791478f26d43e37caee33b6dca85 WatchSource:0}: Error finding container 9723a7ef3e6c6ed85a17941137c225ef7075791478f26d43e37caee33b6dca85: Status 404 returned error can't find the container with id 9723a7ef3e6c6ed85a17941137c225ef7075791478f26d43e37caee33b6dca85 Jun 08 10:20:35.972172 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.972143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lcwbh" event={"ID":"d314f158-a213-4ad2-b9a8-66df7dee61f6","Type":"ContainerStarted","Data":"a898529f5448950f93b016e7acc1b901cea1f9f79c7da060a411487afe66ce45"} Jun 08 10:20:35.973189 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:35.973164 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-84tx9" event={"ID":"640d0bde-0a46-4cd1-b802-31336f4f618d","Type":"ContainerStarted","Data":"9723a7ef3e6c6ed85a17941137c225ef7075791478f26d43e37caee33b6dca85"} Jun 08 10:20:36.849667 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:36.849620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:20:36.850242 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:36.849771 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 10:20:36.850242 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:20:36.849855 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls podName:89312fba-4c4a-47f7-9d9a-2fdeebe84c7e nodeName:}" failed. No retries permitted until 2026-06-08 10:21:08.849836309 +0000 UTC m=+98.694038683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls") pod "dns-default-x85w7" (UID: "89312fba-4c4a-47f7-9d9a-2fdeebe84c7e") : secret "dns-default-metrics-tls" not found Jun 08 10:20:40.706638 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:40.706545 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:40.769702 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:40.769660 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:20:40.987851 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:40.987740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lcwbh" event={"ID":"d314f158-a213-4ad2-b9a8-66df7dee61f6","Type":"ContainerStarted","Data":"573c1bf58653ac8c4167b6c43995222d8b3426e5c6a545160e995587e093c8f3"} Jun 08 10:20:40.989128 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:40.989103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-84tx9" event={"ID":"640d0bde-0a46-4cd1-b802-31336f4f618d","Type":"ContainerStarted","Data":"d6fbb8c8187b1a54857b86ba45d5c5ae0c430524e7f34abd59c7e4f03daa4d8f"} Jun 08 10:20:40.989241 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:40.989227 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:20:41.005381 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:41.005337 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lcwbh" podStartSLOduration=66.539322859 podStartE2EDuration="1m11.005323895s" totalImagesPullingTime="4.466001036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:20:41.004952338 +0000 UTC m=+70.849154710" watchObservedRunningTime="2026-06-08 10:20:41.005323895 +0000 UTC m=+70.849526267" Jun 08 10:20:41.020232 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:20:41.020184 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-84tx9" podStartSLOduration=66.574152569 podStartE2EDuration="1m11.020169879s" totalImagesPullingTime="4.44601731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:20:41.020086703 +0000 UTC m=+70.864289087" watchObservedRunningTime="2026-06-08 10:20:41.020169879 +0000 UTC m=+70.864372269" Jun 08 10:21:08.869162 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:21:08.869119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:21:08.869558 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:21:08.869269 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 10:21:08.869558 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:21:08.869343 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls podName:89312fba-4c4a-47f7-9d9a-2fdeebe84c7e nodeName:}" failed. No retries permitted until 2026-06-08 10:22:12.869322561 +0000 UTC m=+162.713524914 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls") pod "dns-default-x85w7" (UID: "89312fba-4c4a-47f7-9d9a-2fdeebe84c7e") : secret "dns-default-metrics-tls" not found Jun 08 10:21:11.994121 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:21:11.994089 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-84tx9" Jun 08 10:21:39.372431 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:21:39.372385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:21:39.372866 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:21:39.372534 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 10:21:39.372866 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:21:39.372636 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs podName:90295d28-34ba-447d-9517-0520ee42f937 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:41.372618458 +0000 UTC m=+251.216820807 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs") pod "network-metrics-daemon-hzg8m" (UID: "90295d28-34ba-447d-9517-0520ee42f937") : secret "metrics-daemon-secret" not found Jun 08 10:22:08.015281 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:22:08.015234 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x85w7" podUID="89312fba-4c4a-47f7-9d9a-2fdeebe84c7e" Jun 08 10:22:08.200006 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:22:08.199978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x85w7" Jun 08 10:22:09.636025 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:22:09.635980 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hzg8m" podUID="90295d28-34ba-447d-9517-0520ee42f937" Jun 08 10:22:12.904114 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:22:12.904076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:22:12.904414 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:22:12.904231 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 10:22:12.904414 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:22:12.904313 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls podName:89312fba-4c4a-47f7-9d9a-2fdeebe84c7e nodeName:}" failed. No retries permitted until 2026-06-08 10:24:14.904291643 +0000 UTC m=+284.748493993 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls") pod "dns-default-x85w7" (UID: "89312fba-4c4a-47f7-9d9a-2fdeebe84c7e") : secret "dns-default-metrics-tls" not found Jun 08 10:22:13.215926 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:22:13.215840 2577 generic.go:356] "Generic (PLEG): container finished" podID="a8e088f1-2a79-484e-bb36-299dcd719e90" containerID="f4653ebe39422993002ff945f1b8b4daa4603ef4d47e728979dc88d7fbd4051f" exitCode=255 Jun 08 10:22:13.215926 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:22:13.215901 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" event={"ID":"a8e088f1-2a79-484e-bb36-299dcd719e90","Type":"ContainerDied","Data":"f4653ebe39422993002ff945f1b8b4daa4603ef4d47e728979dc88d7fbd4051f"} Jun 08 10:22:13.221421 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:22:13.221399 2577 scope.go:117] "RemoveContainer" containerID="f4653ebe39422993002ff945f1b8b4daa4603ef4d47e728979dc88d7fbd4051f" Jun 08 10:22:14.219693 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:22:14.219656 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" event={"ID":"a8e088f1-2a79-484e-bb36-299dcd719e90","Type":"ContainerStarted","Data":"94ee3c9f328b43edb3321c3fd6798d4b3eec6145f721f20ee163392611a52f8f"} Jun 08 10:22:20.616282 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:22:20.616194 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:23:19.258317 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.258283 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t"] Jun 08 10:23:19.260523 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.260506 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" Jun 08 10:23:19.263980 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.263957 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 10:23:19.263980 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.263975 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 10:23:19.264164 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.264096 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qv27n\"" Jun 08 10:23:19.264985 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.264965 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 10:23:19.265091 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.264970 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 10:23:19.268637 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.268096 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-ng6j8"] Jun 08 10:23:19.270474 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.270456 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t"] Jun 08 10:23:19.270571 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.270536 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.273238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.273215 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 08 10:23:19.273390 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.273283 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 08 10:23:19.273390 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.273330 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-z28jh\"" Jun 08 10:23:19.273738 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.273716 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 08 10:23:19.273871 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.273718 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 08 10:23:19.274118 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.274095 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-w9smj"] Jun 08 10:23:19.275762 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.275747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-w9smj" Jun 08 10:23:19.278380 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.278360 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 08 10:23:19.278567 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.278541 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5dfgn\"" Jun 08 10:23:19.278665 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.278622 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 08 10:23:19.278665 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.278640 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 08 10:23:19.284931 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.284911 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-ng6j8"] Jun 08 10:23:19.289317 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.289295 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-w9smj"] Jun 08 10:23:19.347211 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.347175 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf"] Jun 08 10:23:19.348611 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.348586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd366f82-5985-4bc5-8ced-8d57fee135dd-trusted-ca\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.348723 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.348623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs76n\" (UniqueName: \"kubernetes.io/projected/a1bd360d-786a-4234-ba7b-676228a5b76e-kube-api-access-cs76n\") pod \"service-ca-operator-6bc5ff68f5-8p47t\" (UID: \"a1bd360d-786a-4234-ba7b-676228a5b76e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" Jun 08 10:23:19.348723 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.348642 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd366f82-5985-4bc5-8ced-8d57fee135dd-serving-cert\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.348723 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.348687 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1bd360d-786a-4234-ba7b-676228a5b76e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-8p47t\" (UID: \"a1bd360d-786a-4234-ba7b-676228a5b76e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" Jun 08 10:23:19.348723 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.348710 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd366f82-5985-4bc5-8ced-8d57fee135dd-config\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.348872 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.348733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1bd360d-786a-4234-ba7b-676228a5b76e-config\") pod \"service-ca-operator-6bc5ff68f5-8p47t\" (UID: \"a1bd360d-786a-4234-ba7b-676228a5b76e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" Jun 08 10:23:19.348872 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.348761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dg7l\" (UniqueName: \"kubernetes.io/projected/5b6aca61-7130-486b-b4c5-ddaf4b58e459-kube-api-access-6dg7l\") pod \"volume-data-source-validator-78dd696465-w9smj\" (UID: \"5b6aca61-7130-486b-b4c5-ddaf4b58e459\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-w9smj" Jun 08 10:23:19.348872 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.348777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hsmz\" (UniqueName: \"kubernetes.io/projected/dd366f82-5985-4bc5-8ced-8d57fee135dd-kube-api-access-7hsmz\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.349177 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.349158 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:19.352407 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.352385 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 10:23:19.352592 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.352568 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 10:23:19.352805 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.352779 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 10:23:19.353368 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.352881 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb"] Jun 08 10:23:19.355547 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.355521 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fnw72\"" Jun 08 10:23:19.355644 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.355610 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 10:23:19.357291 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.357267 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g"] Jun 08 10:23:19.357401 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.357387 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:19.359079 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.359062 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" Jun 08 10:23:19.359567 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.359550 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9czxx\"" Jun 08 10:23:19.360222 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.360207 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 08 10:23:19.364496 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.364473 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 10:23:19.364668 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.364503 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 10:23:19.364668 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.364525 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 10:23:19.364668 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.364485 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m5ql6\"" Jun 08 10:23:19.364668 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.364664 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 08 10:23:19.364923 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.364898 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 08 10:23:19.364991 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.364973 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 10:23:19.365881 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.365861 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf"] Jun 08 10:23:19.373504 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.373479 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb"] Jun 08 10:23:19.375491 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.375468 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g"] Jun 08 10:23:19.449939 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.449907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd366f82-5985-4bc5-8ced-8d57fee135dd-trusted-ca\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.449939 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.449944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98b14688-bfa2-4bc0-b34b-34fc039d3101-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kmb2g\" (UID: \"98b14688-bfa2-4bc0-b34b-34fc039d3101\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" Jun 08 10:23:19.450208 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.449962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sthhz\" (UniqueName: \"kubernetes.io/projected/f5f7139e-3d44-470b-ac56-02815aa81b9e-kube-api-access-sthhz\") pod \"cluster-samples-operator-854f8b96b6-nx4sb\" (UID: \"f5f7139e-3d44-470b-ac56-02815aa81b9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:19.450208 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.449990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs76n\" (UniqueName: \"kubernetes.io/projected/a1bd360d-786a-4234-ba7b-676228a5b76e-kube-api-access-cs76n\") pod \"service-ca-operator-6bc5ff68f5-8p47t\" (UID: \"a1bd360d-786a-4234-ba7b-676228a5b76e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" Jun 08 10:23:19.450208 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd366f82-5985-4bc5-8ced-8d57fee135dd-serving-cert\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.450208 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1bd360d-786a-4234-ba7b-676228a5b76e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-8p47t\" (UID: \"a1bd360d-786a-4234-ba7b-676228a5b76e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" Jun 08 10:23:19.450208 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nx4sb\" (UID: \"f5f7139e-3d44-470b-ac56-02815aa81b9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:19.450208 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd366f82-5985-4bc5-8ced-8d57fee135dd-config\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.450510 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1bd360d-786a-4234-ba7b-676228a5b76e-config\") pod \"service-ca-operator-6bc5ff68f5-8p47t\" (UID: \"a1bd360d-786a-4234-ba7b-676228a5b76e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" Jun 08 10:23:19.450510 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dg7l\" (UniqueName: \"kubernetes.io/projected/5b6aca61-7130-486b-b4c5-ddaf4b58e459-kube-api-access-6dg7l\") pod \"volume-data-source-validator-78dd696465-w9smj\" (UID: \"5b6aca61-7130-486b-b4c5-ddaf4b58e459\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-w9smj" Jun 08 10:23:19.450510 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hsmz\" (UniqueName: \"kubernetes.io/projected/dd366f82-5985-4bc5-8ced-8d57fee135dd-kube-api-access-7hsmz\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.450510 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450354 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/98b14688-bfa2-4bc0-b34b-34fc039d3101-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kmb2g\" (UID: \"98b14688-bfa2-4bc0-b34b-34fc039d3101\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" Jun 08 10:23:19.450510 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56d14d77-f8d9-44ad-9f62-4795dfb32a79-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:19.450510 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:19.450510 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjsrg\" (UniqueName: \"kubernetes.io/projected/98b14688-bfa2-4bc0-b34b-34fc039d3101-kube-api-access-gjsrg\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kmb2g\" (UID: \"98b14688-bfa2-4bc0-b34b-34fc039d3101\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" Jun 08 10:23:19.450510 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450487 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-825hf\" (UniqueName: \"kubernetes.io/projected/56d14d77-f8d9-44ad-9f62-4795dfb32a79-kube-api-access-825hf\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:19.450964 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450879 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1bd360d-786a-4234-ba7b-676228a5b76e-config\") pod \"service-ca-operator-6bc5ff68f5-8p47t\" (UID: \"a1bd360d-786a-4234-ba7b-676228a5b76e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" Jun 08 10:23:19.450964 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.450937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd366f82-5985-4bc5-8ced-8d57fee135dd-config\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.451132 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.451110 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd366f82-5985-4bc5-8ced-8d57fee135dd-trusted-ca\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.452457 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.452433 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1bd360d-786a-4234-ba7b-676228a5b76e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-8p47t\" (UID: \"a1bd360d-786a-4234-ba7b-676228a5b76e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" Jun 08 10:23:19.452647 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.452631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd366f82-5985-4bc5-8ced-8d57fee135dd-serving-cert\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.457732 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.457708 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5"] Jun 08 10:23:19.460292 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.460277 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:19.463985 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.463956 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 10:23:19.464094 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.464078 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g5nmv\"" Jun 08 10:23:19.464480 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.464463 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 10:23:19.468363 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.468344 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hsmz\" (UniqueName: \"kubernetes.io/projected/dd366f82-5985-4bc5-8ced-8d57fee135dd-kube-api-access-7hsmz\") pod \"console-operator-668fdbf85c-ng6j8\" (UID: \"dd366f82-5985-4bc5-8ced-8d57fee135dd\") " pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.468504 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.468488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs76n\" (UniqueName: \"kubernetes.io/projected/a1bd360d-786a-4234-ba7b-676228a5b76e-kube-api-access-cs76n\") pod \"service-ca-operator-6bc5ff68f5-8p47t\" (UID: \"a1bd360d-786a-4234-ba7b-676228a5b76e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" Jun 08 10:23:19.468875 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.468859 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dg7l\" (UniqueName: \"kubernetes.io/projected/5b6aca61-7130-486b-b4c5-ddaf4b58e459-kube-api-access-6dg7l\") pod \"volume-data-source-validator-78dd696465-w9smj\" (UID: \"5b6aca61-7130-486b-b4c5-ddaf4b58e459\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-w9smj" Jun 08 10:23:19.477752 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.477730 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5"] Jun 08 10:23:19.551397 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.551299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjsrg\" (UniqueName: \"kubernetes.io/projected/98b14688-bfa2-4bc0-b34b-34fc039d3101-kube-api-access-gjsrg\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kmb2g\" (UID: \"98b14688-bfa2-4bc0-b34b-34fc039d3101\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" Jun 08 10:23:19.551397 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.551344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-825hf\" (UniqueName: \"kubernetes.io/projected/56d14d77-f8d9-44ad-9f62-4795dfb32a79-kube-api-access-825hf\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:19.551625 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.551419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98b14688-bfa2-4bc0-b34b-34fc039d3101-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kmb2g\" (UID: \"98b14688-bfa2-4bc0-b34b-34fc039d3101\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" Jun 08 10:23:19.551625 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.551454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sthhz\" (UniqueName: \"kubernetes.io/projected/f5f7139e-3d44-470b-ac56-02815aa81b9e-kube-api-access-sthhz\") pod \"cluster-samples-operator-854f8b96b6-nx4sb\" (UID: \"f5f7139e-3d44-470b-ac56-02815aa81b9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:19.551625 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.551497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nx4sb\" (UID: \"f5f7139e-3d44-470b-ac56-02815aa81b9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:19.551625 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.551543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2adfe24a-68bc-4473-a12c-0745ee473120-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:19.551625 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.551576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/98b14688-bfa2-4bc0-b34b-34fc039d3101-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kmb2g\" (UID: \"98b14688-bfa2-4bc0-b34b-34fc039d3101\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" Jun 08 10:23:19.551625 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.551618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56d14d77-f8d9-44ad-9f62-4795dfb32a79-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:19.551984 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.551666 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:19.551984 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.551719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:19.551984 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:19.551720 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 10:23:19.551984 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:19.551846 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls podName:f5f7139e-3d44-470b-ac56-02815aa81b9e nodeName:}" failed. No retries permitted until 2026-06-08 10:23:20.051800423 +0000 UTC m=+229.896002776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-nx4sb" (UID: "f5f7139e-3d44-470b-ac56-02815aa81b9e") : secret "samples-operator-tls" not found Jun 08 10:23:19.551984 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:19.551866 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:19.551984 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:19.551926 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls podName:56d14d77-f8d9-44ad-9f62-4795dfb32a79 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:20.051914238 +0000 UTC m=+229.896116588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ssxcf" (UID: "56d14d77-f8d9-44ad-9f62-4795dfb32a79") : secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:19.552208 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.552118 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/98b14688-bfa2-4bc0-b34b-34fc039d3101-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kmb2g\" (UID: \"98b14688-bfa2-4bc0-b34b-34fc039d3101\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" Jun 08 10:23:19.552331 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.552313 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56d14d77-f8d9-44ad-9f62-4795dfb32a79-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:19.553711 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.553690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98b14688-bfa2-4bc0-b34b-34fc039d3101-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kmb2g\" (UID: \"98b14688-bfa2-4bc0-b34b-34fc039d3101\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" Jun 08 10:23:19.560579 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.560554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjsrg\" (UniqueName: \"kubernetes.io/projected/98b14688-bfa2-4bc0-b34b-34fc039d3101-kube-api-access-gjsrg\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kmb2g\" (UID: \"98b14688-bfa2-4bc0-b34b-34fc039d3101\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" Jun 08 10:23:19.565769 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.565750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-825hf\" (UniqueName: \"kubernetes.io/projected/56d14d77-f8d9-44ad-9f62-4795dfb32a79-kube-api-access-825hf\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:19.566102 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.566086 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sthhz\" (UniqueName: \"kubernetes.io/projected/f5f7139e-3d44-470b-ac56-02815aa81b9e-kube-api-access-sthhz\") pod \"cluster-samples-operator-854f8b96b6-nx4sb\" (UID: \"f5f7139e-3d44-470b-ac56-02815aa81b9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:19.569828 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.569805 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" Jun 08 10:23:19.580424 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.580395 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:19.586241 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.586213 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-w9smj" Jun 08 10:23:19.599570 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.599521 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:19.653084 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.652808 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2adfe24a-68bc-4473-a12c-0745ee473120-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:19.653084 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.652903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:19.653084 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:19.653070 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 10:23:19.653353 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:19.653155 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert podName:2adfe24a-68bc-4473-a12c-0745ee473120 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:20.153134707 +0000 UTC m=+229.997337075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bhwv5" (UID: "2adfe24a-68bc-4473-a12c-0745ee473120") : secret "networking-console-plugin-cert" not found Jun 08 10:23:19.653684 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.653635 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2adfe24a-68bc-4473-a12c-0745ee473120-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:19.670963 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.670875 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:19.675178 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.675150 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" Jun 08 10:23:19.725369 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.725339 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t"] Jun 08 10:23:19.727762 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:23:19.727738 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1bd360d_786a_4234_ba7b_676228a5b76e.slice/crio-04c6171bf219115e3713fb588582710a27dc3253530570fc25d7c3d63a2153cb WatchSource:0}: Error finding container 04c6171bf219115e3713fb588582710a27dc3253530570fc25d7c3d63a2153cb: Status 404 returned error can't find the container with id 04c6171bf219115e3713fb588582710a27dc3253530570fc25d7c3d63a2153cb Jun 08 10:23:19.809293 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.809216 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g"] Jun 08 10:23:19.811879 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:23:19.811848 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b14688_bfa2_4bc0_b34b_34fc039d3101.slice/crio-ddabe9300b982185e2d922f5b18aaa79f24d8a006bc63dc6b334d63c89992445 WatchSource:0}: Error finding container ddabe9300b982185e2d922f5b18aaa79f24d8a006bc63dc6b334d63c89992445: Status 404 returned error can't find the container with id ddabe9300b982185e2d922f5b18aaa79f24d8a006bc63dc6b334d63c89992445 Jun 08 10:23:19.939619 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.939589 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-w9smj"] Jun 08 10:23:19.943019 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:19.942991 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-ng6j8"] Jun 08 10:23:19.944016 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:23:19.943989 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6aca61_7130_486b_b4c5_ddaf4b58e459.slice/crio-87412cb457ccf7b29165cdf047cee15a9032b4c2a55a3807dc8f4ba8744005db WatchSource:0}: Error finding container 87412cb457ccf7b29165cdf047cee15a9032b4c2a55a3807dc8f4ba8744005db: Status 404 returned error can't find the container with id 87412cb457ccf7b29165cdf047cee15a9032b4c2a55a3807dc8f4ba8744005db Jun 08 10:23:19.947102 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:23:19.947080 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd366f82_5985_4bc5_8ced_8d57fee135dd.slice/crio-020786f59a5008f5d02b77ada5a94b1bb553d794495ae06e6b0230698954387b WatchSource:0}: Error finding container 020786f59a5008f5d02b77ada5a94b1bb553d794495ae06e6b0230698954387b: Status 404 returned error can't find the container with id 020786f59a5008f5d02b77ada5a94b1bb553d794495ae06e6b0230698954387b Jun 08 10:23:20.055420 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:20.055384 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nx4sb\" (UID: \"f5f7139e-3d44-470b-ac56-02815aa81b9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:20.055611 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:20.055483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:20.055611 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:20.055593 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 10:23:20.055697 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:20.055635 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:20.055697 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:20.055683 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls podName:f5f7139e-3d44-470b-ac56-02815aa81b9e nodeName:}" failed. No retries permitted until 2026-06-08 10:23:21.055660112 +0000 UTC m=+230.899862465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-nx4sb" (UID: "f5f7139e-3d44-470b-ac56-02815aa81b9e") : secret "samples-operator-tls" not found Jun 08 10:23:20.055784 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:20.055704 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls podName:56d14d77-f8d9-44ad-9f62-4795dfb32a79 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:21.055694434 +0000 UTC m=+230.899896784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ssxcf" (UID: "56d14d77-f8d9-44ad-9f62-4795dfb32a79") : secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:20.156751 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:20.156658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:20.156917 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:20.156800 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 10:23:20.156917 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:20.156878 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert podName:2adfe24a-68bc-4473-a12c-0745ee473120 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:21.156862703 +0000 UTC m=+231.001065057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bhwv5" (UID: "2adfe24a-68bc-4473-a12c-0745ee473120") : secret "networking-console-plugin-cert" not found Jun 08 10:23:20.410494 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:20.410400 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" event={"ID":"98b14688-bfa2-4bc0-b34b-34fc039d3101","Type":"ContainerStarted","Data":"ddabe9300b982185e2d922f5b18aaa79f24d8a006bc63dc6b334d63c89992445"} Jun 08 10:23:20.411620 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:20.411553 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" event={"ID":"a1bd360d-786a-4234-ba7b-676228a5b76e","Type":"ContainerStarted","Data":"04c6171bf219115e3713fb588582710a27dc3253530570fc25d7c3d63a2153cb"} Jun 08 10:23:20.412912 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:20.412856 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" event={"ID":"dd366f82-5985-4bc5-8ced-8d57fee135dd","Type":"ContainerStarted","Data":"020786f59a5008f5d02b77ada5a94b1bb553d794495ae06e6b0230698954387b"} Jun 08 10:23:20.414098 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:20.414071 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-w9smj" event={"ID":"5b6aca61-7130-486b-b4c5-ddaf4b58e459","Type":"ContainerStarted","Data":"87412cb457ccf7b29165cdf047cee15a9032b4c2a55a3807dc8f4ba8744005db"} Jun 08 10:23:21.065952 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:21.065916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nx4sb\" (UID: \"f5f7139e-3d44-470b-ac56-02815aa81b9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:21.066139 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:21.066026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:21.066139 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:21.066065 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 10:23:21.066139 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:21.066138 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls podName:f5f7139e-3d44-470b-ac56-02815aa81b9e nodeName:}" failed. No retries permitted until 2026-06-08 10:23:23.066116828 +0000 UTC m=+232.910319192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-nx4sb" (UID: "f5f7139e-3d44-470b-ac56-02815aa81b9e") : secret "samples-operator-tls" not found Jun 08 10:23:21.066528 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:21.066504 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:21.066602 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:21.066584 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls podName:56d14d77-f8d9-44ad-9f62-4795dfb32a79 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:23.06655606 +0000 UTC m=+232.910758417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ssxcf" (UID: "56d14d77-f8d9-44ad-9f62-4795dfb32a79") : secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:21.167195 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:21.167156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:21.167363 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:21.167325 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 10:23:21.167439 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:21.167423 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert podName:2adfe24a-68bc-4473-a12c-0745ee473120 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:23.167401156 +0000 UTC m=+233.011603513 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bhwv5" (UID: "2adfe24a-68bc-4473-a12c-0745ee473120") : secret "networking-console-plugin-cert" not found Jun 08 10:23:21.419550 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:21.419463 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-w9smj" event={"ID":"5b6aca61-7130-486b-b4c5-ddaf4b58e459","Type":"ContainerStarted","Data":"f93c19bb0d1f38b5f9138c39dc6b1c79a0a86e53a393d0234443c37d9e2625f3"} Jun 08 10:23:21.437089 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:21.437020 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-w9smj" podStartSLOduration=1.271788825 podStartE2EDuration="2.436998402s" totalImagesPullingTime="1.165209577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:23:21.436795073 +0000 UTC m=+231.280997468" watchObservedRunningTime="2026-06-08 10:23:21.436998402 +0000 UTC m=+231.281200756" Jun 08 10:23:21.555224 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:21.555190 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:21.655992 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:21.655959 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:23.082862 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:23.082803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nx4sb\" (UID: \"f5f7139e-3d44-470b-ac56-02815aa81b9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:23.083278 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:23.082930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:23.083278 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:23.082982 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 10:23:23.083278 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:23.083068 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls podName:f5f7139e-3d44-470b-ac56-02815aa81b9e nodeName:}" failed. No retries permitted until 2026-06-08 10:23:27.083046336 +0000 UTC m=+236.927248698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-nx4sb" (UID: "f5f7139e-3d44-470b-ac56-02815aa81b9e") : secret "samples-operator-tls" not found Jun 08 10:23:23.083278 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:23.083069 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:23.083278 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:23.083126 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls podName:56d14d77-f8d9-44ad-9f62-4795dfb32a79 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:27.083111525 +0000 UTC m=+236.927313879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ssxcf" (UID: "56d14d77-f8d9-44ad-9f62-4795dfb32a79") : secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:23.183504 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:23.183466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:23.183672 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:23.183613 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 10:23:23.183731 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:23.183686 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert podName:2adfe24a-68bc-4473-a12c-0745ee473120 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:27.183670122 +0000 UTC m=+237.027872472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bhwv5" (UID: "2adfe24a-68bc-4473-a12c-0745ee473120") : secret "networking-console-plugin-cert" not found Jun 08 10:23:23.333366 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:23.333287 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:23.427866 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:23.427597 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:24.437742 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.437708 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" event={"ID":"98b14688-bfa2-4bc0-b34b-34fc039d3101","Type":"ContainerStarted","Data":"63c43c0fef133113c2065c338fc31be76b21874937e951c7f489c5cd483ad37f"} Jun 08 10:23:24.439272 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.439239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" event={"ID":"a1bd360d-786a-4234-ba7b-676228a5b76e","Type":"ContainerStarted","Data":"b9f003b7295d5b29ca3561b32602019660897db8671f74aed747a52387d531b3"} Jun 08 10:23:24.440831 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.440798 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/0.log" Jun 08 10:23:24.440953 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.440850 2577 generic.go:356] "Generic (PLEG): container finished" podID="dd366f82-5985-4bc5-8ced-8d57fee135dd" containerID="f40090e59b84395139ffd6f093181a77928480a4b6c40af3f2b5ea1fde695a08" exitCode=255 Jun 08 10:23:24.440953 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.440876 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" event={"ID":"dd366f82-5985-4bc5-8ced-8d57fee135dd","Type":"ContainerDied","Data":"f40090e59b84395139ffd6f093181a77928480a4b6c40af3f2b5ea1fde695a08"} Jun 08 10:23:24.441084 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.441070 2577 scope.go:117] "RemoveContainer" containerID="f40090e59b84395139ffd6f093181a77928480a4b6c40af3f2b5ea1fde695a08" Jun 08 10:23:24.468749 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.468707 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" podStartSLOduration=1.9124035080000001 podStartE2EDuration="5.468693396s" totalImagesPullingTime="3.556289888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:23:24.468520811 +0000 UTC m=+234.312723184" watchObservedRunningTime="2026-06-08 10:23:24.468693396 +0000 UTC m=+234.312895767" Jun 08 10:23:24.527991 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.527928 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" podStartSLOduration=1.893314046 podStartE2EDuration="5.527907419s" totalImagesPullingTime="3.634593373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:23:24.526805466 +0000 UTC m=+234.371007839" watchObservedRunningTime="2026-06-08 10:23:24.527907419 +0000 UTC m=+234.372109808" Jun 08 10:23:24.825955 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.825918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:24.912334 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.912296 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:24.992780 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.992741 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:25.003189 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:24.999650 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s"] Jun 08 10:23:25.004147 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.004061 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s" Jun 08 10:23:25.007101 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.007080 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 08 10:23:25.007101 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.007094 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 08 10:23:25.008174 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.008155 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rzqgp\"" Jun 08 10:23:25.011466 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.011447 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s"] Jun 08 10:23:25.089019 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.088934 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:25.099037 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.099006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m58nl\" (UniqueName: \"kubernetes.io/projected/cf3d5c6d-7cc0-48e0-978b-87b2aaf2288e-kube-api-access-m58nl\") pod \"migrator-955ffdf5f-78h6s\" (UID: \"cf3d5c6d-7cc0-48e0-978b-87b2aaf2288e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s" Jun 08 10:23:25.187836 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.187789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:25.200015 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.199985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m58nl\" (UniqueName: \"kubernetes.io/projected/cf3d5c6d-7cc0-48e0-978b-87b2aaf2288e-kube-api-access-m58nl\") pod \"migrator-955ffdf5f-78h6s\" (UID: \"cf3d5c6d-7cc0-48e0-978b-87b2aaf2288e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s" Jun 08 10:23:25.209167 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.209141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m58nl\" (UniqueName: \"kubernetes.io/projected/cf3d5c6d-7cc0-48e0-978b-87b2aaf2288e-kube-api-access-m58nl\") pod \"migrator-955ffdf5f-78h6s\" (UID: \"cf3d5c6d-7cc0-48e0-978b-87b2aaf2288e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s" Jun 08 10:23:25.291053 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.291024 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:25.314611 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.314589 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s" Jun 08 10:23:25.437215 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.437181 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s"] Jun 08 10:23:25.440006 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:23:25.439979 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3d5c6d_7cc0_48e0_978b_87b2aaf2288e.slice/crio-8bd579f2a9a05a5fc9d02046b2e719f9ce625a3dafcd178352749f955621e593 WatchSource:0}: Error finding container 8bd579f2a9a05a5fc9d02046b2e719f9ce625a3dafcd178352749f955621e593: Status 404 returned error can't find the container with id 8bd579f2a9a05a5fc9d02046b2e719f9ce625a3dafcd178352749f955621e593 Jun 08 10:23:25.444954 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.444939 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/1.log" Jun 08 10:23:25.445351 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.445333 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/0.log" Jun 08 10:23:25.445436 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.445370 2577 generic.go:356] "Generic (PLEG): container finished" podID="dd366f82-5985-4bc5-8ced-8d57fee135dd" containerID="01bbd61c894ff7bedde4f185e968f404a5a13cff1535fb67658feca9ce3c3bb1" exitCode=255 Jun 08 10:23:25.445501 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.445455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" event={"ID":"dd366f82-5985-4bc5-8ced-8d57fee135dd","Type":"ContainerDied","Data":"01bbd61c894ff7bedde4f185e968f404a5a13cff1535fb67658feca9ce3c3bb1"} Jun 08 10:23:25.445554 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.445508 2577 scope.go:117] "RemoveContainer" containerID="f40090e59b84395139ffd6f093181a77928480a4b6c40af3f2b5ea1fde695a08" Jun 08 10:23:25.445737 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.445715 2577 scope.go:117] "RemoveContainer" containerID="01bbd61c894ff7bedde4f185e968f404a5a13cff1535fb67658feca9ce3c3bb1" Jun 08 10:23:25.445866 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.445849 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r52bt_42ab1983-d354-4c86-813c-cdc7b031523d/dns-node-resolver/0.log" Jun 08 10:23:25.445967 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:25.445948 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-ng6j8_openshift-console-operator(dd366f82-5985-4bc5-8ced-8d57fee135dd)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" podUID="dd366f82-5985-4bc5-8ced-8d57fee135dd" Jun 08 10:23:25.446770 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.446743 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s" event={"ID":"cf3d5c6d-7cc0-48e0-978b-87b2aaf2288e","Type":"ContainerStarted","Data":"8bd579f2a9a05a5fc9d02046b2e719f9ce625a3dafcd178352749f955621e593"} Jun 08 10:23:25.526063 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.526033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:25.621953 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:25.621861 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:26.247022 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:26.246993 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g4ksc_439e2bac-1174-41b6-9418-9091f93effba/node-ca/0.log" Jun 08 10:23:26.451892 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:26.451855 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/1.log" Jun 08 10:23:26.452302 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:26.452248 2577 scope.go:117] "RemoveContainer" containerID="01bbd61c894ff7bedde4f185e968f404a5a13cff1535fb67658feca9ce3c3bb1" Jun 08 10:23:26.452435 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:26.452414 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-ng6j8_openshift-console-operator(dd366f82-5985-4bc5-8ced-8d57fee135dd)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" podUID="dd366f82-5985-4bc5-8ced-8d57fee135dd" Jun 08 10:23:26.845967 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:26.845896 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8cwp2_4722055d-0c45-410e-82c8-6d87030a7019/serve-healthcheck-canary/0.log" Jun 08 10:23:27.106413 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.106338 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-7xbwb"] Jun 08 10:23:27.108370 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.108354 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" Jun 08 10:23:27.111139 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.111119 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 08 10:23:27.111251 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.111204 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 08 10:23:27.112117 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.112098 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ntt2t\"" Jun 08 10:23:27.112201 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.112098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 08 10:23:27.112201 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.112124 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 08 10:23:27.115570 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.115541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:27.115655 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.115598 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nx4sb\" (UID: \"f5f7139e-3d44-470b-ac56-02815aa81b9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:27.115655 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:27.115632 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:27.115745 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:27.115689 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls podName:56d14d77-f8d9-44ad-9f62-4795dfb32a79 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:35.115669496 +0000 UTC m=+244.959871863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ssxcf" (UID: "56d14d77-f8d9-44ad-9f62-4795dfb32a79") : secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:27.115745 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:27.115713 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 10:23:27.115846 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:27.115751 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls podName:f5f7139e-3d44-470b-ac56-02815aa81b9e nodeName:}" failed. No retries permitted until 2026-06-08 10:23:35.115739198 +0000 UTC m=+244.959941563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-nx4sb" (UID: "f5f7139e-3d44-470b-ac56-02815aa81b9e") : secret "samples-operator-tls" not found Jun 08 10:23:27.118142 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.118119 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-7xbwb"] Jun 08 10:23:27.149445 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.149421 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:27.216959 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.216934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9422fdae-c471-49b3-a950-46ce5a96f0c7-signing-cabundle\") pod \"service-ca-7d74d578b8-7xbwb\" (UID: \"9422fdae-c471-49b3-a950-46ce5a96f0c7\") " pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" Jun 08 10:23:27.217083 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.216982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9422fdae-c471-49b3-a950-46ce5a96f0c7-signing-key\") pod \"service-ca-7d74d578b8-7xbwb\" (UID: \"9422fdae-c471-49b3-a950-46ce5a96f0c7\") " pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" Jun 08 10:23:27.217083 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.217042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:27.217083 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.217080 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhncg\" (UniqueName: \"kubernetes.io/projected/9422fdae-c471-49b3-a950-46ce5a96f0c7-kube-api-access-mhncg\") pod \"service-ca-7d74d578b8-7xbwb\" (UID: \"9422fdae-c471-49b3-a950-46ce5a96f0c7\") " pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" Jun 08 10:23:27.217230 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:27.217215 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 10:23:27.217280 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:27.217271 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert podName:2adfe24a-68bc-4473-a12c-0745ee473120 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:35.217257687 +0000 UTC m=+245.061460038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bhwv5" (UID: "2adfe24a-68bc-4473-a12c-0745ee473120") : secret "networking-console-plugin-cert" not found Jun 08 10:23:27.247500 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.247472 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:27.318316 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.318289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9422fdae-c471-49b3-a950-46ce5a96f0c7-signing-key\") pod \"service-ca-7d74d578b8-7xbwb\" (UID: \"9422fdae-c471-49b3-a950-46ce5a96f0c7\") " pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" Jun 08 10:23:27.318448 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.318338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhncg\" (UniqueName: \"kubernetes.io/projected/9422fdae-c471-49b3-a950-46ce5a96f0c7-kube-api-access-mhncg\") pod \"service-ca-7d74d578b8-7xbwb\" (UID: \"9422fdae-c471-49b3-a950-46ce5a96f0c7\") " pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" Jun 08 10:23:27.318544 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.318522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9422fdae-c471-49b3-a950-46ce5a96f0c7-signing-cabundle\") pod \"service-ca-7d74d578b8-7xbwb\" (UID: \"9422fdae-c471-49b3-a950-46ce5a96f0c7\") " pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" Jun 08 10:23:27.319124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.319106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9422fdae-c471-49b3-a950-46ce5a96f0c7-signing-cabundle\") pod \"service-ca-7d74d578b8-7xbwb\" (UID: \"9422fdae-c471-49b3-a950-46ce5a96f0c7\") " pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" Jun 08 10:23:27.320603 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.320585 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9422fdae-c471-49b3-a950-46ce5a96f0c7-signing-key\") pod \"service-ca-7d74d578b8-7xbwb\" (UID: \"9422fdae-c471-49b3-a950-46ce5a96f0c7\") " pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" Jun 08 10:23:27.326558 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.326527 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhncg\" (UniqueName: \"kubernetes.io/projected/9422fdae-c471-49b3-a950-46ce5a96f0c7-kube-api-access-mhncg\") pod \"service-ca-7d74d578b8-7xbwb\" (UID: \"9422fdae-c471-49b3-a950-46ce5a96f0c7\") " pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" Jun 08 10:23:27.417204 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.417120 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" Jun 08 10:23:27.457391 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.457360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s" event={"ID":"cf3d5c6d-7cc0-48e0-978b-87b2aaf2288e","Type":"ContainerStarted","Data":"2ddcfe3f93d323a607ddf6b7a3836a4697b5e440e8fd0346538b0c671cbe6c54"} Jun 08 10:23:27.457744 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.457411 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s" event={"ID":"cf3d5c6d-7cc0-48e0-978b-87b2aaf2288e","Type":"ContainerStarted","Data":"8ce288952ac605039ceda2066e1167a82cb8a225a37d846b00e0ef32f0372f6a"} Jun 08 10:23:27.473639 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.473587 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-78h6s" podStartSLOduration=2.341980012 podStartE2EDuration="3.473565668s" totalImagesPullingTime="1.131585656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:23:27.473133652 +0000 UTC m=+237.317336035" watchObservedRunningTime="2026-06-08 10:23:27.473565668 +0000 UTC m=+237.317768042" Jun 08 10:23:27.541228 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.541204 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-7xbwb"] Jun 08 10:23:27.543628 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:23:27.543592 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9422fdae_c471_49b3_a950_46ce5a96f0c7.slice/crio-f52a42f5598e45f8a5a83542675e7a8e0059f0e3a10398784ea429125c01730a WatchSource:0}: Error finding container f52a42f5598e45f8a5a83542675e7a8e0059f0e3a10398784ea429125c01730a: Status 404 returned error can't find the container with id f52a42f5598e45f8a5a83542675e7a8e0059f0e3a10398784ea429125c01730a Jun 08 10:23:27.563954 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:27.563924 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:28.021095 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:28.021060 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:28.462466 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:28.462372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" event={"ID":"9422fdae-c471-49b3-a950-46ce5a96f0c7","Type":"ContainerStarted","Data":"f34f079be7e8ff487a73e48c40eba751a8b9b00a152db6f7e8e0c7241574c522"} Jun 08 10:23:28.462813 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:28.462465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" event={"ID":"9422fdae-c471-49b3-a950-46ce5a96f0c7","Type":"ContainerStarted","Data":"f52a42f5598e45f8a5a83542675e7a8e0059f0e3a10398784ea429125c01730a"} Jun 08 10:23:28.482403 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:28.482347 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-7xbwb" podStartSLOduration=1.48232766 podStartE2EDuration="1.48232766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:23:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:23:28.481163636 +0000 UTC m=+238.325366018" watchObservedRunningTime="2026-06-08 10:23:28.48232766 +0000 UTC m=+238.326530035" Jun 08 10:23:28.714919 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:28.714803 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:28.911298 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:28.911263 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:29.010315 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:29.010277 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:29.110181 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:29.110138 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:29.211003 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:29.210968 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:29.409182 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:29.409148 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:29.581570 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:29.581491 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:29.581570 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:29.581546 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:29.581972 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:29.581912 2577 scope.go:117] "RemoveContainer" containerID="01bbd61c894ff7bedde4f185e968f404a5a13cff1535fb67658feca9ce3c3bb1" Jun 08 10:23:29.582084 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:29.582064 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-ng6j8_openshift-console-operator(dd366f82-5985-4bc5-8ced-8d57fee135dd)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" podUID="dd366f82-5985-4bc5-8ced-8d57fee135dd" Jun 08 10:23:30.238242 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:30.238210 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:30.807848 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:30.807804 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:30.987065 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:30.987032 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:31.046218 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:31.046184 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:31.408177 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:31.408135 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:31.609680 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:31.609640 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:32.003310 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:32.003279 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:32.432330 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:32.432291 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:32.608033 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:32.607998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:32.797370 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:32.797333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:33.201884 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:33.201792 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:33.395002 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:33.394968 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:33.613495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:33.613463 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:33.997032 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:33.996954 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:34.482657 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:34.482626 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:34.806573 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:34.806542 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:34.998863 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:34.998801 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:35.185884 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.185780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:35.186044 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.185931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nx4sb\" (UID: \"f5f7139e-3d44-470b-ac56-02815aa81b9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:35.186044 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:35.185935 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:35.186153 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:35.186093 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls podName:56d14d77-f8d9-44ad-9f62-4795dfb32a79 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:51.18607157 +0000 UTC m=+261.030273923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ssxcf" (UID: "56d14d77-f8d9-44ad-9f62-4795dfb32a79") : secret "cluster-monitoring-operator-tls" not found Jun 08 10:23:35.188187 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.188163 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5f7139e-3d44-470b-ac56-02815aa81b9e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-nx4sb\" (UID: \"f5f7139e-3d44-470b-ac56-02815aa81b9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:35.224432 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.224369 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:35.271588 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.271559 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9czxx\"" Jun 08 10:23:35.280258 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.280234 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" Jun 08 10:23:35.288004 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.287979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:35.288107 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:35.288092 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 10:23:35.288157 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:35.288150 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert podName:2adfe24a-68bc-4473-a12c-0745ee473120 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:51.288135548 +0000 UTC m=+261.132337919 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bhwv5" (UID: "2adfe24a-68bc-4473-a12c-0745ee473120") : secret "networking-console-plugin-cert" not found Jun 08 10:23:35.403612 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.403580 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:35.403808 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.403789 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb"] Jun 08 10:23:35.486600 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.486569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" event={"ID":"f5f7139e-3d44-470b-ac56-02815aa81b9e","Type":"ContainerStarted","Data":"f869398ef927dfd10b32c88648d55ca9265491f18b57b56e6a9757855d618ebb"} Jun 08 10:23:35.602635 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.602573 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:35.999859 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:35.999805 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:36.362872 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:36.362835 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:36.800349 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:36.800312 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:37.000944 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:37.000907 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:37.200949 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:37.200861 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:37.398108 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:37.398082 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:37.495435 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:37.495349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" event={"ID":"f5f7139e-3d44-470b-ac56-02815aa81b9e","Type":"ContainerStarted","Data":"9c94bb5011c27db42717a373a1b1e17fe9006b90dc53d62181c55ea29e1a815e"} Jun 08 10:23:37.495435 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:37.495402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" event={"ID":"f5f7139e-3d44-470b-ac56-02815aa81b9e","Type":"ContainerStarted","Data":"378d27be238f744f9ce41db21e801c20466ca932495655140c49b0177fc7bb8e"} Jun 08 10:23:37.513812 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:37.513768 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-nx4sb" podStartSLOduration=16.658388363 podStartE2EDuration="18.513754672s" totalImagesPullingTime="1.855366309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:23:37.512102118 +0000 UTC m=+247.356304489" watchObservedRunningTime="2026-06-08 10:23:37.513754672 +0000 UTC m=+247.357957100" Jun 08 10:23:38.405527 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:38.405496 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:38.800835 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:38.800792 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:38.998984 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:38.998941 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:39.196902 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:39.196802 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:39.396373 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:39.396342 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:39.651240 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:39.651209 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:39.743015 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:39.742984 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:41.436377 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:41.436328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:23:41.438677 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:41.438656 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90295d28-34ba-447d-9517-0520ee42f937-metrics-certs\") pod \"network-metrics-daemon-hzg8m\" (UID: \"90295d28-34ba-447d-9517-0520ee42f937\") " pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:23:41.619736 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:41.619704 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z72dv\"" Jun 08 10:23:41.627485 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:41.627450 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hzg8m" Jun 08 10:23:41.756325 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:41.756300 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hzg8m"] Jun 08 10:23:41.758809 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:23:41.758773 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90295d28_34ba_447d_9517_0520ee42f937.slice/crio-009cf05be96bd117ae8a74c1727150121fd8471c959661dbad14773ad4a950bc WatchSource:0}: Error finding container 009cf05be96bd117ae8a74c1727150121fd8471c959661dbad14773ad4a950bc: Status 404 returned error can't find the container with id 009cf05be96bd117ae8a74c1727150121fd8471c959661dbad14773ad4a950bc Jun 08 10:23:42.513106 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:42.513070 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzg8m" event={"ID":"90295d28-34ba-447d-9517-0520ee42f937","Type":"ContainerStarted","Data":"009cf05be96bd117ae8a74c1727150121fd8471c959661dbad14773ad4a950bc"} Jun 08 10:23:43.517669 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:43.517634 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzg8m" event={"ID":"90295d28-34ba-447d-9517-0520ee42f937","Type":"ContainerStarted","Data":"e792d1dac5b6ac5b6d0d09afb4960e74ec61c3c7dd3405acfc4168576db9d4d9"} Jun 08 10:23:43.518067 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:43.517687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hzg8m" event={"ID":"90295d28-34ba-447d-9517-0520ee42f937","Type":"ContainerStarted","Data":"c6b379b801c40f1ee4a8cfefa8dbb48fc9d0145ce779e8f914a09c8612d58a68"} Jun 08 10:23:43.534699 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:43.534639 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hzg8m" podStartSLOduration=252.730070466 podStartE2EDuration="4m13.534620139s" totalImagesPullingTime="804.549673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:23:43.534428493 +0000 UTC m=+253.378630884" watchObservedRunningTime="2026-06-08 10:23:43.534620139 +0000 UTC m=+253.378822511" Jun 08 10:23:44.614991 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:44.614964 2577 scope.go:117] "RemoveContainer" containerID="01bbd61c894ff7bedde4f185e968f404a5a13cff1535fb67658feca9ce3c3bb1" Jun 08 10:23:45.524926 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:45.524899 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/2.log" Jun 08 10:23:45.525344 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:45.525324 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/1.log" Jun 08 10:23:45.525452 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:45.525364 2577 generic.go:356] "Generic (PLEG): container finished" podID="dd366f82-5985-4bc5-8ced-8d57fee135dd" containerID="ed3f26c1d0329a909ad47cd96b4062d6569248a705ec6aac42b98c589ed249d0" exitCode=255 Jun 08 10:23:45.525452 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:45.525438 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" event={"ID":"dd366f82-5985-4bc5-8ced-8d57fee135dd","Type":"ContainerDied","Data":"ed3f26c1d0329a909ad47cd96b4062d6569248a705ec6aac42b98c589ed249d0"} Jun 08 10:23:45.525550 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:45.525497 2577 scope.go:117] "RemoveContainer" containerID="01bbd61c894ff7bedde4f185e968f404a5a13cff1535fb67658feca9ce3c3bb1" Jun 08 10:23:45.525901 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:45.525875 2577 scope.go:117] "RemoveContainer" containerID="ed3f26c1d0329a909ad47cd96b4062d6569248a705ec6aac42b98c589ed249d0" Jun 08 10:23:45.526095 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:45.526074 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-ng6j8_openshift-console-operator(dd366f82-5985-4bc5-8ced-8d57fee135dd)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" podUID="dd366f82-5985-4bc5-8ced-8d57fee135dd" Jun 08 10:23:46.529539 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:46.529507 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/2.log" Jun 08 10:23:47.835697 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.835659 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k9mz9"] Jun 08 10:23:47.851504 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.851477 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:47.855000 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.854971 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 10:23:47.855315 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.855299 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 10:23:47.856059 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.856030 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 10:23:47.856299 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.856266 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gl8w4\"" Jun 08 10:23:47.856408 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.856332 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 10:23:47.860124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.860099 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9mz9"] Jun 08 10:23:47.987784 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.987751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98116eed-5bcc-40ca-ad77-f0566108abd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:47.987947 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.987794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98116eed-5bcc-40ca-ad77-f0566108abd6-data-volume\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:47.987947 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.987833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slds9\" (UniqueName: \"kubernetes.io/projected/98116eed-5bcc-40ca-ad77-f0566108abd6-kube-api-access-slds9\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:47.988033 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.987969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98116eed-5bcc-40ca-ad77-f0566108abd6-crio-socket\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:47.988033 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:47.987993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98116eed-5bcc-40ca-ad77-f0566108abd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.016152 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.016117 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:48.088625 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.088520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98116eed-5bcc-40ca-ad77-f0566108abd6-crio-socket\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.088625 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.088556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98116eed-5bcc-40ca-ad77-f0566108abd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.088874 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.088647 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98116eed-5bcc-40ca-ad77-f0566108abd6-crio-socket\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.088874 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.088693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98116eed-5bcc-40ca-ad77-f0566108abd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.088874 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.088753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98116eed-5bcc-40ca-ad77-f0566108abd6-data-volume\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.088874 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.088778 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slds9\" (UniqueName: \"kubernetes.io/projected/98116eed-5bcc-40ca-ad77-f0566108abd6-kube-api-access-slds9\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.089073 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.089037 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98116eed-5bcc-40ca-ad77-f0566108abd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.089123 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.089094 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98116eed-5bcc-40ca-ad77-f0566108abd6-data-volume\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.091021 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.091004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98116eed-5bcc-40ca-ad77-f0566108abd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.097240 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.097215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slds9\" (UniqueName: \"kubernetes.io/projected/98116eed-5bcc-40ca-ad77-f0566108abd6-kube-api-access-slds9\") pod \"insights-runtime-extractor-k9mz9\" (UID: \"98116eed-5bcc-40ca-ad77-f0566108abd6\") " pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.113230 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.113202 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:48.162755 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.162726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9mz9" Jun 08 10:23:48.328016 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.327983 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9mz9"] Jun 08 10:23:48.331160 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:23:48.331132 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98116eed_5bcc_40ca_ad77_f0566108abd6.slice/crio-fd9aacd583a95fa7b06ad4994a55c63f625340b18da20deb33876700bc92a240 WatchSource:0}: Error finding container fd9aacd583a95fa7b06ad4994a55c63f625340b18da20deb33876700bc92a240: Status 404 returned error can't find the container with id fd9aacd583a95fa7b06ad4994a55c63f625340b18da20deb33876700bc92a240 Jun 08 10:23:48.360598 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.360531 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:48.463836 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.463783 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:48.538081 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.538049 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9mz9" event={"ID":"98116eed-5bcc-40ca-ad77-f0566108abd6","Type":"ContainerStarted","Data":"f37b5927eb1ba93e3ec8028ebcd4b9e83a72e4b245117289441d45ebdee0aec6"} Jun 08 10:23:48.538225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:48.538103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9mz9" event={"ID":"98116eed-5bcc-40ca-ad77-f0566108abd6","Type":"ContainerStarted","Data":"fd9aacd583a95fa7b06ad4994a55c63f625340b18da20deb33876700bc92a240"} Jun 08 10:23:49.542859 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:49.542830 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9mz9" event={"ID":"98116eed-5bcc-40ca-ad77-f0566108abd6","Type":"ContainerStarted","Data":"b699811c39736fdcf3376920eb9ccdc370594163ea891d5ab50cb5bc42f5a1cd"} Jun 08 10:23:49.561382 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:49.561352 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:49.581263 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:49.581233 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:49.581397 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:49.581294 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:23:49.581660 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:49.581632 2577 scope.go:117] "RemoveContainer" containerID="ed3f26c1d0329a909ad47cd96b4062d6569248a705ec6aac42b98c589ed249d0" Jun 08 10:23:49.581814 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:49.581791 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-ng6j8_openshift-console-operator(dd366f82-5985-4bc5-8ced-8d57fee135dd)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" podUID="dd366f82-5985-4bc5-8ced-8d57fee135dd" Jun 08 10:23:51.214561 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.214510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:51.216918 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.216897 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56d14d77-f8d9-44ad-9f62-4795dfb32a79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ssxcf\" (UID: \"56d14d77-f8d9-44ad-9f62-4795dfb32a79\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:51.315346 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.315306 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:51.317586 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.317568 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2adfe24a-68bc-4473-a12c-0745ee473120-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bhwv5\" (UID: \"2adfe24a-68bc-4473-a12c-0745ee473120\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:51.463412 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.463380 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fnw72\"" Jun 08 10:23:51.471700 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.471655 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" Jun 08 10:23:51.552947 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.552910 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9mz9" event={"ID":"98116eed-5bcc-40ca-ad77-f0566108abd6","Type":"ContainerStarted","Data":"e5ead6f2fc5bc91a54d777670a8f264090cc126828d8ad3e0f7a0c4fb90aed1f"} Jun 08 10:23:51.573342 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.573311 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g5nmv\"" Jun 08 10:23:51.574500 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.574450 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k9mz9" podStartSLOduration=2.451025267 podStartE2EDuration="4.574435586s" totalImagesPullingTime="2.123410319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:23:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:23:51.573398097 +0000 UTC m=+261.417600471" watchObservedRunningTime="2026-06-08 10:23:51.574435586 +0000 UTC m=+261.418637957" Jun 08 10:23:51.580531 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.580510 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" Jun 08 10:23:51.599494 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.599464 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf"] Jun 08 10:23:51.602301 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:23:51.602265 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d14d77_f8d9_44ad_9f62_4795dfb32a79.slice/crio-e37c4805cae7289ae690995dc13d38c84166291793ce3c10dc7af28c5f19e254 WatchSource:0}: Error finding container e37c4805cae7289ae690995dc13d38c84166291793ce3c10dc7af28c5f19e254: Status 404 returned error can't find the container with id e37c4805cae7289ae690995dc13d38c84166291793ce3c10dc7af28c5f19e254 Jun 08 10:23:51.703442 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:51.703407 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5"] Jun 08 10:23:51.706771 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:23:51.706743 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2adfe24a_68bc_4473_a12c_0745ee473120.slice/crio-b057760a5a06f3910987333cc52a6b9b99b1ae8d2c5a31dcd7ed735c0b62fe09 WatchSource:0}: Error finding container b057760a5a06f3910987333cc52a6b9b99b1ae8d2c5a31dcd7ed735c0b62fe09: Status 404 returned error can't find the container with id b057760a5a06f3910987333cc52a6b9b99b1ae8d2c5a31dcd7ed735c0b62fe09 Jun 08 10:23:52.558839 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:52.558774 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" event={"ID":"56d14d77-f8d9-44ad-9f62-4795dfb32a79","Type":"ContainerStarted","Data":"e37c4805cae7289ae690995dc13d38c84166291793ce3c10dc7af28c5f19e254"} Jun 08 10:23:52.560710 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:52.560653 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" event={"ID":"2adfe24a-68bc-4473-a12c-0745ee473120","Type":"ContainerStarted","Data":"b057760a5a06f3910987333cc52a6b9b99b1ae8d2c5a31dcd7ed735c0b62fe09"} Jun 08 10:23:53.566066 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:53.566016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" event={"ID":"2adfe24a-68bc-4473-a12c-0745ee473120","Type":"ContainerStarted","Data":"29cf110ecc217bcb0cbb92a70573089e70859a3b6aa4f515d8740d2fd7a6828a"} Jun 08 10:23:53.584143 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:53.584089 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bhwv5" podStartSLOduration=33.361690736 podStartE2EDuration="34.584072446s" totalImagesPullingTime="1.22238171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:23:53.582523773 +0000 UTC m=+263.426726146" watchObservedRunningTime="2026-06-08 10:23:53.584072446 +0000 UTC m=+263.428274808" Jun 08 10:23:53.977114 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:53.977026 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:54.078503 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:54.078471 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:54.147328 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:54.147298 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:54.326108 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:54.326068 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:54.572799 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:54.572767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" event={"ID":"56d14d77-f8d9-44ad-9f62-4795dfb32a79","Type":"ContainerStarted","Data":"024a9fa428127ec5d840a841bd8d4e76e5921d9945c2276922ebb7d539231084"} Jun 08 10:23:54.588657 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:54.588558 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ssxcf" podStartSLOduration=33.546565453 podStartE2EDuration="35.588541896s" totalImagesPullingTime="2.041976443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:23:54.588499977 +0000 UTC m=+264.432702348" watchObservedRunningTime="2026-06-08 10:23:54.588541896 +0000 UTC m=+264.432744267" Jun 08 10:23:55.911148 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:55.911113 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:55.961513 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:55.961485 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:56.285162 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:56.285133 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:57.160253 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.160219 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:57.197889 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.197860 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-r7s58"] Jun 08 10:23:57.200372 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.200357 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.203164 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.203137 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 10:23:57.204326 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.204308 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 10:23:57.204429 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.204331 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 10:23:57.204429 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.204308 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vcfnl\"" Jun 08 10:23:57.211513 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.211490 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-r7s58"] Jun 08 10:23:57.229908 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.229883 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:57.260032 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.260009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/03ece060-2c70-4753-8f46-27b80508dba7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.260139 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.260045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v7lq\" (UniqueName: \"kubernetes.io/projected/03ece060-2c70-4753-8f46-27b80508dba7-kube-api-access-5v7lq\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.260139 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.260066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03ece060-2c70-4753-8f46-27b80508dba7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.260139 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.260105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03ece060-2c70-4753-8f46-27b80508dba7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.361098 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.361060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03ece060-2c70-4753-8f46-27b80508dba7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.361235 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.361133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/03ece060-2c70-4753-8f46-27b80508dba7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.361235 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:57.361226 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 08 10:23:57.361318 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.361252 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v7lq\" (UniqueName: \"kubernetes.io/projected/03ece060-2c70-4753-8f46-27b80508dba7-kube-api-access-5v7lq\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.361318 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.361285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03ece060-2c70-4753-8f46-27b80508dba7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.361318 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:23:57.361305 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ece060-2c70-4753-8f46-27b80508dba7-prometheus-operator-tls podName:03ece060-2c70-4753-8f46-27b80508dba7 nodeName:}" failed. No retries permitted until 2026-06-08 10:23:57.861288501 +0000 UTC m=+267.705490851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/03ece060-2c70-4753-8f46-27b80508dba7-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-r7s58" (UID: "03ece060-2c70-4753-8f46-27b80508dba7") : secret "prometheus-operator-tls" not found Jun 08 10:23:57.361878 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.361858 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03ece060-2c70-4753-8f46-27b80508dba7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.363558 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.363538 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03ece060-2c70-4753-8f46-27b80508dba7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.372395 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.372373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v7lq\" (UniqueName: \"kubernetes.io/projected/03ece060-2c70-4753-8f46-27b80508dba7-kube-api-access-5v7lq\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.638093 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.638056 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:23:57.865088 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.865049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/03ece060-2c70-4753-8f46-27b80508dba7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:57.867248 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:57.867222 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/03ece060-2c70-4753-8f46-27b80508dba7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-r7s58\" (UID: \"03ece060-2c70-4753-8f46-27b80508dba7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:58.109651 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:58.109608 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" Jun 08 10:23:58.240624 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:58.240512 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-r7s58"] Jun 08 10:23:58.243008 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:23:58.242980 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ece060_2c70_4753_8f46_27b80508dba7.slice/crio-4afb4686623a5a86bfba75ed826cf1b591220861fcd5fa0878ac606f147578bc WatchSource:0}: Error finding container 4afb4686623a5a86bfba75ed826cf1b591220861fcd5fa0878ac606f147578bc: Status 404 returned error can't find the container with id 4afb4686623a5a86bfba75ed826cf1b591220861fcd5fa0878ac606f147578bc Jun 08 10:23:58.587052 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:58.587014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" event={"ID":"03ece060-2c70-4753-8f46-27b80508dba7","Type":"ContainerStarted","Data":"4afb4686623a5a86bfba75ed826cf1b591220861fcd5fa0878ac606f147578bc"} Jun 08 10:23:59.931932 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:23:59.931855 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:00.596369 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:00.596338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" event={"ID":"03ece060-2c70-4753-8f46-27b80508dba7","Type":"ContainerStarted","Data":"7f40694ad3e3eb71c39ac4f0f95254ced17990ff6ff79249aadeb46818bfc3ad"} Jun 08 10:24:00.596541 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:00.596398 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" event={"ID":"03ece060-2c70-4753-8f46-27b80508dba7","Type":"ContainerStarted","Data":"a492ddc5caa69c75c9d0abd17ab18508d7b979f6a5da1e351937d1bc8f4c572f"} Jun 08 10:24:00.620538 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:00.616261 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-r7s58" podStartSLOduration=2.222466914 podStartE2EDuration="3.616242536s" totalImagesPullingTime="1.393775622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:24:00.614654686 +0000 UTC m=+270.458857070" watchObservedRunningTime="2026-06-08 10:24:00.616242536 +0000 UTC m=+270.460444912" Jun 08 10:24:02.301171 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.301136 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:02.519640 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.519600 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:02.573263 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.573179 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z6s87"] Jun 08 10:24:02.575720 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.575704 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.578363 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.578339 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 10:24:02.579045 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.578881 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sqx8z\"" Jun 08 10:24:02.579045 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.578903 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 10:24:02.579045 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.578930 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 10:24:02.600476 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.600450 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.600476 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.600482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da392e0b-5f7c-4d2d-9920-a7318871fd48-sys\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.600672 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.600520 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk9hq\" (UniqueName: \"kubernetes.io/projected/da392e0b-5f7c-4d2d-9920-a7318871fd48-kube-api-access-mk9hq\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.600672 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.600557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-accelerators-collector-config\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.600672 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.600625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-tls\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.600672 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.600656 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da392e0b-5f7c-4d2d-9920-a7318871fd48-root\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.600931 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.600677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da392e0b-5f7c-4d2d-9920-a7318871fd48-metrics-client-ca\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.600931 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.600703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-wtmp\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.600931 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.600729 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-textfile\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.637651 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.637612 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:02.701174 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.701123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9hq\" (UniqueName: \"kubernetes.io/projected/da392e0b-5f7c-4d2d-9920-a7318871fd48-kube-api-access-mk9hq\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.701392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.701213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-accelerators-collector-config\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.701392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.701303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-tls\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.701392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.701347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da392e0b-5f7c-4d2d-9920-a7318871fd48-root\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.701392 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.701370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da392e0b-5f7c-4d2d-9920-a7318871fd48-metrics-client-ca\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.701597 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.701393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-wtmp\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.701597 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.701422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-textfile\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.701597 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.701481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.701597 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.701508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da392e0b-5f7c-4d2d-9920-a7318871fd48-sys\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.701780 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.701596 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da392e0b-5f7c-4d2d-9920-a7318871fd48-sys\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.702261 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.702113 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da392e0b-5f7c-4d2d-9920-a7318871fd48-root\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.702261 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.702192 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-accelerators-collector-config\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.702420 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:24:02.702277 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 08 10:24:02.702420 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:24:02.702352 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-tls podName:da392e0b-5f7c-4d2d-9920-a7318871fd48 nodeName:}" failed. No retries permitted until 2026-06-08 10:24:03.202334547 +0000 UTC m=+273.046536902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-tls") pod "node-exporter-z6s87" (UID: "da392e0b-5f7c-4d2d-9920-a7318871fd48") : secret "node-exporter-tls" not found Jun 08 10:24:02.702420 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.702399 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da392e0b-5f7c-4d2d-9920-a7318871fd48-metrics-client-ca\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.702579 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.702435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-wtmp\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.702953 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.702928 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-textfile\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.704932 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.704913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.711388 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.711368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk9hq\" (UniqueName: \"kubernetes.io/projected/da392e0b-5f7c-4d2d-9920-a7318871fd48-kube-api-access-mk9hq\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:02.728675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.728648 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:02.828732 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.828646 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:02.887941 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.887897 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:02.962120 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:02.962081 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:03.093465 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:03.093387 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:03.206123 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:03.206088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-tls\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:03.208457 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:03.208435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da392e0b-5f7c-4d2d-9920-a7318871fd48-node-exporter-tls\") pod \"node-exporter-z6s87\" (UID: \"da392e0b-5f7c-4d2d-9920-a7318871fd48\") " pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:03.486132 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:03.486033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z6s87" Jun 08 10:24:03.497170 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:24:03.497138 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda392e0b_5f7c_4d2d_9920_a7318871fd48.slice/crio-1f21a70825d46aab05d502ece8c3ee08487ce0f1ee6ae894d311cc378d8d3cfe WatchSource:0}: Error finding container 1f21a70825d46aab05d502ece8c3ee08487ce0f1ee6ae894d311cc378d8d3cfe: Status 404 returned error can't find the container with id 1f21a70825d46aab05d502ece8c3ee08487ce0f1ee6ae894d311cc378d8d3cfe Jun 08 10:24:03.567129 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:03.567098 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:03.610195 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:03.610163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6s87" event={"ID":"da392e0b-5f7c-4d2d-9920-a7318871fd48","Type":"ContainerStarted","Data":"1f21a70825d46aab05d502ece8c3ee08487ce0f1ee6ae894d311cc378d8d3cfe"} Jun 08 10:24:03.615634 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:03.615608 2577 scope.go:117] "RemoveContainer" containerID="ed3f26c1d0329a909ad47cd96b4062d6569248a705ec6aac42b98c589ed249d0" Jun 08 10:24:03.615873 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:24:03.615852 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-ng6j8_openshift-console-operator(dd366f82-5985-4bc5-8ced-8d57fee135dd)\"" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" podUID="dd366f82-5985-4bc5-8ced-8d57fee135dd" Jun 08 10:24:03.671207 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:03.671163 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:03.867956 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:03.867922 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:04.619701 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:04.619667 2577 generic.go:356] "Generic (PLEG): container finished" podID="da392e0b-5f7c-4d2d-9920-a7318871fd48" containerID="572fedaa83a33b883de5a4684d899777d8f3a6effc0f15475f4b9bc45c983adc" exitCode=0 Jun 08 10:24:04.620995 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:04.620972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6s87" event={"ID":"da392e0b-5f7c-4d2d-9920-a7318871fd48","Type":"ContainerDied","Data":"572fedaa83a33b883de5a4684d899777d8f3a6effc0f15475f4b9bc45c983adc"} Jun 08 10:24:05.485912 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.485869 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:05.584193 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.584156 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:05.587962 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.587932 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-64d975cdc7-h9vtr"] Jun 08 10:24:05.590949 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.590930 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.593935 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.593911 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 10:24:05.594125 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.594074 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 10:24:05.594198 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.594127 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 10:24:05.594428 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.594404 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 10:24:05.594536 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.594471 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pz6nj\"" Jun 08 10:24:05.594592 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.594556 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 10:24:05.594592 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.594567 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4itcaanhfnpbc\"" Jun 08 10:24:05.607254 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.607226 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64d975cdc7-h9vtr"] Jun 08 10:24:05.625185 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.625154 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6s87" event={"ID":"da392e0b-5f7c-4d2d-9920-a7318871fd48","Type":"ContainerStarted","Data":"db7176ec11a35a106a9dae07295e8c99f5fc12f5e86221b1de4d0e8d619a2489"} Jun 08 10:24:05.625547 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.625201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6s87" event={"ID":"da392e0b-5f7c-4d2d-9920-a7318871fd48","Type":"ContainerStarted","Data":"95499c988e1e07bedcbde1105faf883aa114f5ff80a1ccfd171cb697c8f4b5f1"} Jun 08 10:24:05.625627 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.625606 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-metrics-client-ca\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.625698 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.625650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-grpc-tls\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.625750 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.625700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.625804 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.625751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.625804 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.625789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp87m\" (UniqueName: \"kubernetes.io/projected/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-kube-api-access-pp87m\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.625922 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.625859 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-tls\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.625922 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.625886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.625989 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.625971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.649381 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.649331 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z6s87" podStartSLOduration=2.648647962 podStartE2EDuration="3.649318555s" totalImagesPullingTime="932.942243ms" totalInitContainerRuntime="67.72835ms" isStatefulPod=true podCreationTimestamp="2026-06-08 10:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:24:05.648595785 +0000 UTC m=+275.492798153" watchObservedRunningTime="2026-06-08 10:24:05.649318555 +0000 UTC m=+275.493520926" Jun 08 10:24:05.662218 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.662194 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:05.726528 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.726493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.726681 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.726535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-metrics-client-ca\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.726681 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.726574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-grpc-tls\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.726681 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.726601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.726681 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.726653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.726918 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.726850 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp87m\" (UniqueName: \"kubernetes.io/projected/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-kube-api-access-pp87m\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.726968 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.726929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-tls\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.726968 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.726958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.727363 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.727338 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-metrics-client-ca\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.729385 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.729358 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.729663 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.729616 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.729791 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.729724 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.729876 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.729854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.729957 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.729940 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-thanos-querier-tls\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.730013 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.729950 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-secret-grpc-tls\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.735246 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.735228 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp87m\" (UniqueName: \"kubernetes.io/projected/81b9e5a5-0f35-4c51-bb4d-e4a043a6b423-kube-api-access-pp87m\") pod \"thanos-querier-64d975cdc7-h9vtr\" (UID: \"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423\") " pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:05.764393 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.764363 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:05.900632 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:05.900600 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:06.035860 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:06.035757 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64d975cdc7-h9vtr"] Jun 08 10:24:06.038920 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:24:06.038882 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b9e5a5_0f35_4c51_bb4d_e4a043a6b423.slice/crio-8095b5d6b1b69d7c853062ba68e1aef6a863dce78d03e1a5f7327db896320552 WatchSource:0}: Error finding container 8095b5d6b1b69d7c853062ba68e1aef6a863dce78d03e1a5f7327db896320552: Status 404 returned error can't find the container with id 8095b5d6b1b69d7c853062ba68e1aef6a863dce78d03e1a5f7327db896320552 Jun 08 10:24:06.630104 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:06.630066 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" event={"ID":"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423","Type":"ContainerStarted","Data":"8095b5d6b1b69d7c853062ba68e1aef6a863dce78d03e1a5f7327db896320552"} Jun 08 10:24:07.129123 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:07.129087 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:07.232197 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:07.232157 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:07.332237 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:07.332196 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:07.543547 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:07.543521 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:08.639786 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.639680 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" event={"ID":"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423","Type":"ContainerStarted","Data":"df753659ef6fffc382a8bf03f9b8539793fed5f70474f6cb30de1b25b0003d92"} Jun 08 10:24:08.640257 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.639782 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" event={"ID":"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423","Type":"ContainerStarted","Data":"d442c171dd8144d968b35c2b3c81552d5dbb35613b500ffb3a67f8365c44f021"} Jun 08 10:24:08.640257 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.639849 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" event={"ID":"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423","Type":"ContainerStarted","Data":"2cda1e7953f8f58950e088c643af4795ae123ce8d15d30a56b60aa34476807c7"} Jun 08 10:24:08.822405 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.822360 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:08.823445 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.823423 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 10:24:08.826470 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.826443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.829550 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.829526 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 10:24:08.830655 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.830626 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 10:24:08.830971 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.830956 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 10:24:08.831108 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.831095 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 10:24:08.831185 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.831150 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 10:24:08.833604 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.831941 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 10:24:08.833604 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.831982 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 10:24:08.833604 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.832313 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 10:24:08.833604 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.832357 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-796l7\"" Jun 08 10:24:08.833604 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.832510 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 10:24:08.833604 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.832558 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 10:24:08.833604 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.832698 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 10:24:08.833604 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.832884 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 10:24:08.833604 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.833110 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 10:24:08.833604 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.833283 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 10:24:08.834262 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.834231 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-16cp7us54k2ev\"" Jun 08 10:24:08.835380 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.835361 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 10:24:08.846042 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.846015 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 10:24:08.853247 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853359 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853359 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853359 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853558 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853558 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853558 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853466 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853558 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853558 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853798 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853567 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853798 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853602 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853798 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853798 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853798 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853798 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853798 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853798 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.853798 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-config\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.854251 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv6pz\" (UniqueName: \"kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-kube-api-access-kv6pz\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.854251 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.853845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.954740 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.954656 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.955009 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.954987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.955532 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.955513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-config\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.955700 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.955669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv6pz\" (UniqueName: \"kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-kube-api-access-kv6pz\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.955849 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.955709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.955849 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.955749 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.955849 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.955778 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.955849 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.955804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956092 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.955862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956092 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.955905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956092 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.955953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956092 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.955976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956092 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.956009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956092 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.956034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956092 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.956064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956426 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.956098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956426 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.956133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956426 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.956168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956426 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.956192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956426 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.956237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.956644 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.956560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.959857 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.957348 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.959857 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.957444 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.959857 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.957637 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.959857 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.959599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.960101 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.960004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.960101 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.960018 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.960101 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.960086 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.960361 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.960322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.960807 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.960766 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-config\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.961123 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.961097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.961343 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.961320 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.961949 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.961923 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.962439 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.962344 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.962527 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.962450 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.962713 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.962690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.962781 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.962741 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.962858 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.962796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.963679 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.963661 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:08.964483 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:08.964459 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv6pz\" (UniqueName: \"kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-kube-api-access-kv6pz\") pod \"prometheus-k8s-0\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:09.138467 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:09.138352 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:09.307414 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:09.307377 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 10:24:09.311549 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:24:09.311519 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8593b379_bb02_42b9_96a7_3973d106832a.slice/crio-e13cad4337235db049ba63d5278b4456b13ebe7794d99e60f40af9a65b15ecd5 WatchSource:0}: Error finding container e13cad4337235db049ba63d5278b4456b13ebe7794d99e60f40af9a65b15ecd5: Status 404 returned error can't find the container with id e13cad4337235db049ba63d5278b4456b13ebe7794d99e60f40af9a65b15ecd5 Jun 08 10:24:09.645369 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:09.645329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerStarted","Data":"e13cad4337235db049ba63d5278b4456b13ebe7794d99e60f40af9a65b15ecd5"} Jun 08 10:24:09.649261 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:09.648640 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" event={"ID":"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423","Type":"ContainerStarted","Data":"6fca6b6758fe7c3b191e37a3bd93023d0df1d6e9a19c77618805bdd9fbc47dc1"} Jun 08 10:24:09.649261 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:09.648717 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" event={"ID":"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423","Type":"ContainerStarted","Data":"e0380d1b839be15eb174e2204eb7b804cc9715a8548408203c9e2ee89adc5b36"} Jun 08 10:24:09.649261 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:09.648757 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" event={"ID":"81b9e5a5-0f35-4c51-bb4d-e4a043a6b423","Type":"ContainerStarted","Data":"aa06521a9d4390fcf073bec014620d3b7366825f80baed54e1503d9ca7b10b2b"} Jun 08 10:24:09.649498 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:09.649284 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:09.672493 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:09.672450 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" podStartSLOduration=1.422960867 podStartE2EDuration="4.672435257s" totalImagesPullingTime="3.24947439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:24:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:24:09.671330093 +0000 UTC m=+279.515532476" watchObservedRunningTime="2026-06-08 10:24:09.672435257 +0000 UTC m=+279.516637628" Jun 08 10:24:10.654250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:10.654154 2577 generic.go:356] "Generic (PLEG): container finished" podID="8593b379-bb02-42b9-96a7-3973d106832a" containerID="ee0ec63e5a305622f4d24dc40853f16780035aa55c93091cf0418fca74e18900" exitCode=0 Jun 08 10:24:10.654694 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:10.654238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerDied","Data":"ee0ec63e5a305622f4d24dc40853f16780035aa55c93091cf0418fca74e18900"} Jun 08 10:24:11.201237 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:24:11.201192 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x85w7" podUID="89312fba-4c4a-47f7-9d9a-2fdeebe84c7e" Jun 08 10:24:11.658641 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:11.658608 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x85w7" Jun 08 10:24:14.679284 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.679247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerStarted","Data":"bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9"} Jun 08 10:24:14.679693 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.679325 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerStarted","Data":"68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb"} Jun 08 10:24:14.679693 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.679373 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerStarted","Data":"1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202"} Jun 08 10:24:14.679693 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.679409 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerStarted","Data":"1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253"} Jun 08 10:24:14.679693 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.679441 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerStarted","Data":"d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41"} Jun 08 10:24:14.679693 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.679475 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerStarted","Data":"03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908"} Jun 08 10:24:14.681118 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.681094 2577 generic.go:356] "Generic (PLEG): container finished" podID="a8e088f1-2a79-484e-bb36-299dcd719e90" containerID="94ee3c9f328b43edb3321c3fd6798d4b3eec6145f721f20ee163392611a52f8f" exitCode=255 Jun 08 10:24:14.681233 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.681134 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" event={"ID":"a8e088f1-2a79-484e-bb36-299dcd719e90","Type":"ContainerDied","Data":"94ee3c9f328b43edb3321c3fd6798d4b3eec6145f721f20ee163392611a52f8f"} Jun 08 10:24:14.681233 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.681172 2577 scope.go:117] "RemoveContainer" containerID="f4653ebe39422993002ff945f1b8b4daa4603ef4d47e728979dc88d7fbd4051f" Jun 08 10:24:14.687650 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.687630 2577 scope.go:117] "RemoveContainer" containerID="94ee3c9f328b43edb3321c3fd6798d4b3eec6145f721f20ee163392611a52f8f" Jun 08 10:24:14.687812 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:24:14.687795 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp_open-cluster-management-agent-addon(a8e088f1-2a79-484e-bb36-299dcd719e90)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" podUID="a8e088f1-2a79-484e-bb36-299dcd719e90" Jun 08 10:24:14.712342 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.712298 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.116657661 podStartE2EDuration="6.712282152s" totalImagesPullingTime="4.57649539s" totalInitContainerRuntime="19.129101ms" isStatefulPod=false podCreationTimestamp="2026-06-08 10:24:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:24:14.710361016 +0000 UTC m=+284.554563446" watchObservedRunningTime="2026-06-08 10:24:14.712282152 +0000 UTC m=+284.556484524" Jun 08 10:24:14.911487 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.911441 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:24:14.913813 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.913788 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89312fba-4c4a-47f7-9d9a-2fdeebe84c7e-metrics-tls\") pod \"dns-default-x85w7\" (UID: \"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e\") " pod="openshift-dns/dns-default-x85w7" Jun 08 10:24:14.962349 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.962325 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-db48d\"" Jun 08 10:24:14.970394 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:14.970378 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x85w7" Jun 08 10:24:15.095319 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:15.095294 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x85w7"] Jun 08 10:24:15.097726 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:24:15.097695 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89312fba_4c4a_47f7_9d9a_2fdeebe84c7e.slice/crio-48a954281e53bf0838527075a84c9da64cc830a32c37508c8cf1abc2be12e7e8 WatchSource:0}: Error finding container 48a954281e53bf0838527075a84c9da64cc830a32c37508c8cf1abc2be12e7e8: Status 404 returned error can't find the container with id 48a954281e53bf0838527075a84c9da64cc830a32c37508c8cf1abc2be12e7e8 Jun 08 10:24:15.661015 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:15.660986 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-64d975cdc7-h9vtr" Jun 08 10:24:15.690403 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:15.690354 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x85w7" event={"ID":"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e","Type":"ContainerStarted","Data":"48a954281e53bf0838527075a84c9da64cc830a32c37508c8cf1abc2be12e7e8"} Jun 08 10:24:16.699581 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:16.698463 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x85w7" event={"ID":"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e","Type":"ContainerStarted","Data":"26456ea1eedf007ea2217d32d27472f4e74fa814d04f7a4670fc9804367ab5c2"} Jun 08 10:24:16.699581 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:16.698536 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x85w7" event={"ID":"89312fba-4c4a-47f7-9d9a-2fdeebe84c7e","Type":"ContainerStarted","Data":"24d37844459ac9c551aeb3e5e0a27c30fc35926d8250108b324b61a760436d90"} Jun 08 10:24:16.699581 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:16.699467 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x85w7" Jun 08 10:24:16.717269 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:16.717202 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x85w7" podStartSLOduration=251.344837805 podStartE2EDuration="4m12.717184067s" totalImagesPullingTime="1.372346262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:24:16.716857357 +0000 UTC m=+286.561059754" watchObservedRunningTime="2026-06-08 10:24:16.717184067 +0000 UTC m=+286.561386443" Jun 08 10:24:17.615568 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:17.615542 2577 scope.go:117] "RemoveContainer" containerID="ed3f26c1d0329a909ad47cd96b4062d6569248a705ec6aac42b98c589ed249d0" Jun 08 10:24:17.704855 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:17.704807 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/2.log" Jun 08 10:24:17.705303 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:17.704943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" event={"ID":"dd366f82-5985-4bc5-8ced-8d57fee135dd","Type":"ContainerStarted","Data":"396633362fc1a64a51a787db28767ced32fc68865e2036a0635d22c2e00945ee"} Jun 08 10:24:17.724031 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:17.723976 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" podStartSLOduration=55.304880209 podStartE2EDuration="58.723956769s" totalImagesPullingTime="3.41907656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:24:17.723593255 +0000 UTC m=+287.567795627" watchObservedRunningTime="2026-06-08 10:24:17.723956769 +0000 UTC m=+287.568159144" Jun 08 10:24:18.759450 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:18.759401 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:18.857791 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:18.857758 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:18.924364 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:18.924333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:19.031276 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:19.031187 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:19.138859 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:19.138800 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:24:19.409520 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:19.409443 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:19.462121 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:19.462091 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:19.888393 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:19.888359 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" Jun 08 10:24:19.888808 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:19.888704 2577 scope.go:117] "RemoveContainer" containerID="94ee3c9f328b43edb3321c3fd6798d4b3eec6145f721f20ee163392611a52f8f" Jun 08 10:24:19.888924 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:24:19.888903 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp_open-cluster-management-agent-addon(a8e088f1-2a79-484e-bb36-299dcd719e90)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" podUID="a8e088f1-2a79-484e-bb36-299dcd719e90" Jun 08 10:24:20.037089 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:20.037051 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:20.096598 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:20.096563 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:20.409021 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:20.408985 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:20.615360 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:20.615317 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:20.812910 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:20.812857 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:20.865997 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:20.865963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:22.260127 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:22.260091 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:22.326806 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:22.326773 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:24.637161 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:24.637126 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:24.693612 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:24.693578 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:27.706198 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:27.706150 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:24:27.709972 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:27.709949 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-ng6j8" Jun 08 10:24:27.711116 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:27.711093 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x85w7" Jun 08 10:24:30.567027 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:30.566990 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/2.log" Jun 08 10:24:30.567550 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:30.567529 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/2.log" Jun 08 10:24:30.576860 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:30.576835 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/0.log" Jun 08 10:24:30.580304 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:30.580268 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/0.log" Jun 08 10:24:30.585422 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:30.585406 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 10:24:32.621492 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:32.621468 2577 scope.go:117] "RemoveContainer" containerID="94ee3c9f328b43edb3321c3fd6798d4b3eec6145f721f20ee163392611a52f8f" Jun 08 10:24:32.636216 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:32.636187 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:32.764726 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:32.764682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc5594f8b-kx4vp" event={"ID":"a8e088f1-2a79-484e-bb36-299dcd719e90","Type":"ContainerStarted","Data":"42e8794abb47f7fd65d33098caaca1f6312fd315d9cdae0ab07cae0fe95548da"} Jun 08 10:24:33.741615 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:33.741579 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:34.656952 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:34.656918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:34.774899 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:34.774863 2577 generic.go:356] "Generic (PLEG): container finished" podID="98b14688-bfa2-4bc0-b34b-34fc039d3101" containerID="63c43c0fef133113c2065c338fc31be76b21874937e951c7f489c5cd483ad37f" exitCode=0 Jun 08 10:24:34.775271 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:34.774911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" event={"ID":"98b14688-bfa2-4bc0-b34b-34fc039d3101","Type":"ContainerDied","Data":"63c43c0fef133113c2065c338fc31be76b21874937e951c7f489c5cd483ad37f"} Jun 08 10:24:34.775271 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:34.775255 2577 scope.go:117] "RemoveContainer" containerID="63c43c0fef133113c2065c338fc31be76b21874937e951c7f489c5cd483ad37f" Jun 08 10:24:35.780711 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:35.780673 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kmb2g" event={"ID":"98b14688-bfa2-4bc0-b34b-34fc039d3101","Type":"ContainerStarted","Data":"2c28dde534ed5a24354e362fb543d7a16ed57cd0df4b42517c6cac257a85f137"} Jun 08 10:24:38.393333 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:38.393291 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:38.493518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:38.493478 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:38.552042 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:38.552004 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:39.655410 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:39.655375 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:39.742714 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:39.742686 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:40.669264 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:40.669227 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:40.734597 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:40.734560 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:41.699517 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:41.699483 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:41.766292 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:41.766260 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:47.027340 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:47.027245 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:47.116318 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:47.116279 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:47.216758 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:47.216701 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:47.834717 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:47.834675 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:47.939990 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:47.939939 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:49.651634 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:49.651530 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:49.754204 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:49.754167 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:49.811978 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:49.811949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:49.841838 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:49.841792 2577 generic.go:356] "Generic (PLEG): container finished" podID="a1bd360d-786a-4234-ba7b-676228a5b76e" containerID="b9f003b7295d5b29ca3561b32602019660897db8671f74aed747a52387d531b3" exitCode=0 Jun 08 10:24:49.841981 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:49.841850 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" event={"ID":"a1bd360d-786a-4234-ba7b-676228a5b76e","Type":"ContainerDied","Data":"b9f003b7295d5b29ca3561b32602019660897db8671f74aed747a52387d531b3"} Jun 08 10:24:49.842149 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:49.842136 2577 scope.go:117] "RemoveContainer" containerID="b9f003b7295d5b29ca3561b32602019660897db8671f74aed747a52387d531b3" Jun 08 10:24:50.847559 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:50.847521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8p47t" event={"ID":"a1bd360d-786a-4234-ba7b-676228a5b76e","Type":"ContainerStarted","Data":"a5dccc09a7122b1319d6c353dde608e4c2ade3b63161958d3285e930c71a817d"} Jun 08 10:24:54.637137 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:54.637107 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:54.732716 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:54.732678 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:54.803938 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:54.803906 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:56.022057 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:56.022023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:24:56.078979 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:24:56.078949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:09.138724 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:09.138691 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:09.157980 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:09.157951 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:09.650692 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:09.650662 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:09.704796 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:09.704765 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:09.940004 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:09.939930 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:16.986675 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:16.986641 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:17.104162 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:17.104129 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:18.635595 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:18.635502 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:18.695411 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:18.695379 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:19.003393 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:19.003313 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:19.182490 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:19.182457 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:19.242688 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:19.242660 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:19.745690 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:19.745650 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:19.846753 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:19.846724 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:24.642066 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:24.642025 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:24.742614 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:24.742577 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:25.461207 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:25.461172 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:25.515335 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:25.515302 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:27.140281 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:27.140244 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 10:25:27.141098 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:27.141049 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="config-reloader" containerID="cri-o://d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41" gracePeriod=600 Jun 08 10:25:27.141237 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:27.141090 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="thanos-sidecar" containerID="cri-o://1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253" gracePeriod=600 Jun 08 10:25:27.141237 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:27.141134 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy" containerID="cri-o://68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb" gracePeriod=600 Jun 08 10:25:27.141237 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:27.141049 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="prometheus" containerID="cri-o://03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908" gracePeriod=600 Jun 08 10:25:27.141237 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:27.141078 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy-web" containerID="cri-o://1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202" gracePeriod=600 Jun 08 10:25:27.141237 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:27.141200 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9" gracePeriod=600 Jun 08 10:25:28.003250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.003213 2577 generic.go:356] "Generic (PLEG): container finished" podID="8593b379-bb02-42b9-96a7-3973d106832a" containerID="bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9" exitCode=0 Jun 08 10:25:28.003250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.003239 2577 generic.go:356] "Generic (PLEG): container finished" podID="8593b379-bb02-42b9-96a7-3973d106832a" containerID="68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb" exitCode=0 Jun 08 10:25:28.003250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.003247 2577 generic.go:356] "Generic (PLEG): container finished" podID="8593b379-bb02-42b9-96a7-3973d106832a" containerID="1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253" exitCode=0 Jun 08 10:25:28.003250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.003254 2577 generic.go:356] "Generic (PLEG): container finished" podID="8593b379-bb02-42b9-96a7-3973d106832a" containerID="d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41" exitCode=0 Jun 08 10:25:28.003250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.003259 2577 generic.go:356] "Generic (PLEG): container finished" podID="8593b379-bb02-42b9-96a7-3973d106832a" containerID="03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908" exitCode=0 Jun 08 10:25:28.003583 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.003251 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerDied","Data":"bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9"} Jun 08 10:25:28.003583 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.003334 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerDied","Data":"68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb"} Jun 08 10:25:28.003583 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.003371 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerDied","Data":"1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253"} Jun 08 10:25:28.003583 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.003407 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerDied","Data":"d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41"} Jun 08 10:25:28.003583 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.003440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerDied","Data":"03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908"} Jun 08 10:25:28.381667 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.381644 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:28.465579 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465544 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-metrics-client-certs\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.465751 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465593 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-kube-rbac-proxy\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.465751 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465618 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-config-out\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.465751 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465634 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv6pz\" (UniqueName: \"kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-kube-api-access-kv6pz\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.465751 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465656 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-metrics-client-ca\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.465751 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465685 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-kubelet-serving-ca-bundle\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.465751 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465713 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-db\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.466081 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465786 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-trusted-ca-bundle\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.466081 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465836 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-serving-certs-ca-bundle\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.466081 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465887 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.466081 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465920 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-thanos-prometheus-http-client-file\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.466081 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465950 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-0\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.466081 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.465977 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-web-config\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.466081 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.466004 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-grpc-tls\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.466081 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.466033 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-2\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.466081 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.466062 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-1\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.467507 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.466094 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-config\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.467507 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.466123 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.467507 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.466155 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-tls-assets\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.467507 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.466181 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-tls\") pod \"8593b379-bb02-42b9-96a7-3973d106832a\" (UID: \"8593b379-bb02-42b9-96a7-3973d106832a\") " Jun 08 10:25:28.467507 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.466629 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 10:25:28.467507 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.466970 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-metrics-client-ca\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.467507 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.467226 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 10:25:28.467507 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.467337 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 10:25:28.469157 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.467856 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 10:25:28.469157 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.468094 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 10:25:28.469157 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.468189 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 10:25:28.469157 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.468341 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 10:25:28.469157 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.468575 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 10:25:28.469157 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.469015 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 10:25:28.469157 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.469087 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 10:25:28.469157 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.469096 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-config-out" (OuterVolumeSpecName: "config-out") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 10:25:28.469602 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.469487 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 10:25:28.470042 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.470011 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 10:25:28.470501 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.470467 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-kube-api-access-kv6pz" (OuterVolumeSpecName: "kube-api-access-kv6pz") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "kube-api-access-kv6pz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 10:25:28.470717 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.470691 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 10:25:28.470717 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.470705 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 10:25:28.470884 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.470733 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 10:25:28.470978 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.470962 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-config" (OuterVolumeSpecName: "config") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 10:25:28.471557 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.471531 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 10:25:28.481992 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.481965 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-web-config" (OuterVolumeSpecName: "web-config") pod "8593b379-bb02-42b9-96a7-3973d106832a" (UID: "8593b379-bb02-42b9-96a7-3973d106832a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 10:25:28.568404 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568323 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568404 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568356 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-db\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568404 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568370 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568404 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568384 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568404 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568397 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568411 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568424 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568436 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-web-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568447 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-grpc-tls\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568459 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568470 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8593b379-bb02-42b9-96a7-3973d106832a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568482 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568493 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568504 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-tls-assets\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568516 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568527 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-metrics-client-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568540 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8593b379-bb02-42b9-96a7-3973d106832a-secret-kube-rbac-proxy\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568552 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8593b379-bb02-42b9-96a7-3973d106832a-config-out\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:28.568691 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:28.568564 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv6pz\" (UniqueName: \"kubernetes.io/projected/8593b379-bb02-42b9-96a7-3973d106832a-kube-api-access-kv6pz\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:25:29.010692 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.010653 2577 generic.go:356] "Generic (PLEG): container finished" podID="8593b379-bb02-42b9-96a7-3973d106832a" containerID="1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202" exitCode=0 Jun 08 10:25:29.010884 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.010712 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerDied","Data":"1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202"} Jun 08 10:25:29.010884 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.010751 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.010884 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.010807 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8593b379-bb02-42b9-96a7-3973d106832a","Type":"ContainerDied","Data":"e13cad4337235db049ba63d5278b4456b13ebe7794d99e60f40af9a65b15ecd5"} Jun 08 10:25:29.010884 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.010850 2577 scope.go:117] "RemoveContainer" containerID="bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9" Jun 08 10:25:29.018676 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.018646 2577 scope.go:117] "RemoveContainer" containerID="68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb" Jun 08 10:25:29.025357 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.025332 2577 scope.go:117] "RemoveContainer" containerID="1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202" Jun 08 10:25:29.032616 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.032592 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 10:25:29.032936 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.032914 2577 scope.go:117] "RemoveContainer" containerID="1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253" Jun 08 10:25:29.036495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.036477 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 10:25:29.039556 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.039536 2577 scope.go:117] "RemoveContainer" containerID="d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41" Jun 08 10:25:29.046053 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.046035 2577 scope.go:117] "RemoveContainer" containerID="03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908" Jun 08 10:25:29.053171 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.053157 2577 scope.go:117] "RemoveContainer" containerID="ee0ec63e5a305622f4d24dc40853f16780035aa55c93091cf0418fca74e18900" Jun 08 10:25:29.059656 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.059627 2577 scope.go:117] "RemoveContainer" containerID="bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9" Jun 08 10:25:29.059930 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:25:29.059907 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9\": container with ID starting with bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9 not found: ID does not exist" containerID="bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9" Jun 08 10:25:29.059994 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.059938 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9"} err="failed to get container status \"bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9\": rpc error: code = NotFound desc = could not find container \"bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9\": container with ID starting with bf21c227dbf7065220ea5eb034b0397e9f6e7543a1f257b24ead75c9e93dd1f9 not found: ID does not exist" Jun 08 10:25:29.059994 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.059970 2577 scope.go:117] "RemoveContainer" containerID="68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb" Jun 08 10:25:29.060231 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:25:29.060214 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb\": container with ID starting with 68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb not found: ID does not exist" containerID="68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb" Jun 08 10:25:29.060299 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.060251 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb"} err="failed to get container status \"68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb\": rpc error: code = NotFound desc = could not find container \"68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb\": container with ID starting with 68c9d565a31aab47403f4b01438f90b8cbf4a798791c54430839346263544fbb not found: ID does not exist" Jun 08 10:25:29.060299 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.060274 2577 scope.go:117] "RemoveContainer" containerID="1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202" Jun 08 10:25:29.060512 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:25:29.060494 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202\": container with ID starting with 1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202 not found: ID does not exist" containerID="1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202" Jun 08 10:25:29.060570 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.060518 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202"} err="failed to get container status \"1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202\": rpc error: code = NotFound desc = could not find container \"1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202\": container with ID starting with 1c15c473fb3588fe596174e9a509586be2d691797347cb6d4f3d6defdd2fe202 not found: ID does not exist" Jun 08 10:25:29.060570 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.060538 2577 scope.go:117] "RemoveContainer" containerID="1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253" Jun 08 10:25:29.060744 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:25:29.060730 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253\": container with ID starting with 1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253 not found: ID does not exist" containerID="1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253" Jun 08 10:25:29.060802 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.060748 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253"} err="failed to get container status \"1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253\": rpc error: code = NotFound desc = could not find container \"1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253\": container with ID starting with 1de041e7280d726e4f9ab4a2fe2bd9d2fd783671108ad26e1949f190ce730253 not found: ID does not exist" Jun 08 10:25:29.060802 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.060765 2577 scope.go:117] "RemoveContainer" containerID="d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41" Jun 08 10:25:29.061241 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:25:29.061209 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41\": container with ID starting with d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41 not found: ID does not exist" containerID="d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41" Jun 08 10:25:29.061378 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.061245 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41"} err="failed to get container status \"d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41\": rpc error: code = NotFound desc = could not find container \"d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41\": container with ID starting with d688e3327d278b3c9947493db8d9a13162dde08e825d0fbfb0c6f826f355ee41 not found: ID does not exist" Jun 08 10:25:29.061378 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.061294 2577 scope.go:117] "RemoveContainer" containerID="03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908" Jun 08 10:25:29.061610 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:25:29.061582 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908\": container with ID starting with 03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908 not found: ID does not exist" containerID="03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908" Jun 08 10:25:29.061671 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.061610 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908"} err="failed to get container status \"03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908\": rpc error: code = NotFound desc = could not find container \"03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908\": container with ID starting with 03c0f0a2c473c1d9cfc0f3a28ff4e758e47f11b9dcd7b2ca333425217b727908 not found: ID does not exist" Jun 08 10:25:29.061671 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.061632 2577 scope.go:117] "RemoveContainer" containerID="ee0ec63e5a305622f4d24dc40853f16780035aa55c93091cf0418fca74e18900" Jun 08 10:25:29.061918 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:25:29.061896 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee0ec63e5a305622f4d24dc40853f16780035aa55c93091cf0418fca74e18900\": container with ID starting with ee0ec63e5a305622f4d24dc40853f16780035aa55c93091cf0418fca74e18900 not found: ID does not exist" containerID="ee0ec63e5a305622f4d24dc40853f16780035aa55c93091cf0418fca74e18900" Jun 08 10:25:29.061987 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.061923 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0ec63e5a305622f4d24dc40853f16780035aa55c93091cf0418fca74e18900"} err="failed to get container status \"ee0ec63e5a305622f4d24dc40853f16780035aa55c93091cf0418fca74e18900\": rpc error: code = NotFound desc = could not find container \"ee0ec63e5a305622f4d24dc40853f16780035aa55c93091cf0418fca74e18900\": container with ID starting with ee0ec63e5a305622f4d24dc40853f16780035aa55c93091cf0418fca74e18900 not found: ID does not exist" Jun 08 10:25:29.062738 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.062721 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 10:25:29.063028 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063015 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy-web" Jun 08 10:25:29.063067 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063030 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy-web" Jun 08 10:25:29.063067 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063047 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="config-reloader" Jun 08 10:25:29.063067 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063053 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="config-reloader" Jun 08 10:25:29.063067 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063060 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy" Jun 08 10:25:29.063067 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063065 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063071 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="init-config-reloader" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063076 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="init-config-reloader" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063087 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy-thanos" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063092 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy-thanos" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063101 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="prometheus" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063105 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="prometheus" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063111 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="thanos-sidecar" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063116 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="thanos-sidecar" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063163 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy-web" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063169 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="config-reloader" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063176 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="thanos-sidecar" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063181 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="prometheus" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063187 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy" Jun 08 10:25:29.063202 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.063194 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8593b379-bb02-42b9-96a7-3973d106832a" containerName="kube-rbac-proxy-thanos" Jun 08 10:25:29.068324 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.068306 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.071141 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.071120 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 10:25:29.071257 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.071236 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 10:25:29.071257 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.071248 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 10:25:29.071411 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.071236 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-796l7\"" Jun 08 10:25:29.071708 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.071564 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 10:25:29.071708 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.071571 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 10:25:29.071708 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.071607 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 10:25:29.071708 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.071625 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-16cp7us54k2ev\"" Jun 08 10:25:29.071912 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.071772 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 10:25:29.071912 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.071875 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 10:25:29.072155 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.072139 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 10:25:29.072776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.072526 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 10:25:29.072776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.072562 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 10:25:29.072776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.072648 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 10:25:29.072776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.072744 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 10:25:29.074794 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.074772 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 10:25:29.076414 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.076397 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 10:25:29.083110 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.083090 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 10:25:29.172051 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172051 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172306 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172306 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172306 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172306 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-config\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172306 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0920804-fe4d-499b-9fff-d84914ab392b-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172306 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172306 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0920804-fe4d-499b-9fff-d84914ab392b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172306 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172673 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172673 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172673 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6c67\" (UniqueName: \"kubernetes.io/projected/e0920804-fe4d-499b-9fff-d84914ab392b-kube-api-access-w6c67\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172673 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172673 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172673 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172673 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172673 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172673 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.172673 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.172632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273457 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273375 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273457 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273457 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273711 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273711 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273711 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273711 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273977 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-config\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273977 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0920804-fe4d-499b-9fff-d84914ab392b-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273977 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273977 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273878 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0920804-fe4d-499b-9fff-d84914ab392b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273977 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273977 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.273977 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.273955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.274304 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.274008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6c67\" (UniqueName: \"kubernetes.io/projected/e0920804-fe4d-499b-9fff-d84914ab392b-kube-api-access-w6c67\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.274304 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.274047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.274304 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.274073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.274304 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.274104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.274304 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.274130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.274304 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.274156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.274304 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.274194 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.274304 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.274228 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.274304 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.274247 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.275116 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.274775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.275316 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.275117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.275593 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.275569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.277330 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.276692 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.277330 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.276776 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-web-config\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.277330 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.276909 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.277330 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.277013 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.277881 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.277580 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-config\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.277881 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.277724 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.277881 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.277797 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.277881 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.277870 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e0920804-fe4d-499b-9fff-d84914ab392b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.278895 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.278870 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0920804-fe4d-499b-9fff-d84914ab392b-config-out\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.279128 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.279107 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.279265 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.279250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0920804-fe4d-499b-9fff-d84914ab392b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.279725 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.279704 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.279858 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.279840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e0920804-fe4d-499b-9fff-d84914ab392b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.285227 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.285207 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6c67\" (UniqueName: \"kubernetes.io/projected/e0920804-fe4d-499b-9fff-d84914ab392b-kube-api-access-w6c67\") pod \"prometheus-k8s-0\" (UID: \"e0920804-fe4d-499b-9fff-d84914ab392b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.377931 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.377897 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:29.516120 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.516073 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 10:25:29.518756 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:25:29.518731 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0920804_fe4d_499b_9fff_d84914ab392b.slice/crio-9521106a1233c458f4cbd6affb3a282e6804f8f53d2c7af6dba3d6be923841f0 WatchSource:0}: Error finding container 9521106a1233c458f4cbd6affb3a282e6804f8f53d2c7af6dba3d6be923841f0: Status 404 returned error can't find the container with id 9521106a1233c458f4cbd6affb3a282e6804f8f53d2c7af6dba3d6be923841f0 Jun 08 10:25:29.963448 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:29.963366 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:30.017761 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:30.017726 2577 generic.go:356] "Generic (PLEG): container finished" podID="e0920804-fe4d-499b-9fff-d84914ab392b" containerID="d8e31ed819e6d2d0ffd36175dc4636b507403b297bfd897d410e733c8c55a0d8" exitCode=0 Jun 08 10:25:30.017929 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:30.017812 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0920804-fe4d-499b-9fff-d84914ab392b","Type":"ContainerDied","Data":"d8e31ed819e6d2d0ffd36175dc4636b507403b297bfd897d410e733c8c55a0d8"} Jun 08 10:25:30.017929 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:30.017910 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0920804-fe4d-499b-9fff-d84914ab392b","Type":"ContainerStarted","Data":"9521106a1233c458f4cbd6affb3a282e6804f8f53d2c7af6dba3d6be923841f0"} Jun 08 10:25:30.074990 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:30.074958 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:30.175385 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:30.175355 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:30.620027 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:30.620000 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8593b379-bb02-42b9-96a7-3973d106832a" path="/var/lib/kubelet/pods/8593b379-bb02-42b9-96a7-3973d106832a/volumes" Jun 08 10:25:31.025009 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:31.024971 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0920804-fe4d-499b-9fff-d84914ab392b","Type":"ContainerStarted","Data":"4466e51f9bc206df8ead114eb167c2214cab8e2dd7acfe42e9170f007e9af30a"} Jun 08 10:25:31.025209 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:31.025034 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0920804-fe4d-499b-9fff-d84914ab392b","Type":"ContainerStarted","Data":"74fd2cf190be3b8a075281919f3d90122d87f25207a5c01661bf3c929a7b398b"} Jun 08 10:25:31.025209 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:31.025060 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0920804-fe4d-499b-9fff-d84914ab392b","Type":"ContainerStarted","Data":"ed83bb9cb81cc94bf71b65c011afbc46fb0e95c9407cac5f36325263d318c208"} Jun 08 10:25:31.025209 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:31.025083 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0920804-fe4d-499b-9fff-d84914ab392b","Type":"ContainerStarted","Data":"23d41251b7456552cffb7ec3962153b080b20181c0ff4f847cc38120d698c6ed"} Jun 08 10:25:31.025209 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:31.025111 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0920804-fe4d-499b-9fff-d84914ab392b","Type":"ContainerStarted","Data":"e96674a1c67c7fbed41d1cc283221d221bfe1b6d61b230ff5d7543374c0fec9f"} Jun 08 10:25:31.025209 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:31.025134 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e0920804-fe4d-499b-9fff-d84914ab392b","Type":"ContainerStarted","Data":"4774d77815085b5e4c7972d8cd28a212ede21644e019d00959283fc4e3a640e3"} Jun 08 10:25:31.055305 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:31.055241 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.04008413 podStartE2EDuration="2.055221927s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.137797ms" isStatefulPod=false podCreationTimestamp="2026-06-08 10:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:25:31.052603978 +0000 UTC m=+360.896806382" watchObservedRunningTime="2026-06-08 10:25:31.055221927 +0000 UTC m=+360.899424290" Jun 08 10:25:34.378341 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:34.378304 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:25:39.650111 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:39.650077 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:25:39.746576 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:25:39.746543 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:26:24.205228 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:26:24.205175 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:26:24.258364 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:26:24.258326 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:26:29.378281 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:26:29.378236 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:26:29.393539 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:26:29.393509 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:26:30.271157 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:26:30.271130 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 10:26:31.824868 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:26:31.824834 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:26:31.924295 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:26:31.924263 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:26:49.684173 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:26:49.684090 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:26:51.210926 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:26:51.210884 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:04.188055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:04.188020 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:04.373787 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:04.373748 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:06.565662 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:06.565624 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:08.004754 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:08.004721 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:08.071049 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:08.071018 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:09.129797 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:09.129758 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:09.230346 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:09.230311 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:12.426371 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:12.426342 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:12.604501 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:12.604462 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:12.657222 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:12.657187 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:13.094744 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:13.094711 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:21.027647 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:21.027606 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:26.412914 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:26.412883 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:26.506445 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:26.506414 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:36.791271 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:36.791232 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:36.892987 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:36.892953 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:39.307259 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:39.307221 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:39.361580 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:39.361551 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:40.449277 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:40.449244 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:40.511272 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:40.511239 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:47.160511 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:47.160477 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:49.163200 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:49.163166 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:49.764516 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:49.764482 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:51.363261 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:51.363222 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:27:51.464225 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:27:51.464192 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:28:08.620877 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:08.620845 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:28:08.716164 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:08.716126 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:28:11.528168 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.528131 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm"] Jun 08 10:28:11.531479 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.531453 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:11.533344 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.533318 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:28:11.534109 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.534085 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 08 10:28:11.534109 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.534103 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 10:28:11.535276 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.535245 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 08 10:28:11.535429 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.535285 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-fgrqb\"" Jun 08 10:28:11.535429 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.535288 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 10:28:11.538055 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.538031 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm"] Jun 08 10:28:11.621250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.621218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee182228-31dc-408b-af66-5bd79be8543e-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-478hm\" (UID: \"ee182228-31dc-408b-af66-5bd79be8543e\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:11.621250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.621255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6qxq\" (UniqueName: \"kubernetes.io/projected/ee182228-31dc-408b-af66-5bd79be8543e-kube-api-access-c6qxq\") pod \"kubeflow-trainer-controller-manager-857f77d56c-478hm\" (UID: \"ee182228-31dc-408b-af66-5bd79be8543e\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:11.621478 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.621353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/ee182228-31dc-408b-af66-5bd79be8543e-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-478hm\" (UID: \"ee182228-31dc-408b-af66-5bd79be8543e\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:11.721940 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.721900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6qxq\" (UniqueName: \"kubernetes.io/projected/ee182228-31dc-408b-af66-5bd79be8543e-kube-api-access-c6qxq\") pod \"kubeflow-trainer-controller-manager-857f77d56c-478hm\" (UID: \"ee182228-31dc-408b-af66-5bd79be8543e\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:11.722124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.721974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/ee182228-31dc-408b-af66-5bd79be8543e-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-478hm\" (UID: \"ee182228-31dc-408b-af66-5bd79be8543e\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:11.722124 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.722014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee182228-31dc-408b-af66-5bd79be8543e-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-478hm\" (UID: \"ee182228-31dc-408b-af66-5bd79be8543e\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:11.722608 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.722579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/ee182228-31dc-408b-af66-5bd79be8543e-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-478hm\" (UID: \"ee182228-31dc-408b-af66-5bd79be8543e\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:11.724461 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.724439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee182228-31dc-408b-af66-5bd79be8543e-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-478hm\" (UID: \"ee182228-31dc-408b-af66-5bd79be8543e\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:11.731884 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.731860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6qxq\" (UniqueName: \"kubernetes.io/projected/ee182228-31dc-408b-af66-5bd79be8543e-kube-api-access-c6qxq\") pod \"kubeflow-trainer-controller-manager-857f77d56c-478hm\" (UID: \"ee182228-31dc-408b-af66-5bd79be8543e\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:11.761275 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.761246 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:28:11.842185 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.842109 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:11.976572 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.976538 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm"] Jun 08 10:28:11.979059 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:28:11.979025 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee182228_31dc_408b_af66_5bd79be8543e.slice/crio-5e20fe00db1aac10bd568a5d3ed832dadf2c1554d3476002fad48627067f5781 WatchSource:0}: Error finding container 5e20fe00db1aac10bd568a5d3ed832dadf2c1554d3476002fad48627067f5781: Status 404 returned error can't find the container with id 5e20fe00db1aac10bd568a5d3ed832dadf2c1554d3476002fad48627067f5781 Jun 08 10:28:11.980882 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:11.980857 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 10:28:12.649974 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:12.649930 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" event={"ID":"ee182228-31dc-408b-af66-5bd79be8543e","Type":"ContainerStarted","Data":"5e20fe00db1aac10bd568a5d3ed832dadf2c1554d3476002fad48627067f5781"} Jun 08 10:28:14.661083 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:14.661005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" event={"ID":"ee182228-31dc-408b-af66-5bd79be8543e","Type":"ContainerStarted","Data":"0029ca35bb271b9041a10d394a76b446fc37e177ef1ca3ec69c0cd0ba9ad9825"} Jun 08 10:28:14.661416 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:14.661125 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:14.678194 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:14.678150 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" podStartSLOduration=1.250671712 podStartE2EDuration="3.678135124s" totalImagesPullingTime="2.427463412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:28:14.677085958 +0000 UTC m=+524.521288340" watchObservedRunningTime="2026-06-08 10:28:14.678135124 +0000 UTC m=+524.522337495" Jun 08 10:28:15.383300 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:15.383254 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:28:21.753771 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:21.753682 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:28:30.670541 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:30.670508 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-478hm" Jun 08 10:28:59.102247 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:59.102202 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:28:59.159906 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:28:59.159875 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:29:00.953043 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:29:00.953006 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:29:29.864429 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:29:29.864391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:29:29.916393 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:29:29.916338 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:29:30.602262 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:29:30.602228 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/2.log" Jun 08 10:29:30.602643 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:29:30.602622 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/2.log" Jun 08 10:29:30.606970 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:29:30.606951 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/0.log" Jun 08 10:29:30.607074 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:29:30.607032 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/0.log" Jun 08 10:29:40.886156 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:29:40.886116 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:29:42.036804 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:29:42.036778 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:30:05.623296 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.623257 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:30:05.720188 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.720155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:30:05.724245 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.724221 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72"] Jun 08 10:30:05.727699 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.727682 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" Jun 08 10:30:05.733835 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.730610 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-29fj4\"/\"openshift-service-ca.crt\"" Jun 08 10:30:05.733835 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.731080 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-29fj4\"/\"kube-root-ca.crt\"" Jun 08 10:30:05.733835 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.731096 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-29fj4\"/\"default-dockercfg-bdsww\"" Jun 08 10:30:05.739144 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.739119 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72"] Jun 08 10:30:05.768065 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.768036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wplx6\" (UniqueName: \"kubernetes.io/projected/b5c80715-5280-4e79-bdc3-93c213b260e1-kube-api-access-wplx6\") pod \"test-trainjob-rvbb7-node-0-0-k8c72\" (UID: \"b5c80715-5280-4e79-bdc3-93c213b260e1\") " pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" Jun 08 10:30:05.780576 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.780532 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:30:05.869054 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.869014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wplx6\" (UniqueName: \"kubernetes.io/projected/b5c80715-5280-4e79-bdc3-93c213b260e1-kube-api-access-wplx6\") pod \"test-trainjob-rvbb7-node-0-0-k8c72\" (UID: \"b5c80715-5280-4e79-bdc3-93c213b260e1\") " pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" Jun 08 10:30:05.878416 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:05.878356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wplx6\" (UniqueName: \"kubernetes.io/projected/b5c80715-5280-4e79-bdc3-93c213b260e1-kube-api-access-wplx6\") pod \"test-trainjob-rvbb7-node-0-0-k8c72\" (UID: \"b5c80715-5280-4e79-bdc3-93c213b260e1\") " pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" Jun 08 10:30:06.043343 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:06.043304 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" Jun 08 10:30:06.176980 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:06.176898 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72"] Jun 08 10:30:06.180492 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:30:06.180462 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5c80715_5280_4e79_bdc3_93c213b260e1.slice/crio-f2e6aae4a86edc37b4509898d093ce634343f4d41c24f6bc9686c4e682778779 WatchSource:0}: Error finding container f2e6aae4a86edc37b4509898d093ce634343f4d41c24f6bc9686c4e682778779: Status 404 returned error can't find the container with id f2e6aae4a86edc37b4509898d093ce634343f4d41c24f6bc9686c4e682778779 Jun 08 10:30:07.113053 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:30:07.112951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" event={"ID":"b5c80715-5280-4e79-bdc3-93c213b260e1","Type":"ContainerStarted","Data":"f2e6aae4a86edc37b4509898d093ce634343f4d41c24f6bc9686c4e682778779"} Jun 08 10:33:17.826771 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:33:17.826725 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:34:04.441495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:04.441451 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:34:04.502915 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:04.502882 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:34:29.336568 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:29.336525 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" event={"ID":"b5c80715-5280-4e79-bdc3-93c213b260e1","Type":"ContainerStarted","Data":"d13fc34b4d9e339c75c4851f042b623e706ae25a2f4351f57207892cf5f0f09b"} Jun 08 10:34:29.364589 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:29.364539 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" podStartSLOduration=2.098717518 podStartE2EDuration="4m24.364522587s" totalImagesPullingTime="4m22.265805069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:34:29.363607326 +0000 UTC m=+899.207809696" watchObservedRunningTime="2026-06-08 10:34:29.364522587 +0000 UTC m=+899.208724957" Jun 08 10:34:29.585687 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:29.585660 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-29fj4_test-trainjob-rvbb7-node-0-0-k8c72_b5c80715-5280-4e79-bdc3-93c213b260e1/node/0.log" Jun 08 10:34:30.640968 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:30.640937 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/2.log" Jun 08 10:34:30.641390 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:30.640945 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/2.log" Jun 08 10:34:30.646925 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:30.646901 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/0.log" Jun 08 10:34:30.646925 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:30.646912 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/0.log" Jun 08 10:34:32.585333 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:32.585306 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-29fj4_test-trainjob-rvbb7-node-0-0-k8c72_b5c80715-5280-4e79-bdc3-93c213b260e1/node/0.log" Jun 08 10:34:35.361875 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:35.361837 2577 generic.go:356] "Generic (PLEG): container finished" podID="b5c80715-5280-4e79-bdc3-93c213b260e1" containerID="d13fc34b4d9e339c75c4851f042b623e706ae25a2f4351f57207892cf5f0f09b" exitCode=0 Jun 08 10:34:35.362276 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:35.361907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" event={"ID":"b5c80715-5280-4e79-bdc3-93c213b260e1","Type":"ContainerDied","Data":"d13fc34b4d9e339c75c4851f042b623e706ae25a2f4351f57207892cf5f0f09b"} Jun 08 10:34:35.584999 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:35.584975 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-29fj4_test-trainjob-rvbb7-node-0-0-k8c72_b5c80715-5280-4e79-bdc3-93c213b260e1/node/0.log" Jun 08 10:34:36.506807 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:36.506782 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" Jun 08 10:34:36.633664 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:36.633588 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wplx6\" (UniqueName: \"kubernetes.io/projected/b5c80715-5280-4e79-bdc3-93c213b260e1-kube-api-access-wplx6\") pod \"b5c80715-5280-4e79-bdc3-93c213b260e1\" (UID: \"b5c80715-5280-4e79-bdc3-93c213b260e1\") " Jun 08 10:34:36.635751 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:36.635728 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5c80715-5280-4e79-bdc3-93c213b260e1-kube-api-access-wplx6" (OuterVolumeSpecName: "kube-api-access-wplx6") pod "b5c80715-5280-4e79-bdc3-93c213b260e1" (UID: "b5c80715-5280-4e79-bdc3-93c213b260e1"). InnerVolumeSpecName "kube-api-access-wplx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 10:34:36.734535 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:36.734497 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wplx6\" (UniqueName: \"kubernetes.io/projected/b5c80715-5280-4e79-bdc3-93c213b260e1-kube-api-access-wplx6\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:34:37.371046 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:37.371014 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" Jun 08 10:34:37.371279 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:37.371050 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72" event={"ID":"b5c80715-5280-4e79-bdc3-93c213b260e1","Type":"ContainerDied","Data":"f2e6aae4a86edc37b4509898d093ce634343f4d41c24f6bc9686c4e682778779"} Jun 08 10:34:37.371279 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:37.371087 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2e6aae4a86edc37b4509898d093ce634343f4d41c24f6bc9686c4e682778779" Jun 08 10:34:37.911416 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:37.911385 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-29fj4_test-trainjob-rvbb7-node-0-0-k8c72_b5c80715-5280-4e79-bdc3-93c213b260e1/node/0.log" Jun 08 10:34:38.009050 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:38.009017 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:34:39.001020 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.000985 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fw4v5/must-gather-s7r8t"] Jun 08 10:34:39.001376 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.001289 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c80715-5280-4e79-bdc3-93c213b260e1" containerName="node" Jun 08 10:34:39.001376 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.001299 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c80715-5280-4e79-bdc3-93c213b260e1" containerName="node" Jun 08 10:34:39.001376 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.001374 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c80715-5280-4e79-bdc3-93c213b260e1" containerName="node" Jun 08 10:34:39.012778 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.012740 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:34:39.027994 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.027966 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fw4v5/must-gather-s7r8t"] Jun 08 10:34:39.028142 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.028072 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:34:39.030652 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.030632 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fw4v5\"/\"openshift-service-ca.crt\"" Jun 08 10:34:39.030803 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.030680 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fw4v5\"/\"kube-root-ca.crt\"" Jun 08 10:34:39.031889 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.031866 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fw4v5\"/\"default-dockercfg-zbxh8\"" Jun 08 10:34:39.070142 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.070115 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:34:39.154712 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.154678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a66f3f0d-6828-473c-8f90-7919d196c43a-must-gather-output\") pod \"must-gather-s7r8t\" (UID: \"a66f3f0d-6828-473c-8f90-7919d196c43a\") " pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:34:39.154885 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.154721 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvc97\" (UniqueName: \"kubernetes.io/projected/a66f3f0d-6828-473c-8f90-7919d196c43a-kube-api-access-gvc97\") pod \"must-gather-s7r8t\" (UID: \"a66f3f0d-6828-473c-8f90-7919d196c43a\") " pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:34:39.256134 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.256102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a66f3f0d-6828-473c-8f90-7919d196c43a-must-gather-output\") pod \"must-gather-s7r8t\" (UID: \"a66f3f0d-6828-473c-8f90-7919d196c43a\") " pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:34:39.256258 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.256152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvc97\" (UniqueName: \"kubernetes.io/projected/a66f3f0d-6828-473c-8f90-7919d196c43a-kube-api-access-gvc97\") pod \"must-gather-s7r8t\" (UID: \"a66f3f0d-6828-473c-8f90-7919d196c43a\") " pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:34:39.256495 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.256475 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a66f3f0d-6828-473c-8f90-7919d196c43a-must-gather-output\") pod \"must-gather-s7r8t\" (UID: \"a66f3f0d-6828-473c-8f90-7919d196c43a\") " pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:34:39.264953 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.264925 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvc97\" (UniqueName: \"kubernetes.io/projected/a66f3f0d-6828-473c-8f90-7919d196c43a-kube-api-access-gvc97\") pod \"must-gather-s7r8t\" (UID: \"a66f3f0d-6828-473c-8f90-7919d196c43a\") " pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:34:39.336503 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.336466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:34:39.483442 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.480699 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fw4v5/must-gather-s7r8t"] Jun 08 10:34:39.487452 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:34:39.487423 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda66f3f0d_6828_473c_8f90_7919d196c43a.slice/crio-d46d8a8058bd3d4c7dd737a8295ae098a0836db73935dfc415c1aaa4607c48e4 WatchSource:0}: Error finding container d46d8a8058bd3d4c7dd737a8295ae098a0836db73935dfc415c1aaa4607c48e4: Status 404 returned error can't find the container with id d46d8a8058bd3d4c7dd737a8295ae098a0836db73935dfc415c1aaa4607c48e4 Jun 08 10:34:39.489542 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:39.489520 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 10:34:40.387374 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:40.387334 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" event={"ID":"a66f3f0d-6828-473c-8f90-7919d196c43a","Type":"ContainerStarted","Data":"d46d8a8058bd3d4c7dd737a8295ae098a0836db73935dfc415c1aaa4607c48e4"} Jun 08 10:34:42.944515 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:42.944479 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72"] Jun 08 10:34:42.953069 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:42.948010 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-29fj4/test-trainjob-rvbb7-node-0-0-k8c72"] Jun 08 10:34:43.322242 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:43.322211 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:34:44.300114 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:44.300073 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:34:44.623179 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:44.623093 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5c80715-5280-4e79-bdc3-93c213b260e1" path="/var/lib/kubelet/pods/b5c80715-5280-4e79-bdc3-93c213b260e1/volumes" Jun 08 10:34:46.418944 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:46.418907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" event={"ID":"a66f3f0d-6828-473c-8f90-7919d196c43a","Type":"ContainerStarted","Data":"8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5"} Jun 08 10:34:47.426503 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:47.426468 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" event={"ID":"a66f3f0d-6828-473c-8f90-7919d196c43a","Type":"ContainerStarted","Data":"5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef"} Jun 08 10:34:47.443694 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:47.443631 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" podStartSLOduration=2.715214204 podStartE2EDuration="9.443614462s" totalImagesPullingTime="6.728400258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 10:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:34:47.441743362 +0000 UTC m=+917.285945734" watchObservedRunningTime="2026-06-08 10:34:47.443614462 +0000 UTC m=+917.287816833" Jun 08 10:34:56.777707 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:56.777671 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-478hm_ee182228-31dc-408b-af66-5bd79be8543e/manager/0.log" Jun 08 10:34:57.320488 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:57.320460 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-478hm_ee182228-31dc-408b-af66-5bd79be8543e/manager/0.log" Jun 08 10:34:57.797915 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:34:57.797886 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-478hm_ee182228-31dc-408b-af66-5bd79be8543e/manager/0.log" Jun 08 10:35:07.656559 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:07.656520 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:35:35.652628 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:35.652592 2577 generic.go:356] "Generic (PLEG): container finished" podID="a66f3f0d-6828-473c-8f90-7919d196c43a" containerID="8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5" exitCode=0 Jun 08 10:35:35.653057 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:35.652668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" event={"ID":"a66f3f0d-6828-473c-8f90-7919d196c43a","Type":"ContainerDied","Data":"8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5"} Jun 08 10:35:35.653057 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:35.653048 2577 scope.go:117] "RemoveContainer" containerID="8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5" Jun 08 10:35:36.532835 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:36.532790 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fw4v5_must-gather-s7r8t_a66f3f0d-6828-473c-8f90-7919d196c43a/gather/0.log" Jun 08 10:35:36.905517 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:36.905439 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:35:37.055154 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:37.055119 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:35:37.111292 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:37.111254 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:35:37.212597 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:37.212510 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:35:37.268020 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:37.267989 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:35:39.790702 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:39.790669 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lcwbh_d314f158-a213-4ad2-b9a8-66df7dee61f6/global-pull-secret-syncer/0.log" Jun 08 10:35:39.873635 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:39.873608 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" Jun 08 10:35:39.938213 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:39.938181 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-117.ec2.internal_9c31271bbde5f4411a9e783b19068f04/haproxy/0.log" Jun 08 10:35:41.883164 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:41.883127 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-fw4v5/must-gather-s7r8t"] Jun 08 10:35:41.883590 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:41.883303 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" podUID="a66f3f0d-6828-473c-8f90-7919d196c43a" containerName="copy" containerID="cri-o://5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef" gracePeriod=2 Jun 08 10:35:41.885765 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:35:41.885730 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s7r8t\" is forbidden: User \"system:node:ip-10-0-132-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fw4v5\": no relationship found between node 'ip-10-0-132-117.ec2.internal' and this object" podUID="a66f3f0d-6828-473c-8f90-7919d196c43a" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:35:41.886597 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:41.886573 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-fw4v5/must-gather-s7r8t"] Jun 08 10:35:42.121153 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.121129 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fw4v5_must-gather-s7r8t_a66f3f0d-6828-473c-8f90-7919d196c43a/copy/0.log" Jun 08 10:35:42.122945 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.122928 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:35:42.125304 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:35:42.125277 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s7r8t\" is forbidden: User \"system:node:ip-10-0-132-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fw4v5\": no relationship found between node 'ip-10-0-132-117.ec2.internal' and this object" podUID="a66f3f0d-6828-473c-8f90-7919d196c43a" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:35:42.207880 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.207794 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvc97\" (UniqueName: \"kubernetes.io/projected/a66f3f0d-6828-473c-8f90-7919d196c43a-kube-api-access-gvc97\") pod \"a66f3f0d-6828-473c-8f90-7919d196c43a\" (UID: \"a66f3f0d-6828-473c-8f90-7919d196c43a\") " Jun 08 10:35:42.208022 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.207905 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a66f3f0d-6828-473c-8f90-7919d196c43a-must-gather-output\") pod \"a66f3f0d-6828-473c-8f90-7919d196c43a\" (UID: \"a66f3f0d-6828-473c-8f90-7919d196c43a\") " Jun 08 10:35:42.209430 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.209400 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a66f3f0d-6828-473c-8f90-7919d196c43a-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "a66f3f0d-6828-473c-8f90-7919d196c43a" (UID: "a66f3f0d-6828-473c-8f90-7919d196c43a"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 10:35:42.210085 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.210057 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a66f3f0d-6828-473c-8f90-7919d196c43a-kube-api-access-gvc97" (OuterVolumeSpecName: "kube-api-access-gvc97") pod "a66f3f0d-6828-473c-8f90-7919d196c43a" (UID: "a66f3f0d-6828-473c-8f90-7919d196c43a"). InnerVolumeSpecName "kube-api-access-gvc97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 10:35:42.309194 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.309147 2577 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a66f3f0d-6828-473c-8f90-7919d196c43a-must-gather-output\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:35:42.309194 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.309190 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvc97\" (UniqueName: \"kubernetes.io/projected/a66f3f0d-6828-473c-8f90-7919d196c43a-kube-api-access-gvc97\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 08 10:35:42.449571 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.449541 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:35:42.508486 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.508451 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dm92z_d221238c-1f7d-4b43-9e5b-30a88c8f9685/konnectivity-agent/0.log" limit=1024 Jun 08 10:35:42.619870 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.619834 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a66f3f0d-6828-473c-8f90-7919d196c43a" path="/var/lib/kubelet/pods/a66f3f0d-6828-473c-8f90-7919d196c43a/volumes" Jun 08 10:35:42.681864 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.681838 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fw4v5_must-gather-s7r8t_a66f3f0d-6828-473c-8f90-7919d196c43a/copy/0.log" Jun 08 10:35:42.682194 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.682169 2577 generic.go:356] "Generic (PLEG): container finished" podID="a66f3f0d-6828-473c-8f90-7919d196c43a" containerID="5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef" exitCode=143 Jun 08 10:35:42.682244 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.682210 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fw4v5/must-gather-s7r8t" Jun 08 10:35:42.682244 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.682238 2577 scope.go:117] "RemoveContainer" containerID="5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef" Jun 08 10:35:42.690025 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.689976 2577 scope.go:117] "RemoveContainer" containerID="8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5" Jun 08 10:35:42.701793 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.701769 2577 scope.go:117] "RemoveContainer" containerID="5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef" Jun 08 10:35:42.702107 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:35:42.702086 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef\": container with ID starting with 5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef not found: ID does not exist" containerID="5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef" Jun 08 10:35:42.702191 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.702116 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef"} err="failed to get container status \"5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef\": rpc error: code = NotFound desc = could not find container \"5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef\": container with ID starting with 5536fc4f75c141a589a3622cab6df0ca78ce14f57e44043e7b23643a2f88c9ef not found: ID does not exist" Jun 08 10:35:42.702191 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.702145 2577 scope.go:117] "RemoveContainer" containerID="8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5" Jun 08 10:35:42.702434 ip-10-0-132-117 kubenswrapper[2577]: E0608 10:35:42.702413 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5\": container with ID starting with 8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5 not found: ID does not exist" containerID="8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5" Jun 08 10:35:42.702516 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:42.702445 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5"} err="failed to get container status \"8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5\": rpc error: code = NotFound desc = could not find container \"8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5\": container with ID starting with 8784237bfbd4e212370558262f4d9c8fbb3bae6b56065337ecb360ff2ef6c0a5 not found: ID does not exist" Jun 08 10:35:43.114006 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.113976 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-ssxcf_56d14d77-f8d9-44ad-9f62-4795dfb32a79/cluster-monitoring-operator/0.log" Jun 08 10:35:43.487705 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.487626 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z6s87_da392e0b-5f7c-4d2d-9920-a7318871fd48/node-exporter/0.log" Jun 08 10:35:43.512673 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.512640 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z6s87_da392e0b-5f7c-4d2d-9920-a7318871fd48/kube-rbac-proxy/0.log" Jun 08 10:35:43.539943 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.539916 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z6s87_da392e0b-5f7c-4d2d-9920-a7318871fd48/init-textfile/0.log" Jun 08 10:35:43.676103 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.676074 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0920804-fe4d-499b-9fff-d84914ab392b/prometheus/0.log" Jun 08 10:35:43.702493 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.702467 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0920804-fe4d-499b-9fff-d84914ab392b/config-reloader/0.log" Jun 08 10:35:43.726250 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.726227 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0920804-fe4d-499b-9fff-d84914ab392b/thanos-sidecar/0.log" Jun 08 10:35:43.743197 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.743141 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0920804-fe4d-499b-9fff-d84914ab392b/kube-rbac-proxy-web/0.log" Jun 08 10:35:43.764417 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.764394 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0920804-fe4d-499b-9fff-d84914ab392b/kube-rbac-proxy/0.log" Jun 08 10:35:43.780749 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.780730 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0920804-fe4d-499b-9fff-d84914ab392b/kube-rbac-proxy-thanos/0.log" Jun 08 10:35:43.799605 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.799588 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e0920804-fe4d-499b-9fff-d84914ab392b/init-config-reloader/0.log" Jun 08 10:35:43.824016 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.823991 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-r7s58_03ece060-2c70-4753-8f46-27b80508dba7/prometheus-operator/0.log" Jun 08 10:35:43.839639 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.839617 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-r7s58_03ece060-2c70-4753-8f46-27b80508dba7/kube-rbac-proxy/0.log" Jun 08 10:35:43.966278 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.966252 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d975cdc7-h9vtr_81b9e5a5-0f35-4c51-bb4d-e4a043a6b423/thanos-query/0.log" Jun 08 10:35:43.984046 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:43.984025 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d975cdc7-h9vtr_81b9e5a5-0f35-4c51-bb4d-e4a043a6b423/kube-rbac-proxy-web/0.log" Jun 08 10:35:44.003484 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:44.003416 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d975cdc7-h9vtr_81b9e5a5-0f35-4c51-bb4d-e4a043a6b423/kube-rbac-proxy/0.log" Jun 08 10:35:44.019796 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:44.019770 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d975cdc7-h9vtr_81b9e5a5-0f35-4c51-bb4d-e4a043a6b423/prom-label-proxy/0.log" Jun 08 10:35:44.039191 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:44.039172 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d975cdc7-h9vtr_81b9e5a5-0f35-4c51-bb4d-e4a043a6b423/kube-rbac-proxy-rules/0.log" Jun 08 10:35:44.055224 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:44.055203 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64d975cdc7-h9vtr_81b9e5a5-0f35-4c51-bb4d-e4a043a6b423/kube-rbac-proxy-metrics/0.log" Jun 08 10:35:45.311030 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:45.311002 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-bhwv5_2adfe24a-68bc-4473-a12c-0745ee473120/networking-console-plugin/0.log" Jun 08 10:35:45.883514 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:45.883484 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/2.log" Jun 08 10:35:45.887241 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:45.887222 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-ng6j8_dd366f82-5985-4bc5-8ced-8d57fee135dd/console-operator/3.log" Jun 08 10:35:46.840288 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:46.840258 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-w9smj_5b6aca61-7130-486b-b4c5-ddaf4b58e459/volume-data-source-validator/0.log" Jun 08 10:35:47.450951 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.450910 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd"] Jun 08 10:35:47.451310 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.451292 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66f3f0d-6828-473c-8f90-7919d196c43a" containerName="gather" Jun 08 10:35:47.451394 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.451313 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66f3f0d-6828-473c-8f90-7919d196c43a" containerName="gather" Jun 08 10:35:47.451394 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.451337 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66f3f0d-6828-473c-8f90-7919d196c43a" containerName="copy" Jun 08 10:35:47.451394 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.451346 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66f3f0d-6828-473c-8f90-7919d196c43a" containerName="copy" Jun 08 10:35:47.451545 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.451424 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66f3f0d-6828-473c-8f90-7919d196c43a" containerName="copy" Jun 08 10:35:47.451545 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.451438 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66f3f0d-6828-473c-8f90-7919d196c43a" containerName="gather" Jun 08 10:35:47.455176 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.455154 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.457992 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.457970 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9p7tn\"/\"kube-root-ca.crt\"" Jun 08 10:35:47.459166 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.459149 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9p7tn\"/\"default-dockercfg-c5l8r\"" Jun 08 10:35:47.459166 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.459156 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9p7tn\"/\"openshift-service-ca.crt\"" Jun 08 10:35:47.468023 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.468000 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd"] Jun 08 10:35:47.557585 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.557532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-lib-modules\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.557776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.557595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-proc\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.557776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.557625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkbsz\" (UniqueName: \"kubernetes.io/projected/7ae93047-10bb-449d-8739-c735e2321064-kube-api-access-lkbsz\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.557776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.557661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-sys\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.557776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.557734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-podres\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.658280 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.658229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-lib-modules\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.658280 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.658290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-proc\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.658518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.658317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkbsz\" (UniqueName: \"kubernetes.io/projected/7ae93047-10bb-449d-8739-c735e2321064-kube-api-access-lkbsz\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.658518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.658352 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-sys\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.658518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.658413 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-lib-modules\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.658518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.658426 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-proc\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.658518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.658436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-podres\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.658518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.658422 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-sys\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.658518 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.658502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ae93047-10bb-449d-8739-c735e2321064-podres\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.666565 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.666542 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkbsz\" (UniqueName: \"kubernetes.io/projected/7ae93047-10bb-449d-8739-c735e2321064-kube-api-access-lkbsz\") pod \"perf-node-gather-daemonset-mt5pd\" (UID: \"7ae93047-10bb-449d-8739-c735e2321064\") " pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.730411 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.730335 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x85w7_89312fba-4c4a-47f7-9d9a-2fdeebe84c7e/dns/0.log" Jun 08 10:35:47.746235 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.746207 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x85w7_89312fba-4c4a-47f7-9d9a-2fdeebe84c7e/kube-rbac-proxy/0.log" Jun 08 10:35:47.765226 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.765203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:47.810893 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.810861 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r52bt_42ab1983-d354-4c86-813c-cdc7b031523d/dns-node-resolver/0.log" Jun 08 10:35:47.893861 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:47.893830 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd"] Jun 08 10:35:47.896141 ip-10-0-132-117 kubenswrapper[2577]: W0608 10:35:47.896111 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ae93047_10bb_449d_8739_c735e2321064.slice/crio-df7ea0592e9d44961dadbd8dde8808ff5e574375ca9d8e2f048d508c56b519df WatchSource:0}: Error finding container df7ea0592e9d44961dadbd8dde8808ff5e574375ca9d8e2f048d508c56b519df: Status 404 returned error can't find the container with id df7ea0592e9d44961dadbd8dde8808ff5e574375ca9d8e2f048d508c56b519df Jun 08 10:35:48.246092 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:48.246022 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g4ksc_439e2bac-1174-41b6-9418-9091f93effba/node-ca/0.log" Jun 08 10:35:48.708489 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:48.708457 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" event={"ID":"7ae93047-10bb-449d-8739-c735e2321064","Type":"ContainerStarted","Data":"f0564ab25a3f7f876a5f4624b4fb41b27c59530b1ff7f59316fcf05593126063"} Jun 08 10:35:48.708653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:48.708503 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" event={"ID":"7ae93047-10bb-449d-8739-c735e2321064","Type":"ContainerStarted","Data":"df7ea0592e9d44961dadbd8dde8808ff5e574375ca9d8e2f048d508c56b519df"} Jun 08 10:35:48.708653 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:48.708585 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:48.731402 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:48.731355 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" podStartSLOduration=1.7313402230000001 podStartE2EDuration="1.731340223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 10:35:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 10:35:48.730460116 +0000 UTC m=+978.574662488" watchObservedRunningTime="2026-06-08 10:35:48.731340223 +0000 UTC m=+978.575542649" Jun 08 10:35:49.243969 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:49.243941 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8cwp2_4722055d-0c45-410e-82c8-6d87030a7019/serve-healthcheck-canary/0.log" Jun 08 10:35:49.710995 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:49.710965 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9mz9_98116eed-5bcc-40ca-ad77-f0566108abd6/kube-rbac-proxy/0.log" Jun 08 10:35:49.726813 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:49.726788 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9mz9_98116eed-5bcc-40ca-ad77-f0566108abd6/exporter/0.log" Jun 08 10:35:49.744123 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:49.744106 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9mz9_98116eed-5bcc-40ca-ad77-f0566108abd6/extractor/0.log" Jun 08 10:35:54.097238 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:54.097204 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-78h6s_cf3d5c6d-7cc0-48e0-978b-87b2aaf2288e/migrator/0.log" Jun 08 10:35:54.114733 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:54.114697 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-78h6s_cf3d5c6d-7cc0-48e0-978b-87b2aaf2288e/graceful-termination/0.log" Jun 08 10:35:54.382898 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:54.382806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-kmb2g_98b14688-bfa2-4bc0-b34b-34fc039d3101/kube-storage-version-migrator-operator/1.log" Jun 08 10:35:54.384381 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:54.384361 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-kmb2g_98b14688-bfa2-4bc0-b34b-34fc039d3101/kube-storage-version-migrator-operator/0.log" Jun 08 10:35:54.722802 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:54.722730 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9p7tn/perf-node-gather-daemonset-mt5pd" Jun 08 10:35:55.382057 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:55.382025 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx6rw_736829ca-c2c8-4a61-a598-2cdda4ff0ea5/kube-multus-additional-cni-plugins/0.log" Jun 08 10:35:55.399918 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:55.399885 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx6rw_736829ca-c2c8-4a61-a598-2cdda4ff0ea5/egress-router-binary-copy/0.log" Jun 08 10:35:55.417437 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:55.417408 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx6rw_736829ca-c2c8-4a61-a598-2cdda4ff0ea5/cni-plugins/0.log" Jun 08 10:35:55.432836 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:55.432788 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx6rw_736829ca-c2c8-4a61-a598-2cdda4ff0ea5/bond-cni-plugin/0.log" Jun 08 10:35:55.448329 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:55.448306 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx6rw_736829ca-c2c8-4a61-a598-2cdda4ff0ea5/routeoverride-cni/0.log" Jun 08 10:35:55.464511 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:55.464488 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx6rw_736829ca-c2c8-4a61-a598-2cdda4ff0ea5/whereabouts-cni-bincopy/0.log" Jun 08 10:35:55.480311 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:55.480287 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx6rw_736829ca-c2c8-4a61-a598-2cdda4ff0ea5/whereabouts-cni/0.log" Jun 08 10:35:55.501624 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:55.501600 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fbj9v_389cee50-7051-4bd9-b037-49c40f04eacc/kube-multus/0.log" Jun 08 10:35:55.560638 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:55.560612 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hzg8m_90295d28-34ba-447d-9517-0520ee42f937/network-metrics-daemon/0.log" Jun 08 10:35:55.579927 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:55.579902 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hzg8m_90295d28-34ba-447d-9517-0520ee42f937/kube-rbac-proxy/0.log" Jun 08 10:35:56.451694 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:56.451663 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-controller/0.log" Jun 08 10:35:56.466147 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:56.466114 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/1.log" Jun 08 10:35:56.466397 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:56.466381 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovn-acl-logging/0.log" Jun 08 10:35:56.482879 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:56.482845 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/kube-rbac-proxy-node/0.log" Jun 08 10:35:56.502167 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:56.502139 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/kube-rbac-proxy-ovn-metrics/0.log" Jun 08 10:35:56.515761 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:56.515740 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/northd/0.log" Jun 08 10:35:56.532922 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:56.532901 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/nbdb/0.log" Jun 08 10:35:56.549698 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:56.549680 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/sbdb/0.log" Jun 08 10:35:56.644963 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:56.644930 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7s4qb_e436b793-82b9-4abe-9697-4ee2c4ba471c/ovnkube-controller/0.log" Jun 08 10:35:57.944563 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:57.944525 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-84tx9_640d0bde-0a46-4cd1-b802-31336f4f618d/network-check-target-container/0.log" Jun 08 10:35:58.836164 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:58.836136 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xc5j5_e17377ad-cffa-42a7-bb74-fa2e7a3feb7a/iptables-alerter/0.log" Jun 08 10:35:59.427070 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:35:59.427033 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-cslrb_af413261-7dd4-4de4-a0a9-e308dd3b437b/tuned/0.log" Jun 08 10:36:01.036733 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:36:01.036702 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-nx4sb_f5f7139e-3d44-470b-ac56-02815aa81b9e/cluster-samples-operator/0.log" Jun 08 10:36:01.049769 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:36:01.049742 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-nx4sb_f5f7139e-3d44-470b-ac56-02815aa81b9e/cluster-samples-operator-watch/0.log" Jun 08 10:36:01.857996 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:36:01.857962 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-8p47t_a1bd360d-786a-4234-ba7b-676228a5b76e/service-ca-operator/1.log" Jun 08 10:36:01.859776 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:36:01.859757 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-8p47t_a1bd360d-786a-4234-ba7b-676228a5b76e/service-ca-operator/0.log" Jun 08 10:36:02.141490 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:36:02.141415 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-7d74d578b8-7xbwb_9422fdae-c471-49b3-a950-46ce5a96f0c7/service-ca-controller/0.log" Jun 08 10:36:02.493456 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:36:02.493375 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-bgn2b_3329197c-0b71-4332-9684-a73656d1868a/csi-driver/0.log" Jun 08 10:36:02.508587 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:36:02.508562 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-bgn2b_3329197c-0b71-4332-9684-a73656d1868a/csi-node-driver-registrar/0.log" Jun 08 10:36:02.524337 ip-10-0-132-117 kubenswrapper[2577]: I0608 10:36:02.524301 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-bgn2b_3329197c-0b71-4332-9684-a73656d1868a/csi-liveness-probe/0.log"