Sep 11 03:00:41.498459 ip-10-0-138-232 systemd[1]: Starting Kubernetes Kubelet... Sep 11 03:00:41.934020 ip-10-0-138-232 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 03:00:41.934020 ip-10-0-138-232 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 11 03:00:41.934020 ip-10-0-138-232 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 03:00:41.934020 ip-10-0-138-232 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 11 03:00:41.934020 ip-10-0-138-232 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 03:00:41.937015 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.936924 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 11 03:00:41.941115 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941100 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 03:00:41.941115 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941116 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941120 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941123 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941126 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941130 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941132 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941135 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941138 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941155 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941159 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941161 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941164 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941167 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941170 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941173 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941176 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941179 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941187 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941190 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941193 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 03:00:41.941190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941196 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941199 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941202 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941204 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941207 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941210 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941212 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941214 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941217 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941219 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941222 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941224 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941227 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941230 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941233 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941235 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941238 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941240 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941243 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941245 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 03:00:41.941660 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941247 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941250 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941252 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941254 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941258 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941260 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941263 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941265 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941268 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941270 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941273 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941276 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941278 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941280 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941283 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941287 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941289 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941292 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941295 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941297 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 03:00:41.942154 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941300 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941302 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941305 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941308 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941310 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941313 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941315 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941319 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941321 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941323 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941326 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941328 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941333 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941336 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941339 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941343 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941346 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941349 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 03:00:41.942639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941352 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941355 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941357 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941360 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941363 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941366 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941368 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941370 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941374 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941377 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941380 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941382 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941385 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941387 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941389 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941392 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941395 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941399 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941402 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 03:00:41.943262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.941405 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942088 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942094 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942099 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942103 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942106 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942110 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942112 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942115 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942118 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942120 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942123 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942125 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942128 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942131 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942133 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942136 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942155 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942158 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 03:00:41.943912 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942161 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942164 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942168 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942170 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942173 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942175 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942178 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942180 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942183 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942187 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942190 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942193 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942195 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942198 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942200 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942203 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942205 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942208 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942212 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942215 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 03:00:41.944430 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942217 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942220 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942223 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942225 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942228 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942230 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942232 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942235 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942237 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942240 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942242 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942245 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942248 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942251 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942253 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942256 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942258 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942261 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942263 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942266 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 03:00:41.944913 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942268 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942270 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942273 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942275 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942278 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942280 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942283 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942285 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942288 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942290 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942293 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942297 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942300 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942302 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942305 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942307 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942310 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942312 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942315 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 03:00:41.945452 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942317 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942319 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942322 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942325 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942329 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942332 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942335 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942339 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942342 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942345 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942348 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942350 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942353 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942355 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942358 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942360 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942362 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942365 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942368 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 03:00:41.945919 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942370 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942373 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.942375 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943184 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943197 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943202 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943206 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943210 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943214 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943219 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943223 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943227 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943231 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943236 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943246 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943250 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943255 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943259 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943263 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943267 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 03:00:41.946397 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943272 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943276 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943281 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943285 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943291 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943298 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943308 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943312 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943316 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943321 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943326 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943330 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943334 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943338 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943342 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943346 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943350 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943355 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943359 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943368 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 03:00:41.946921 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943373 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943377 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943380 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943384 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943390 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943395 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943399 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943403 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943407 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943411 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943415 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943419 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943428 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943433 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943441 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943446 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943451 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943455 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943460 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943464 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 03:00:41.947419 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943469 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943473 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943478 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943488 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943492 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943496 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943501 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943505 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943509 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943513 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943517 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943522 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943526 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943530 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943534 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943537 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943549 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943554 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943558 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943562 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 03:00:41.947900 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943566 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943571 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943577 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943582 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943586 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943590 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943595 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943599 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943608 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943612 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943616 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943620 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943624 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943631 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943636 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943641 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943645 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943649 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943653 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 03:00:41.948458 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943657 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943667 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.943671 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.943810 2578 flags.go:64] FLAG: --address="0.0.0.0" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.943983 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.943994 2578 flags.go:64] FLAG: --anonymous-auth="true" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.943998 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944002 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944005 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944018 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944022 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944025 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944028 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944032 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944035 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944038 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944041 2578 flags.go:64] FLAG: --cgroup-root="" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944044 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944046 2578 flags.go:64] FLAG: --client-ca-file="" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944049 2578 flags.go:64] FLAG: --cloud-provider="external" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944052 2578 flags.go:64] FLAG: --cluster-dns="[]" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944056 2578 flags.go:64] FLAG: --cluster-domain="" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944059 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944062 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 11 03:00:41.948903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944065 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944068 2578 flags.go:64] FLAG: --container-log-max-files="5" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944073 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944076 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944079 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944082 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944085 2578 flags.go:64] FLAG: --contention-profiling="false" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944088 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944090 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944093 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944096 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944101 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944103 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944106 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944109 2578 flags.go:64] FLAG: --enable-load-reader="false" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944112 2578 flags.go:64] FLAG: --enable-server="true" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944115 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944120 2578 flags.go:64] FLAG: --event-burst="100" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944124 2578 flags.go:64] FLAG: --event-qps="50" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944127 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944129 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944133 2578 flags.go:64] FLAG: --eviction-hard="" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944136 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944156 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944161 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 11 03:00:41.949501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944166 2578 flags.go:64] FLAG: --eviction-soft="" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944169 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944172 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944175 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944178 2578 flags.go:64] FLAG: --experimental-mounter-path="" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944181 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944184 2578 flags.go:64] FLAG: --fail-swap-on="true" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944186 2578 flags.go:64] FLAG: --feature-gates="" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944191 2578 flags.go:64] FLAG: --file-check-frequency="20s" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944194 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944197 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944200 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944203 2578 flags.go:64] FLAG: --healthz-port="10248" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944206 2578 flags.go:64] FLAG: --help="false" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944209 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-138-232.ec2.internal" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944212 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944215 2578 flags.go:64] FLAG: --http-check-frequency="20s" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944218 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944221 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944224 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944227 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944230 2578 flags.go:64] FLAG: --image-service-endpoint="" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944232 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 11 03:00:41.950102 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944235 2578 flags.go:64] FLAG: --kube-api-burst="100" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944238 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944241 2578 flags.go:64] FLAG: --kube-api-qps="50" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944244 2578 flags.go:64] FLAG: --kube-reserved="" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944246 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944249 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944252 2578 flags.go:64] FLAG: --kubelet-cgroups="" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944255 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944257 2578 flags.go:64] FLAG: --lock-file="" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944260 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944263 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944266 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944271 2578 flags.go:64] FLAG: --log-json-split-stream="false" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944273 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944276 2578 flags.go:64] FLAG: --log-text-split-stream="false" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944287 2578 flags.go:64] FLAG: --logging-format="text" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944290 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944293 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944296 2578 flags.go:64] FLAG: --manifest-url="" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944299 2578 flags.go:64] FLAG: --manifest-url-header="" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944304 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944307 2578 flags.go:64] FLAG: --max-open-files="1000000" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944311 2578 flags.go:64] FLAG: --max-pods="110" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944314 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944317 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 11 03:00:41.950701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944320 2578 flags.go:64] FLAG: --memory-manager-policy="None" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944322 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944325 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944328 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944331 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944339 2578 flags.go:64] FLAG: --node-status-max-images="50" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944342 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944345 2578 flags.go:64] FLAG: --oom-score-adj="-999" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944348 2578 flags.go:64] FLAG: --pod-cidr="" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944350 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944357 2578 flags.go:64] FLAG: --pod-manifest-path="" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944360 2578 flags.go:64] FLAG: --pod-max-pids="-1" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944363 2578 flags.go:64] FLAG: --pods-per-core="0" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944366 2578 flags.go:64] FLAG: --port="10250" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944369 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944371 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cda9f8eefcdef9d1" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944374 2578 flags.go:64] FLAG: --qos-reserved="" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944377 2578 flags.go:64] FLAG: --read-only-port="10255" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944380 2578 flags.go:64] FLAG: --register-node="true" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944382 2578 flags.go:64] FLAG: --register-with-taints="" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944386 2578 flags.go:64] FLAG: --registry-burst="10" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944389 2578 flags.go:64] FLAG: --registry-qps="5" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944392 2578 flags.go:64] FLAG: --reserved-cpus="" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944395 2578 flags.go:64] FLAG: --reserved-memory="" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944399 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 11 03:00:41.951318 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944402 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944405 2578 flags.go:64] FLAG: --rotate-certificates="false" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944410 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944413 2578 flags.go:64] FLAG: --runonce="false" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944415 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944418 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944421 2578 flags.go:64] FLAG: --seccomp-default="false" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944424 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944427 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944430 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944433 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944436 2578 flags.go:64] FLAG: --storage-driver-password="root" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944441 2578 flags.go:64] FLAG: --storage-driver-secure="false" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944444 2578 flags.go:64] FLAG: --storage-driver-table="stats" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944447 2578 flags.go:64] FLAG: --storage-driver-user="root" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944449 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944452 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944455 2578 flags.go:64] FLAG: --system-cgroups="" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944458 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944464 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944467 2578 flags.go:64] FLAG: --tls-cert-file="" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944470 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944474 2578 flags.go:64] FLAG: --tls-min-version="" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944477 2578 flags.go:64] FLAG: --tls-private-key-file="" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944480 2578 flags.go:64] FLAG: --topology-manager-policy="none" Sep 11 03:00:41.952039 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944482 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944485 2578 flags.go:64] FLAG: --topology-manager-scope="container" Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944488 2578 flags.go:64] FLAG: --v="2" Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944492 2578 flags.go:64] FLAG: --version="false" Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944496 2578 flags.go:64] FLAG: --vmodule="" Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944500 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.944503 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944618 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944623 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944630 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944633 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944637 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944640 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944643 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944646 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944649 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944651 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944654 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944656 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944660 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944663 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 03:00:41.952738 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944665 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944668 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944671 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944673 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944676 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944678 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944681 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944684 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944686 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944689 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944691 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944693 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944696 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944698 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944701 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944703 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944706 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944709 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944712 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 03:00:41.953276 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944715 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944718 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944721 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944723 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944726 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944729 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944731 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944733 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944736 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944738 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944741 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944745 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944748 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944750 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944753 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944756 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944759 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944761 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944764 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944766 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 03:00:41.953754 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944769 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944772 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944774 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944776 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944779 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944782 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944785 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944790 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944796 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944800 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944803 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944807 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944810 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944815 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944819 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944823 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944825 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944828 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944830 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 03:00:41.954274 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944832 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944835 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944838 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944840 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944844 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944847 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944850 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944852 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944855 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944858 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944860 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944863 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944866 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944868 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944871 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944873 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944876 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944878 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944881 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944883 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 03:00:41.954731 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944886 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944888 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944891 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944893 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944896 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944899 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.944903 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.945880 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.954088 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.954103 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.954122 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.954128 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954202 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954207 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954210 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 03:00:41.955283 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954213 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954217 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954220 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954223 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954226 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954229 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954231 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954234 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954237 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954241 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954245 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954248 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954251 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954254 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954256 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954259 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954262 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954264 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954267 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954269 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 03:00:41.955665 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954272 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954275 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954278 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954282 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954285 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954289 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954294 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954298 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954300 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954304 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954308 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954311 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954314 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954317 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954319 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954322 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954324 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954327 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954329 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 03:00:41.956134 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954332 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954334 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954337 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954339 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954342 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954345 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954347 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954349 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954352 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954354 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954357 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954359 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954362 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954364 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954366 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954369 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954371 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954374 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954376 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954379 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 03:00:41.956618 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954383 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954385 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954388 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954390 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954393 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954395 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954398 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954400 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954403 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954405 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954408 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954410 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954413 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954415 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954418 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954420 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954423 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954425 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954428 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 03:00:41.957101 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954430 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954433 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954435 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954438 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954440 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954443 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954445 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954448 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954451 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954453 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954456 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954458 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954461 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954464 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954467 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954469 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954472 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 03:00:41.957639 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954474 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.954479 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954604 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954609 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954612 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954615 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954619 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954623 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954626 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954629 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954632 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954634 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954637 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954640 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954643 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 03:00:41.958060 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954645 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954648 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954650 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954653 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954658 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954661 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954663 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954666 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954669 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954672 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954674 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954677 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954680 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954683 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954685 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954688 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954691 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954693 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954695 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 03:00:41.958503 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954698 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954700 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954703 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954705 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954708 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954710 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954713 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954715 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954718 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954720 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954722 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954725 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954727 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954730 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954732 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954735 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954738 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954740 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954743 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 03:00:41.958970 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954745 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954748 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954751 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954753 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954756 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954759 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954761 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954763 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954766 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954768 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954772 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954774 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954776 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954779 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954781 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954784 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954786 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954789 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954791 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954794 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 03:00:41.959867 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954796 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954799 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954801 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954803 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954806 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954808 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954811 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954813 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954816 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954818 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954821 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954823 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954825 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954828 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954831 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954833 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954836 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954838 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954841 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954843 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 03:00:41.960519 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954846 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954849 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954852 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954856 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954858 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954861 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954863 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:41.954865 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.954870 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.954978 2578 server.go:962] "Client rotation is on, will bootstrap in background" Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.957333 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.958309 2578 server.go:1019] "Starting client certificate rotation" Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.958415 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 03:00:41.961118 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.959130 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 03:00:41.961508 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.961348 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 03:00:41.962713 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.962696 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 03:00:41.976018 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.975995 2578 log.go:25] "Validated CRI v1 runtime API" Sep 11 03:00:41.980627 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.980610 2578 log.go:25] "Validated CRI v1 image API" Sep 11 03:00:41.981570 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.981548 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 11 03:00:41.984974 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.984953 2578 fs.go:135] Filesystem UUIDs: map[264724f6-1903-48f7-953e-95aead36bb23:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 be60d433-73b0-4b2a-9629-f215969fdb6c:/dev/nvme0n1p3] Sep 11 03:00:41.985046 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.984972 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 11 03:00:41.988126 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.988112 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 03:00:41.991208 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.991086 2578 manager.go:216] Machine: {Timestamp:2026-09-11 03:00:41.989721517 +0000 UTC m=+0.381841979 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112902 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2293f876b69a344264f80f8b809d5b SystemUUID:ec2293f8-76b6-9a34-4264-f80f8b809d5b BootID:ffc12a09-0a56-4381-9883-07f20d1856a5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2b:ce:8e:17:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2b:ce:8e:17:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:44:72:08:c3:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 11 03:00:41.991208 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.991204 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 11 03:00:41.991330 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.991319 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 11 03:00:41.994755 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.994730 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 11 03:00:41.994889 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.994758 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 11 03:00:41.996316 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.996306 2578 topology_manager.go:138] "Creating topology manager with none policy" Sep 11 03:00:41.996357 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.996319 2578 container_manager_linux.go:309] "Creating device plugin manager" Sep 11 03:00:41.996357 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.996327 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 03:00:41.996357 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.996341 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 03:00:41.997545 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:41.997535 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 11 03:00:42.002450 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.002438 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 11 03:00:42.002565 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.002556 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 11 03:00:42.002598 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.002585 2578 kubelet.go:486] "Attempting to sync node with API server" Sep 11 03:00:42.002598 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.002595 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 11 03:00:42.002651 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.002610 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 11 03:00:42.002651 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.002620 2578 kubelet.go:398] "Adding apiserver pod source" Sep 11 03:00:42.002651 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.002629 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 11 03:00:42.003060 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.003047 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 03:00:42.003122 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.003073 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 03:00:42.005588 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.005568 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 11 03:00:42.008445 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.008429 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 11 03:00:42.008526 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.008460 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 11 03:00:42.010273 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010259 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 11 03:00:42.010335 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010282 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 11 03:00:42.010335 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010294 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 11 03:00:42.010335 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010304 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 11 03:00:42.010335 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010317 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 11 03:00:42.010335 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010324 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 11 03:00:42.010468 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010345 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 11 03:00:42.010468 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010353 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 11 03:00:42.010468 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010363 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 11 03:00:42.010468 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010371 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 11 03:00:42.010468 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010383 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 11 03:00:42.010468 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010392 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 11 03:00:42.010753 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.010739 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7sfn5" Sep 11 03:00:42.011341 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.011329 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 11 03:00:42.011341 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.011342 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 11 03:00:42.012624 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.012603 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 11 03:00:42.012692 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.012642 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 11 03:00:42.015238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.015225 2578 server.go:1268] "Started kubelet" Sep 11 03:00:42.015324 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.015281 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 11 03:00:42.015930 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.015909 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7sfn5" Sep 11 03:00:42.016085 ip-10-0-138-232 systemd[1]: Started Kubernetes Kubelet. Sep 11 03:00:42.016949 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.016171 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 11 03:00:42.016949 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.016753 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 11 03:00:42.018077 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.018059 2578 server.go:310] "Adding debug handlers to kubelet server" Sep 11 03:00:42.019522 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.019506 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 11 03:00:42.020818 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.020803 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 11 03:00:42.027185 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.027167 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 11 03:00:42.027861 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.027844 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 11 03:00:42.028192 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.028166 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:42.028775 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.028755 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 11 03:00:42.028775 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.028764 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 11 03:00:42.028875 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.028782 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 11 03:00:42.028918 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.028886 2578 reconstruct.go:97] "Volume reconstruction finished" Sep 11 03:00:42.028918 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.028892 2578 reconciler.go:29] "Reconciler: start to sync state" Sep 11 03:00:42.029770 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.029754 2578 factory.go:55] Registering systemd factory Sep 11 03:00:42.029770 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.029772 2578 factory.go:223] Registration of the systemd container factory successfully Sep 11 03:00:42.029998 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.029984 2578 factory.go:153] Registering CRI-O factory Sep 11 03:00:42.030049 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.030001 2578 factory.go:223] Registration of the crio container factory successfully Sep 11 03:00:42.030080 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.030053 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 11 03:00:42.030080 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.030071 2578 factory.go:103] Registering Raw factory Sep 11 03:00:42.030176 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.030084 2578 manager.go:1196] Started watching for new ooms in manager Sep 11 03:00:42.030176 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.030118 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 03:00:42.030476 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.030461 2578 manager.go:349] Starting recovery of all containers Sep 11 03:00:42.033637 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.033615 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-232.ec2.internal\" not found" node="ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.033736 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.033664 2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-232.ec2.internal" not found Sep 11 03:00:42.040380 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.040366 2578 manager.go:354] Recovery completed Sep 11 03:00:42.044557 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.044541 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 03:00:42.047347 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.047332 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientMemory" Sep 11 03:00:42.047421 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.047362 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 03:00:42.047421 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.047376 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientPID" Sep 11 03:00:42.047931 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.047920 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 11 03:00:42.047976 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.047931 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 11 03:00:42.047976 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.047934 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 03:00:42.047976 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.047948 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 11 03:00:42.048473 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.048461 2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-232.ec2.internal" not found Sep 11 03:00:42.048718 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.048703 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientMemory" Sep 11 03:00:42.048763 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.048736 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 03:00:42.048763 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.048752 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientPID" Sep 11 03:00:42.049949 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.049938 2578 policy_none.go:49] "None policy: Start" Sep 11 03:00:42.049987 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.049954 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 11 03:00:42.049987 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.049964 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 11 03:00:42.051897 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.051885 2578 policy_none.go:47] "Start" Sep 11 03:00:42.093859 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.093688 2578 manager.go:337] "Starting Device Plugin manager" Sep 11 03:00:42.113457 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.093907 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 11 03:00:42.113457 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.093922 2578 server.go:87] "Starting device plugin registration server" Sep 11 03:00:42.113457 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.094181 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 11 03:00:42.113457 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.094192 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 11 03:00:42.113457 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.094264 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 11 03:00:42.113457 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.094343 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 11 03:00:42.113457 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.094352 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 11 03:00:42.113457 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.094951 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 11 03:00:42.113457 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.094993 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:42.113457 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.109486 2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-232.ec2.internal" not found Sep 11 03:00:42.131419 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.131384 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 11 03:00:42.132691 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.132674 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 11 03:00:42.132782 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.132716 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 11 03:00:42.132782 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.132736 2578 kubelet.go:2448] "Starting kubelet main sync loop" Sep 11 03:00:42.132875 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.132804 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 11 03:00:42.134923 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.134907 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 03:00:42.194762 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.194667 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 03:00:42.195776 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.195761 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientMemory" Sep 11 03:00:42.195837 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.195791 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 03:00:42.195837 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.195804 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientPID" Sep 11 03:00:42.195837 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.195829 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.205020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.205000 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.205116 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.205024 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-232.ec2.internal\": node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:42.220247 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.220223 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:42.234246 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.233697 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-232.ec2.internal"] Sep 11 03:00:42.234300 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.234288 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 03:00:42.235165 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.235132 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientMemory" Sep 11 03:00:42.235229 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.235182 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 03:00:42.235229 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.235196 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientPID" Sep 11 03:00:42.237368 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.237356 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 03:00:42.237503 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.237491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.237542 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.237520 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 03:00:42.238062 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.238049 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientMemory" Sep 11 03:00:42.238164 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.238055 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientMemory" Sep 11 03:00:42.238164 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.238075 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 03:00:42.238164 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.238091 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientPID" Sep 11 03:00:42.238164 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.238093 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 03:00:42.238164 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.238104 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientPID" Sep 11 03:00:42.240175 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.240160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.240229 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.240184 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 03:00:42.241488 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.241468 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientMemory" Sep 11 03:00:42.241571 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.241498 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 03:00:42.241571 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.241519 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeHasSufficientPID" Sep 11 03:00:42.253733 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.253713 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-232.ec2.internal\" not found" node="ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.257574 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.257561 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-232.ec2.internal\" not found" node="ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.320396 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.320374 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:42.330884 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.330866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5251df6d6d13e895d3869fc5a6e732f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal\" (UID: \"5251df6d6d13e895d3869fc5a6e732f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.330935 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.330888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5251df6d6d13e895d3869fc5a6e732f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal\" (UID: \"5251df6d6d13e895d3869fc5a6e732f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.330935 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.330902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfb73c088fb2994699656a729ac976af-config\") pod \"kube-apiserver-proxy-ip-10-0-138-232.ec2.internal\" (UID: \"cfb73c088fb2994699656a729ac976af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.420847 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.420823 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:42.431201 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.431180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfb73c088fb2994699656a729ac976af-config\") pod \"kube-apiserver-proxy-ip-10-0-138-232.ec2.internal\" (UID: \"cfb73c088fb2994699656a729ac976af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.431248 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.431206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5251df6d6d13e895d3869fc5a6e732f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal\" (UID: \"5251df6d6d13e895d3869fc5a6e732f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.431248 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.431222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5251df6d6d13e895d3869fc5a6e732f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal\" (UID: \"5251df6d6d13e895d3869fc5a6e732f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.431307 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.431280 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfb73c088fb2994699656a729ac976af-config\") pod \"kube-apiserver-proxy-ip-10-0-138-232.ec2.internal\" (UID: \"cfb73c088fb2994699656a729ac976af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.431307 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.431292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5251df6d6d13e895d3869fc5a6e732f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal\" (UID: \"5251df6d6d13e895d3869fc5a6e732f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.431369 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.431296 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5251df6d6d13e895d3869fc5a6e732f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal\" (UID: \"5251df6d6d13e895d3869fc5a6e732f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.521602 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.521568 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:42.556106 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.556081 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.560977 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.560756 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-232.ec2.internal" Sep 11 03:00:42.622234 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.622196 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:42.722756 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.722726 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:42.823297 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.823213 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:42.923775 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:42.923735 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:42.958190 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.958169 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 11 03:00:42.958636 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.958303 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 03:00:42.958636 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:42.958337 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 03:00:43.023679 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:43.023619 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 02:55:42 +0000 UTC" deadline="2028-03-15 14:24:27.798523892 +0000 UTC" Sep 11 03:00:43.023679 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:43.023670 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13235h23m44.774856607s" Sep 11 03:00:43.024707 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:43.024689 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:43.125426 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:43.125367 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:43.187214 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:43.187180 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5251df6d6d13e895d3869fc5a6e732f6.slice/crio-c4785858943f14439d1d1938946a0f0fa64c7f9263cc491f7339e5360a07d372 WatchSource:0}: Error finding container c4785858943f14439d1d1938946a0f0fa64c7f9263cc491f7339e5360a07d372: Status 404 returned error can't find the container with id c4785858943f14439d1d1938946a0f0fa64c7f9263cc491f7339e5360a07d372 Sep 11 03:00:43.188007 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:43.187979 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb73c088fb2994699656a729ac976af.slice/crio-20725a3e6bc5ee0d0e4105061974d08e73d2a28622bcdedf18aa4557032eeb57 WatchSource:0}: Error finding container 20725a3e6bc5ee0d0e4105061974d08e73d2a28622bcdedf18aa4557032eeb57: Status 404 returned error can't find the container with id 20725a3e6bc5ee0d0e4105061974d08e73d2a28622bcdedf18aa4557032eeb57 Sep 11 03:00:43.192093 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:43.192078 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 03:00:43.225993 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:43.225962 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-232.ec2.internal\" not found" Sep 11 03:00:43.299741 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:43.299717 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 03:00:43.321042 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:43.321022 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 03:00:43.329014 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:43.328995 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" Sep 11 03:00:43.339644 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:43.339626 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 03:00:43.340733 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:43.340721 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-232.ec2.internal" Sep 11 03:00:43.346972 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:43.346956 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 03:00:43.763262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:43.763229 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 03:00:44.003726 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.003693 2578 apiserver.go:52] "Watching apiserver" Sep 11 03:00:44.010597 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.010568 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 11 03:00:44.010970 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.010944 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-k2wzg","openshift-network-diagnostics/network-check-target-pv5qr","openshift-network-operator/iptables-alerter-kb29j","kube-system/konnectivity-agent-kf2hz","kube-system/kube-apiserver-proxy-ip-10-0-138-232.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm","openshift-cluster-node-tuning-operator/tuned-864b8","openshift-image-registry/node-ca-5s8k9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-vvdjq","kube-system/global-pull-secret-syncer-bdsfj","openshift-dns/node-resolver-b6vc6","openshift-multus/multus-8hbq6","openshift-multus/multus-additional-cni-plugins-gk79t"] Sep 11 03:00:44.013635 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.013577 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.015682 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.015657 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 11 03:00:44.015798 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.015686 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 11 03:00:44.015798 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.015659 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rvvdt\"" Sep 11 03:00:44.016001 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.015984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:44.016086 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.016068 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:00:44.018075 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.018053 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kb29j" Sep 11 03:00:44.022162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.020654 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 11 03:00:44.022162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.020758 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 11 03:00:44.022162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.020656 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-llxvp\"" Sep 11 03:00:44.022162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.020918 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 11 03:00:44.022162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.021101 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:00:44.023072 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.023050 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 11 03:00:44.023072 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.023069 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2shbm\"" Sep 11 03:00:44.023249 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.023099 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.023249 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.023233 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 11 03:00:44.025033 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.025003 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 11 03:00:44.025302 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.025282 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lm2nw\"" Sep 11 03:00:44.025302 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.025298 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 11 03:00:44.025484 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.025282 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 11 03:00:44.025484 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.025449 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 11 03:00:44.025651 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.025504 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 11 03:00:44.025745 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.025725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.027612 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.027592 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 11 03:00:44.027722 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.027599 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 11 03:00:44.027792 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.027748 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 11 03:00:44.027845 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.027822 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jnlk6\"" Sep 11 03:00:44.027901 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.027884 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 11 03:00:44.028238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.028210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5s8k9" Sep 11 03:00:44.029883 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.029864 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 11 03:00:44.030118 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.030099 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 11 03:00:44.030118 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.030102 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 11 03:00:44.030474 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.030450 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8xcsj\"" Sep 11 03:00:44.030641 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.030617 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.032398 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.032381 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 11 03:00:44.032514 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.032408 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mzjns\"" Sep 11 03:00:44.033117 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.033100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:44.033214 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.033183 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:00:44.035898 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.035879 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.036634 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.036617 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 03:00:44.037675 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.037656 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 11 03:00:44.037820 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.037798 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v2rlt\"" Sep 11 03:00:44.037963 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.037921 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 11 03:00:44.037963 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.037942 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 11 03:00:44.038323 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.038259 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 11 03:00:44.038407 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.038391 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 11 03:00:44.038939 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.038915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3fb21f61-b549-419a-87cb-195db9fae336-cni-binary-copy\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.039047 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.038962 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 11 03:00:44.039047 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.038960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-socket-dir-parent\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.039047 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-run-netns\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.039047 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-modprobe-d\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.039284 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039081 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-run\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.039284 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-run-multus-certs\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.039284 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-host\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.039284 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e804423a-8c29-40a0-b798-4190c0c623a6-etc-tuned\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.039284 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3fb21f61-b549-419a-87cb-195db9fae336-cnibin\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.039284 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpb59\" (UniqueName: \"kubernetes.io/projected/9c08f534-bb6e-4c9a-b96e-9089b7dd7f13-kube-api-access-jpb59\") pod \"node-ca-5s8k9\" (UID: \"9c08f534-bb6e-4c9a-b96e-9089b7dd7f13\") " pod="openshift-image-registry/node-ca-5s8k9" Sep 11 03:00:44.039284 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:44.039284 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-socket-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039308 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-sys-fs\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.039323 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-registration-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-device-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntp5\" (UniqueName: \"kubernetes.io/projected/181a399f-574e-4669-a467-43fe5668e62d-kube-api-access-rntp5\") pod \"iptables-alerter-kb29j\" (UID: \"181a399f-574e-4669-a467-43fe5668e62d\") " pod="openshift-network-operator/iptables-alerter-kb29j" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3fb21f61-b549-419a-87cb-195db9fae336-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-cni-dir\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-kubernetes\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fb21f61-b549-419a-87cb-195db9fae336-system-cni-dir\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c19a616e-7c81-44d3-b76e-91b589f2247b-kubelet-config\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.039672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3fb21f61-b549-419a-87cb-195db9fae336-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039712 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8jjx\" (UniqueName: \"kubernetes.io/projected/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-kube-api-access-d8jjx\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039762 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-sysctl-conf\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-sys\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-sysctl-d\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-systemd\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3fb21f61-b549-419a-87cb-195db9fae336-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c08f534-bb6e-4c9a-b96e-9089b7dd7f13-host\") pod \"node-ca-5s8k9\" (UID: \"9c08f534-bb6e-4c9a-b96e-9089b7dd7f13\") " pod="openshift-image-registry/node-ca-5s8k9" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.039985 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c08f534-bb6e-4c9a-b96e-9089b7dd7f13-serviceca\") pod \"node-ca-5s8k9\" (UID: \"9c08f534-bb6e-4c9a-b96e-9089b7dd7f13\") " pod="openshift-image-registry/node-ca-5s8k9" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/181a399f-574e-4669-a467-43fe5668e62d-iptables-alerter-script\") pod \"iptables-alerter-kb29j\" (UID: \"181a399f-574e-4669-a467-43fe5668e62d\") " pod="openshift-network-operator/iptables-alerter-kb29j" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040061 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/181a399f-574e-4669-a467-43fe5668e62d-host-slash\") pod \"iptables-alerter-kb29j\" (UID: \"181a399f-574e-4669-a467-43fe5668e62d\") " pod="openshift-network-operator/iptables-alerter-kb29j" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7gkg\" (UniqueName: \"kubernetes.io/projected/3fb21f61-b549-419a-87cb-195db9fae336-kube-api-access-g7gkg\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-cni-binary-copy\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px9nq\" (UniqueName: \"kubernetes.io/projected/e804423a-8c29-40a0-b798-4190c0c623a6-kube-api-access-px9nq\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.040207 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c19a616e-7c81-44d3-b76e-91b589f2247b-dbus\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-cnibin\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-var-lib-cni-bin\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040304 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-var-lib-kubelet\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-var-lib-kubelet\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e2b044a-7d10-4425-aafe-ca363dea77f6-konnectivity-ca\") pod \"konnectivity-agent-kf2hz\" (UID: \"7e2b044a-7d10-4425-aafe-ca363dea77f6\") " pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-etc-kubernetes\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040382 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-sysconfig\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e2b044a-7d10-4425-aafe-ca363dea77f6-agent-certs\") pod \"konnectivity-agent-kf2hz\" (UID: \"7e2b044a-7d10-4425-aafe-ca363dea77f6\") " pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040481 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e804423a-8c29-40a0-b798-4190c0c623a6-tmp\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-conf-dir\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-run-k8s-cni-cncf-io\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-var-lib-cni-multus\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-daemon-config\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040630 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-lib-modules\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.040990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040652 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-hostroot\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.041655 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5479d\" (UniqueName: \"kubernetes.io/projected/b6d03a1d-30b1-4814-875b-dd2832235f5b-kube-api-access-5479d\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.041655 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.040779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-system-cni-dir\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.041893 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.041876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b6vc6" Sep 11 03:00:44.043989 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.043857 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c2sh7\"" Sep 11 03:00:44.043989 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.043877 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 11 03:00:44.043989 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.043863 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 11 03:00:44.062335 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.062249 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x8mpz" Sep 11 03:00:44.070678 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.070655 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x8mpz" Sep 11 03:00:44.130333 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.130308 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 11 03:00:44.137966 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.137915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-232.ec2.internal" event={"ID":"cfb73c088fb2994699656a729ac976af","Type":"ContainerStarted","Data":"20725a3e6bc5ee0d0e4105061974d08e73d2a28622bcdedf18aa4557032eeb57"} Sep 11 03:00:44.139392 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.139362 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" event={"ID":"5251df6d6d13e895d3869fc5a6e732f6","Type":"ContainerStarted","Data":"c4785858943f14439d1d1938946a0f0fa64c7f9263cc491f7339e5360a07d372"} Sep 11 03:00:44.141556 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c19a616e-7c81-44d3-b76e-91b589f2247b-kubelet-config\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:44.141682 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141633 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c19a616e-7c81-44d3-b76e-91b589f2247b-kubelet-config\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:44.141784 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.141784 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3fb21f61-b549-419a-87cb-195db9fae336-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.141784 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8jjx\" (UniqueName: \"kubernetes.io/projected/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-kube-api-access-d8jjx\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.141944 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141787 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-sysctl-conf\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.141944 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-sys\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.141944 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141815 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.141944 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-kubelet\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.141944 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141867 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-slash\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.141944 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-sysctl-d\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.141944 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-systemd\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3fb21f61-b549-419a-87cb-195db9fae336-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c08f534-bb6e-4c9a-b96e-9089b7dd7f13-host\") pod \"node-ca-5s8k9\" (UID: \"9c08f534-bb6e-4c9a-b96e-9089b7dd7f13\") " pod="openshift-image-registry/node-ca-5s8k9" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.141998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c08f534-bb6e-4c9a-b96e-9089b7dd7f13-serviceca\") pod \"node-ca-5s8k9\" (UID: \"9c08f534-bb6e-4c9a-b96e-9089b7dd7f13\") " pod="openshift-image-registry/node-ca-5s8k9" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/181a399f-574e-4669-a467-43fe5668e62d-iptables-alerter-script\") pod \"iptables-alerter-kb29j\" (UID: \"181a399f-574e-4669-a467-43fe5668e62d\") " pod="openshift-network-operator/iptables-alerter-kb29j" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/181a399f-574e-4669-a467-43fe5668e62d-host-slash\") pod \"iptables-alerter-kb29j\" (UID: \"181a399f-574e-4669-a467-43fe5668e62d\") " pod="openshift-network-operator/iptables-alerter-kb29j" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7gkg\" (UniqueName: \"kubernetes.io/projected/3fb21f61-b549-419a-87cb-195db9fae336-kube-api-access-g7gkg\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-cni-binary-copy\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px9nq\" (UniqueName: \"kubernetes.io/projected/e804423a-8c29-40a0-b798-4190c0c623a6-kube-api-access-px9nq\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142164 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-systemd\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fe5d4f81-2ac2-450d-bea5-cc07ef951b4f-hosts-file\") pod \"node-resolver-b6vc6\" (UID: \"fe5d4f81-2ac2-450d-bea5-cc07ef951b4f\") " pod="openshift-dns/node-resolver-b6vc6" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-run-openvswitch\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b83871-0cde-4f5f-82ea-041a73274b90-ovn-node-metrics-cert\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142303 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-sysctl-conf\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142337 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/181a399f-574e-4669-a467-43fe5668e62d-host-slash\") pod \"iptables-alerter-kb29j\" (UID: \"181a399f-574e-4669-a467-43fe5668e62d\") " pod="openshift-network-operator/iptables-alerter-kb29j" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142339 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c08f534-bb6e-4c9a-b96e-9089b7dd7f13-host\") pod \"node-ca-5s8k9\" (UID: \"9c08f534-bb6e-4c9a-b96e-9089b7dd7f13\") " pod="openshift-image-registry/node-ca-5s8k9" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142383 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-sys\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.142413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142402 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j7xt\" (UniqueName: \"kubernetes.io/projected/53b83871-0cde-4f5f-82ea-041a73274b90-kube-api-access-4j7xt\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142408 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3fb21f61-b549-419a-87cb-195db9fae336-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c19a616e-7c81-44d3-b76e-91b589f2247b-dbus\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142461 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-sysctl-d\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142517 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c19a616e-7c81-44d3-b76e-91b589f2247b-dbus\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-cnibin\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142645 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3fb21f61-b549-419a-87cb-195db9fae336-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-var-lib-cni-bin\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-var-lib-kubelet\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142714 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-var-lib-cni-bin\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-var-lib-kubelet\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142725 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-var-lib-kubelet\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142692 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-cnibin\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-run-systemd\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142774 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-node-log\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142785 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-var-lib-kubelet\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e2b044a-7d10-4425-aafe-ca363dea77f6-konnectivity-ca\") pod \"konnectivity-agent-kf2hz\" (UID: \"7e2b044a-7d10-4425-aafe-ca363dea77f6\") " pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-etc-kubernetes\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.143204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142837 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c08f534-bb6e-4c9a-b96e-9089b7dd7f13-serviceca\") pod \"node-ca-5s8k9\" (UID: \"9c08f534-bb6e-4c9a-b96e-9089b7dd7f13\") " pod="openshift-image-registry/node-ca-5s8k9" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-sysconfig\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142905 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-etc-kubernetes\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142918 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-sysconfig\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-log-socket\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142975 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/181a399f-574e-4669-a467-43fe5668e62d-iptables-alerter-script\") pod \"iptables-alerter-kb29j\" (UID: \"181a399f-574e-4669-a467-43fe5668e62d\") " pod="openshift-network-operator/iptables-alerter-kb29j" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.142992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-cni-bin\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e2b044a-7d10-4425-aafe-ca363dea77f6-agent-certs\") pod \"konnectivity-agent-kf2hz\" (UID: \"7e2b044a-7d10-4425-aafe-ca363dea77f6\") " pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e804423a-8c29-40a0-b798-4190c0c623a6-tmp\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-conf-dir\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-var-lib-openvswitch\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.143193 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-etc-openvswitch\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.144038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.143289 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret podName:c19a616e-7c81-44d3-b76e-91b589f2247b nodeName:}" failed. No retries permitted until 2026-09-11 03:00:44.643252517 +0000 UTC m=+3.035372975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret") pod "global-pull-secret-syncer-bdsfj" (UID: "c19a616e-7c81-44d3-b76e-91b589f2247b") : object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143299 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-conf-dir\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe5d4f81-2ac2-450d-bea5-cc07ef951b4f-tmp-dir\") pod \"node-resolver-b6vc6\" (UID: \"fe5d4f81-2ac2-450d-bea5-cc07ef951b4f\") " pod="openshift-dns/node-resolver-b6vc6" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-systemd-units\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-run-ovn\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143337 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e2b044a-7d10-4425-aafe-ca363dea77f6-konnectivity-ca\") pod \"konnectivity-agent-kf2hz\" (UID: \"7e2b044a-7d10-4425-aafe-ca363dea77f6\") " pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b83871-0cde-4f5f-82ea-041a73274b90-env-overrides\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-run-k8s-cni-cncf-io\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-var-lib-cni-multus\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143433 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmns2\" (UniqueName: \"kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2\") pod \"network-check-target-pv5qr\" (UID: \"281c0b4f-2a67-475a-8a24-ca7e2b78ad84\") " pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143464 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-run-k8s-cni-cncf-io\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-daemon-config\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-var-lib-cni-multus\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-lib-modules\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.144888 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-hostroot\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5479d\" (UniqueName: \"kubernetes.io/projected/b6d03a1d-30b1-4814-875b-dd2832235f5b-kube-api-access-5479d\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143598 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-system-cni-dir\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3fb21f61-b549-419a-87cb-195db9fae336-cni-binary-copy\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143648 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-socket-dir-parent\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143647 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-cni-binary-copy\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-run-netns\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143679 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-lib-modules\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-modprobe-d\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143722 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-run\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143740 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-socket-dir-parent\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143743 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-run-netns\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smmxc\" (UniqueName: \"kubernetes.io/projected/fe5d4f81-2ac2-450d-bea5-cc07ef951b4f-kube-api-access-smmxc\") pod \"node-resolver-b6vc6\" (UID: \"fe5d4f81-2ac2-450d-bea5-cc07ef951b4f\") " pod="openshift-dns/node-resolver-b6vc6" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143758 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-system-cni-dir\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-run-netns\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143692 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143788 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-hostroot\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143857 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-modprobe-d\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.145697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b83871-0cde-4f5f-82ea-041a73274b90-ovnkube-script-lib\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-run-multus-certs\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-host\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143945 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-daemon-config\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.143960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e804423a-8c29-40a0-b798-4190c0c623a6-etc-tuned\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144005 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-run\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtxbp\" (UniqueName: \"kubernetes.io/projected/01cf8be0-13ee-435e-a356-1409d7acd0ff-kube-api-access-jtxbp\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144061 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3fb21f61-b549-419a-87cb-195db9fae336-cnibin\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpb59\" (UniqueName: \"kubernetes.io/projected/9c08f534-bb6e-4c9a-b96e-9089b7dd7f13-kube-api-access-jpb59\") pod \"node-ca-5s8k9\" (UID: \"9c08f534-bb6e-4c9a-b96e-9089b7dd7f13\") " pod="openshift-image-registry/node-ca-5s8k9" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-socket-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-sys-fs\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-cni-netd\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-registration-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-device-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntp5\" (UniqueName: \"kubernetes.io/projected/181a399f-574e-4669-a467-43fe5668e62d-kube-api-access-rntp5\") pod \"iptables-alerter-kb29j\" (UID: \"181a399f-574e-4669-a467-43fe5668e62d\") " pod="openshift-network-operator/iptables-alerter-kb29j" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3fb21f61-b549-419a-87cb-195db9fae336-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-cni-dir\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.146864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-kubernetes\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b83871-0cde-4f5f-82ea-041a73274b90-ovnkube-config\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fb21f61-b549-419a-87cb-195db9fae336-system-cni-dir\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144310 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3fb21f61-b549-419a-87cb-195db9fae336-cni-binary-copy\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144371 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fb21f61-b549-419a-87cb-195db9fae336-system-cni-dir\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144394 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-registration-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144414 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-device-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144449 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3fb21f61-b549-419a-87cb-195db9fae336-cnibin\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144691 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-multus-cni-dir\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144707 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-socket-dir\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144718 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-etc-kubernetes\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144759 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6d03a1d-30b1-4814-875b-dd2832235f5b-sys-fs\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-host-run-multus-certs\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.144807 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e804423a-8c29-40a0-b798-4190c0c623a6-host\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.147778 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.145201 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3fb21f61-b549-419a-87cb-195db9fae336-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.148601 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.148355 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e804423a-8c29-40a0-b798-4190c0c623a6-etc-tuned\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.150256 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.150235 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e804423a-8c29-40a0-b798-4190c0c623a6-tmp\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.151045 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.150921 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px9nq\" (UniqueName: \"kubernetes.io/projected/e804423a-8c29-40a0-b798-4190c0c623a6-kube-api-access-px9nq\") pod \"tuned-864b8\" (UID: \"e804423a-8c29-40a0-b798-4190c0c623a6\") " pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.153025 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.153005 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5479d\" (UniqueName: \"kubernetes.io/projected/b6d03a1d-30b1-4814-875b-dd2832235f5b-kube-api-access-5479d\") pod \"aws-ebs-csi-driver-node-xfrnm\" (UID: \"b6d03a1d-30b1-4814-875b-dd2832235f5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.153394 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.153371 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpb59\" (UniqueName: \"kubernetes.io/projected/9c08f534-bb6e-4c9a-b96e-9089b7dd7f13-kube-api-access-jpb59\") pod \"node-ca-5s8k9\" (UID: \"9c08f534-bb6e-4c9a-b96e-9089b7dd7f13\") " pod="openshift-image-registry/node-ca-5s8k9" Sep 11 03:00:44.154077 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.153874 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8jjx\" (UniqueName: \"kubernetes.io/projected/3826679d-a5dd-4ab3-9a8e-be0fb58a45b6-kube-api-access-d8jjx\") pod \"multus-8hbq6\" (UID: \"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6\") " pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.154280 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.154262 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e2b044a-7d10-4425-aafe-ca363dea77f6-agent-certs\") pod \"konnectivity-agent-kf2hz\" (UID: \"7e2b044a-7d10-4425-aafe-ca363dea77f6\") " pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:00:44.154499 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.154476 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntp5\" (UniqueName: \"kubernetes.io/projected/181a399f-574e-4669-a467-43fe5668e62d-kube-api-access-rntp5\") pod \"iptables-alerter-kb29j\" (UID: \"181a399f-574e-4669-a467-43fe5668e62d\") " pod="openshift-network-operator/iptables-alerter-kb29j" Sep 11 03:00:44.155730 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.155707 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7gkg\" (UniqueName: \"kubernetes.io/projected/3fb21f61-b549-419a-87cb-195db9fae336-kube-api-access-g7gkg\") pod \"multus-additional-cni-plugins-gk79t\" (UID: \"3fb21f61-b549-419a-87cb-195db9fae336\") " pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.244834 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.244799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-kubelet\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.244991 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.244845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-slash\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.244991 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.244874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fe5d4f81-2ac2-450d-bea5-cc07ef951b4f-hosts-file\") pod \"node-resolver-b6vc6\" (UID: \"fe5d4f81-2ac2-450d-bea5-cc07ef951b4f\") " pod="openshift-dns/node-resolver-b6vc6" Sep 11 03:00:44.244991 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.244889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-run-openvswitch\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.244991 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.244906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b83871-0cde-4f5f-82ea-041a73274b90-ovn-node-metrics-cert\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.244991 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.244922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j7xt\" (UniqueName: \"kubernetes.io/projected/53b83871-0cde-4f5f-82ea-041a73274b90-kube-api-access-4j7xt\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.244991 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.244939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-run-systemd\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.244991 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.244953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-node-log\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.244991 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.244970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:44.244991 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.244985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-log-socket\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-cni-bin\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-var-lib-openvswitch\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-etc-openvswitch\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe5d4f81-2ac2-450d-bea5-cc07ef951b4f-tmp-dir\") pod \"node-resolver-b6vc6\" (UID: \"fe5d4f81-2ac2-450d-bea5-cc07ef951b4f\") " pod="openshift-dns/node-resolver-b6vc6" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-systemd-units\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-run-ovn\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b83871-0cde-4f5f-82ea-041a73274b90-env-overrides\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmns2\" (UniqueName: \"kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2\") pod \"network-check-target-pv5qr\" (UID: \"281c0b4f-2a67-475a-8a24-ca7e2b78ad84\") " pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smmxc\" (UniqueName: \"kubernetes.io/projected/fe5d4f81-2ac2-450d-bea5-cc07ef951b4f-kube-api-access-smmxc\") pod \"node-resolver-b6vc6\" (UID: \"fe5d4f81-2ac2-450d-bea5-cc07ef951b4f\") " pod="openshift-dns/node-resolver-b6vc6" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-run-netns\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b83871-0cde-4f5f-82ea-041a73274b90-ovnkube-script-lib\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtxbp\" (UniqueName: \"kubernetes.io/projected/01cf8be0-13ee-435e-a356-1409d7acd0ff-kube-api-access-jtxbp\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-cni-netd\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.245496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b83871-0cde-4f5f-82ea-041a73274b90-ovnkube-config\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.246305 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.245994 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b83871-0cde-4f5f-82ea-041a73274b90-ovnkube-config\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.246305 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246069 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-kubelet\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.246305 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246112 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-slash\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.246305 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246163 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fe5d4f81-2ac2-450d-bea5-cc07ef951b4f-hosts-file\") pod \"node-resolver-b6vc6\" (UID: \"fe5d4f81-2ac2-450d-bea5-cc07ef951b4f\") " pod="openshift-dns/node-resolver-b6vc6" Sep 11 03:00:44.246305 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246200 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-run-openvswitch\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246661 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246709 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-systemd-units\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246661 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-run-ovn\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246793 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-run-netns\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246819 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe5d4f81-2ac2-450d-bea5-cc07ef951b4f-tmp-dir\") pod \"node-resolver-b6vc6\" (UID: \"fe5d4f81-2ac2-450d-bea5-cc07ef951b4f\") " pod="openshift-dns/node-resolver-b6vc6" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246869 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-cni-netd\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246919 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-log-socket\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246959 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-run-systemd\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.246978 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-var-lib-openvswitch\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.247000 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-node-log\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.247020 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-cni-bin\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.247063 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-etc-openvswitch\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.247073 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.247085 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b83871-0cde-4f5f-82ea-041a73274b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.247137 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs podName:01cf8be0-13ee-435e-a356-1409d7acd0ff nodeName:}" failed. No retries permitted until 2026-09-11 03:00:44.747120571 +0000 UTC m=+3.139241021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs") pod "network-metrics-daemon-k2wzg" (UID: "01cf8be0-13ee-435e-a356-1409d7acd0ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.247175 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b83871-0cde-4f5f-82ea-041a73274b90-env-overrides\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.247262 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.247210 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b83871-0cde-4f5f-82ea-041a73274b90-ovnkube-script-lib\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.249003 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.248981 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b83871-0cde-4f5f-82ea-041a73274b90-ovn-node-metrics-cert\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.255318 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.255286 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 03:00:44.255318 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.255317 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 03:00:44.255640 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.255333 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmns2 for pod openshift-network-diagnostics/network-check-target-pv5qr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:00:44.255640 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.255406 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2 podName:281c0b4f-2a67-475a-8a24-ca7e2b78ad84 nodeName:}" failed. No retries permitted until 2026-09-11 03:00:44.755387276 +0000 UTC m=+3.147507709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hmns2" (UniqueName: "kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2") pod "network-check-target-pv5qr" (UID: "281c0b4f-2a67-475a-8a24-ca7e2b78ad84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:00:44.257138 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.257107 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j7xt\" (UniqueName: \"kubernetes.io/projected/53b83871-0cde-4f5f-82ea-041a73274b90-kube-api-access-4j7xt\") pod \"ovnkube-node-vvdjq\" (UID: \"53b83871-0cde-4f5f-82ea-041a73274b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.259670 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.259568 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smmxc\" (UniqueName: \"kubernetes.io/projected/fe5d4f81-2ac2-450d-bea5-cc07ef951b4f-kube-api-access-smmxc\") pod \"node-resolver-b6vc6\" (UID: \"fe5d4f81-2ac2-450d-bea5-cc07ef951b4f\") " pod="openshift-dns/node-resolver-b6vc6" Sep 11 03:00:44.260572 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.260549 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtxbp\" (UniqueName: \"kubernetes.io/projected/01cf8be0-13ee-435e-a356-1409d7acd0ff-kube-api-access-jtxbp\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:44.329576 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.329488 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-864b8" Sep 11 03:00:44.335364 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.335327 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kb29j" Sep 11 03:00:44.342767 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:44.342735 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode804423a_8c29_40a0_b798_4190c0c623a6.slice/crio-2efaafd6795e67de50adc3a1ab34af7899bd48c8d546d769f0e87803b7b49558 WatchSource:0}: Error finding container 2efaafd6795e67de50adc3a1ab34af7899bd48c8d546d769f0e87803b7b49558: Status 404 returned error can't find the container with id 2efaafd6795e67de50adc3a1ab34af7899bd48c8d546d769f0e87803b7b49558 Sep 11 03:00:44.345804 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.345781 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:00:44.351645 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.351621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gk79t" Sep 11 03:00:44.358482 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.358460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" Sep 11 03:00:44.360351 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:44.360316 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181a399f_574e_4669_a467_43fe5668e62d.slice/crio-d74500616c2a7bfee7edfb53add081378548cd43d0c1523a44dfb350225e6d27 WatchSource:0}: Error finding container d74500616c2a7bfee7edfb53add081378548cd43d0c1523a44dfb350225e6d27: Status 404 returned error can't find the container with id d74500616c2a7bfee7edfb53add081378548cd43d0c1523a44dfb350225e6d27 Sep 11 03:00:44.366248 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.366062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5s8k9" Sep 11 03:00:44.366332 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:44.366270 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2b044a_7d10_4425_aafe_ca363dea77f6.slice/crio-4b82cdded49359234f5a81a835a7770030cd8874665f3455541a7445ddeaa0c3 WatchSource:0}: Error finding container 4b82cdded49359234f5a81a835a7770030cd8874665f3455541a7445ddeaa0c3: Status 404 returned error can't find the container with id 4b82cdded49359234f5a81a835a7770030cd8874665f3455541a7445ddeaa0c3 Sep 11 03:00:44.367339 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:44.367317 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb21f61_b549_419a_87cb_195db9fae336.slice/crio-cfbfff4b3091fd7651a5828513c199c64d504900076af75037ad79aab13f10cc WatchSource:0}: Error finding container cfbfff4b3091fd7651a5828513c199c64d504900076af75037ad79aab13f10cc: Status 404 returned error can't find the container with id cfbfff4b3091fd7651a5828513c199c64d504900076af75037ad79aab13f10cc Sep 11 03:00:44.374684 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.374665 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8hbq6" Sep 11 03:00:44.382263 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.382239 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:00:44.388717 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.388693 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b6vc6" Sep 11 03:00:44.407113 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.407089 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 03:00:44.648040 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.647961 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:44.648219 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.648089 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:44.648219 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.648149 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret podName:c19a616e-7c81-44d3-b76e-91b589f2247b nodeName:}" failed. No retries permitted until 2026-09-11 03:00:45.648134685 +0000 UTC m=+4.040255117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret") pod "global-pull-secret-syncer-bdsfj" (UID: "c19a616e-7c81-44d3-b76e-91b589f2247b") : object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:44.748703 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.748651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:44.748897 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.748832 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:44.748946 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.748899 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs podName:01cf8be0-13ee-435e-a356-1409d7acd0ff nodeName:}" failed. No retries permitted until 2026-09-11 03:00:45.748881794 +0000 UTC m=+4.141002245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs") pod "network-metrics-daemon-k2wzg" (UID: "01cf8be0-13ee-435e-a356-1409d7acd0ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:44.849760 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:44.849722 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmns2\" (UniqueName: \"kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2\") pod \"network-check-target-pv5qr\" (UID: \"281c0b4f-2a67-475a-8a24-ca7e2b78ad84\") " pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:44.849949 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.849880 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 03:00:44.849949 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.849902 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 03:00:44.849949 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.849915 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmns2 for pod openshift-network-diagnostics/network-check-target-pv5qr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:00:44.850095 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:44.849985 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2 podName:281c0b4f-2a67-475a-8a24-ca7e2b78ad84 nodeName:}" failed. No retries permitted until 2026-09-11 03:00:45.849967358 +0000 UTC m=+4.242087813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmns2" (UniqueName: "kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2") pod "network-check-target-pv5qr" (UID: "281c0b4f-2a67-475a-8a24-ca7e2b78ad84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:00:45.077513 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:45.077475 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 02:55:44 +0000 UTC" deadline="2028-06-03 08:28:38.81414009 +0000 UTC" Sep 11 03:00:45.077513 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:45.077503 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15149h27m53.736640847s" Sep 11 03:00:45.123907 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:45.123873 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d03a1d_30b1_4814_875b_dd2832235f5b.slice/crio-4b2bddad0d012d9600d2f5c77b27d2224858e7f3a5c2fd12a729d2184547d222 WatchSource:0}: Error finding container 4b2bddad0d012d9600d2f5c77b27d2224858e7f3a5c2fd12a729d2184547d222: Status 404 returned error can't find the container with id 4b2bddad0d012d9600d2f5c77b27d2224858e7f3a5c2fd12a729d2184547d222 Sep 11 03:00:45.132921 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:45.132901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:45.133019 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:45.133002 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:00:45.142530 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:45.142501 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" event={"ID":"b6d03a1d-30b1-4814-875b-dd2832235f5b","Type":"ContainerStarted","Data":"4b2bddad0d012d9600d2f5c77b27d2224858e7f3a5c2fd12a729d2184547d222"} Sep 11 03:00:45.143680 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:45.143658 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk79t" event={"ID":"3fb21f61-b549-419a-87cb-195db9fae336","Type":"ContainerStarted","Data":"cfbfff4b3091fd7651a5828513c199c64d504900076af75037ad79aab13f10cc"} Sep 11 03:00:45.144951 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:45.144928 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kf2hz" event={"ID":"7e2b044a-7d10-4425-aafe-ca363dea77f6","Type":"ContainerStarted","Data":"4b82cdded49359234f5a81a835a7770030cd8874665f3455541a7445ddeaa0c3"} Sep 11 03:00:45.146191 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:45.146170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kb29j" event={"ID":"181a399f-574e-4669-a467-43fe5668e62d","Type":"ContainerStarted","Data":"d74500616c2a7bfee7edfb53add081378548cd43d0c1523a44dfb350225e6d27"} Sep 11 03:00:45.147434 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:45.147411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-864b8" event={"ID":"e804423a-8c29-40a0-b798-4190c0c623a6","Type":"ContainerStarted","Data":"2efaafd6795e67de50adc3a1ab34af7899bd48c8d546d769f0e87803b7b49558"} Sep 11 03:00:45.561809 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:45.561776 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3826679d_a5dd_4ab3_9a8e_be0fb58a45b6.slice/crio-2c88b7cdd8e69f275535e07194b3a05487530f7fc68773ab06947cfc5308e83a WatchSource:0}: Error finding container 2c88b7cdd8e69f275535e07194b3a05487530f7fc68773ab06947cfc5308e83a: Status 404 returned error can't find the container with id 2c88b7cdd8e69f275535e07194b3a05487530f7fc68773ab06947cfc5308e83a Sep 11 03:00:45.565333 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:45.565305 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5d4f81_2ac2_450d_bea5_cc07ef951b4f.slice/crio-12b2766b81e6aef0218c067b06210f57156a5aad9b7bf6f2ec68dd5998f7c976 WatchSource:0}: Error finding container 12b2766b81e6aef0218c067b06210f57156a5aad9b7bf6f2ec68dd5998f7c976: Status 404 returned error can't find the container with id 12b2766b81e6aef0218c067b06210f57156a5aad9b7bf6f2ec68dd5998f7c976 Sep 11 03:00:45.565859 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:45.565833 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c08f534_bb6e_4c9a_b96e_9089b7dd7f13.slice/crio-f6688d2dc1a8ea740d990b1f6f60a19604420a5fc51fb101f8234f08c5c00e21 WatchSource:0}: Error finding container f6688d2dc1a8ea740d990b1f6f60a19604420a5fc51fb101f8234f08c5c00e21: Status 404 returned error can't find the container with id f6688d2dc1a8ea740d990b1f6f60a19604420a5fc51fb101f8234f08c5c00e21 Sep 11 03:00:45.569285 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:00:45.569089 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b83871_0cde_4f5f_82ea_041a73274b90.slice/crio-44de8ef1017916a668bb26bf372644ff31b692b7650f824ae0d20d69b8951bb2 WatchSource:0}: Error finding container 44de8ef1017916a668bb26bf372644ff31b692b7650f824ae0d20d69b8951bb2: Status 404 returned error can't find the container with id 44de8ef1017916a668bb26bf372644ff31b692b7650f824ae0d20d69b8951bb2 Sep 11 03:00:45.656273 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:45.656052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:45.656409 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:45.656234 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:45.656469 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:45.656414 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret podName:c19a616e-7c81-44d3-b76e-91b589f2247b nodeName:}" failed. No retries permitted until 2026-09-11 03:00:47.656389619 +0000 UTC m=+6.048510060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret") pod "global-pull-secret-syncer-bdsfj" (UID: "c19a616e-7c81-44d3-b76e-91b589f2247b") : object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:45.757679 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:45.757405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:45.757679 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:45.757620 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:45.757912 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:45.757702 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs podName:01cf8be0-13ee-435e-a356-1409d7acd0ff nodeName:}" failed. No retries permitted until 2026-09-11 03:00:47.757681157 +0000 UTC m=+6.149801603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs") pod "network-metrics-daemon-k2wzg" (UID: "01cf8be0-13ee-435e-a356-1409d7acd0ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:45.858810 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:45.858729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmns2\" (UniqueName: \"kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2\") pod \"network-check-target-pv5qr\" (UID: \"281c0b4f-2a67-475a-8a24-ca7e2b78ad84\") " pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:45.858945 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:45.858888 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 03:00:45.858945 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:45.858906 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 03:00:45.858945 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:45.858916 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmns2 for pod openshift-network-diagnostics/network-check-target-pv5qr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:00:45.859041 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:45.858970 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2 podName:281c0b4f-2a67-475a-8a24-ca7e2b78ad84 nodeName:}" failed. No retries permitted until 2026-09-11 03:00:47.858955798 +0000 UTC m=+6.251076231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmns2" (UniqueName: "kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2") pod "network-check-target-pv5qr" (UID: "281c0b4f-2a67-475a-8a24-ca7e2b78ad84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:00:46.078272 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.078201 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 02:55:44 +0000 UTC" deadline="2028-04-03 00:52:24.436744313 +0000 UTC" Sep 11 03:00:46.078272 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.078269 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13677h51m38.358478958s" Sep 11 03:00:46.134282 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.133733 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:46.134282 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:46.133870 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:00:46.134518 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.134432 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:46.134583 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:46.134553 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:00:46.153486 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.153075 2578 generic.go:356] "Generic (PLEG): container finished" podID="5251df6d6d13e895d3869fc5a6e732f6" containerID="4c3d01fe92f494e4192ccef47d4e81d079426ae279adfda076d1989bb6a018e5" exitCode=0 Sep 11 03:00:46.153486 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.153169 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" event={"ID":"5251df6d6d13e895d3869fc5a6e732f6","Type":"ContainerDied","Data":"4c3d01fe92f494e4192ccef47d4e81d079426ae279adfda076d1989bb6a018e5"} Sep 11 03:00:46.157172 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.157139 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5s8k9" event={"ID":"9c08f534-bb6e-4c9a-b96e-9089b7dd7f13","Type":"ContainerStarted","Data":"f6688d2dc1a8ea740d990b1f6f60a19604420a5fc51fb101f8234f08c5c00e21"} Sep 11 03:00:46.159539 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.159512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8hbq6" event={"ID":"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6","Type":"ContainerStarted","Data":"2c88b7cdd8e69f275535e07194b3a05487530f7fc68773ab06947cfc5308e83a"} Sep 11 03:00:46.162470 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.162443 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-232.ec2.internal" event={"ID":"cfb73c088fb2994699656a729ac976af","Type":"ContainerStarted","Data":"945c40aa71b39416d40ff789209aee2461aebdb403161672559afdaa77d27420"} Sep 11 03:00:46.164333 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.164305 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" event={"ID":"53b83871-0cde-4f5f-82ea-041a73274b90","Type":"ContainerStarted","Data":"44de8ef1017916a668bb26bf372644ff31b692b7650f824ae0d20d69b8951bb2"} Sep 11 03:00:46.168203 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.168177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b6vc6" event={"ID":"fe5d4f81-2ac2-450d-bea5-cc07ef951b4f","Type":"ContainerStarted","Data":"12b2766b81e6aef0218c067b06210f57156a5aad9b7bf6f2ec68dd5998f7c976"} Sep 11 03:00:46.183857 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:46.183804 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-232.ec2.internal" podStartSLOduration=3.183784219 podStartE2EDuration="3.183784219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:00:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:00:46.182925411 +0000 UTC m=+4.575045870" watchObservedRunningTime="2026-09-11 03:00:46.183784219 +0000 UTC m=+4.575904677" Sep 11 03:00:47.133723 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:47.133687 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:47.134410 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:47.133826 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:00:47.188780 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:47.188675 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" event={"ID":"5251df6d6d13e895d3869fc5a6e732f6","Type":"ContainerStarted","Data":"5304863205e1e2fc598146589eb1e25212bc9af9fd8c5d2482fe83f4353668f2"} Sep 11 03:00:47.673504 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:47.673456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:47.673703 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:47.673589 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:47.673703 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:47.673653 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret podName:c19a616e-7c81-44d3-b76e-91b589f2247b nodeName:}" failed. No retries permitted until 2026-09-11 03:00:51.673635973 +0000 UTC m=+10.065756406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret") pod "global-pull-secret-syncer-bdsfj" (UID: "c19a616e-7c81-44d3-b76e-91b589f2247b") : object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:47.773933 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:47.773884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:47.774136 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:47.774073 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:47.774266 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:47.774142 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs podName:01cf8be0-13ee-435e-a356-1409d7acd0ff nodeName:}" failed. No retries permitted until 2026-09-11 03:00:51.774121504 +0000 UTC m=+10.166241944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs") pod "network-metrics-daemon-k2wzg" (UID: "01cf8be0-13ee-435e-a356-1409d7acd0ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:47.874975 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:47.874936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmns2\" (UniqueName: \"kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2\") pod \"network-check-target-pv5qr\" (UID: \"281c0b4f-2a67-475a-8a24-ca7e2b78ad84\") " pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:47.875210 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:47.875117 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 03:00:47.875210 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:47.875137 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 03:00:47.875210 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:47.875150 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmns2 for pod openshift-network-diagnostics/network-check-target-pv5qr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:00:47.875400 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:47.875233 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2 podName:281c0b4f-2a67-475a-8a24-ca7e2b78ad84 nodeName:}" failed. No retries permitted until 2026-09-11 03:00:51.875212857 +0000 UTC m=+10.267333294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmns2" (UniqueName: "kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2") pod "network-check-target-pv5qr" (UID: "281c0b4f-2a67-475a-8a24-ca7e2b78ad84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:00:48.135939 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:48.134824 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:48.135939 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:48.134947 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:00:48.135939 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:48.135007 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:48.135939 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:48.135166 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:00:49.133857 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:49.133819 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:49.134043 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:49.133954 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:00:50.134963 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:50.134272 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:50.134963 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:50.134406 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:00:50.134963 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:50.134810 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:50.134963 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:50.134916 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:00:51.133709 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:51.133682 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:51.133871 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:51.133799 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:00:51.708697 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:51.708652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:51.709185 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:51.708860 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:51.709185 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:51.708927 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret podName:c19a616e-7c81-44d3-b76e-91b589f2247b nodeName:}" failed. No retries permitted until 2026-09-11 03:00:59.708908516 +0000 UTC m=+18.101028951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret") pod "global-pull-secret-syncer-bdsfj" (UID: "c19a616e-7c81-44d3-b76e-91b589f2247b") : object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:51.809656 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:51.809618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:51.809818 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:51.809801 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:51.809914 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:51.809876 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs podName:01cf8be0-13ee-435e-a356-1409d7acd0ff nodeName:}" failed. No retries permitted until 2026-09-11 03:00:59.809859704 +0000 UTC m=+18.201980136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs") pod "network-metrics-daemon-k2wzg" (UID: "01cf8be0-13ee-435e-a356-1409d7acd0ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:51.910717 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:51.910672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmns2\" (UniqueName: \"kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2\") pod \"network-check-target-pv5qr\" (UID: \"281c0b4f-2a67-475a-8a24-ca7e2b78ad84\") " pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:51.910895 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:51.910854 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 03:00:51.910895 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:51.910874 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 03:00:51.910895 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:51.910886 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmns2 for pod openshift-network-diagnostics/network-check-target-pv5qr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:00:51.911037 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:51.910945 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2 podName:281c0b4f-2a67-475a-8a24-ca7e2b78ad84 nodeName:}" failed. No retries permitted until 2026-09-11 03:00:59.910927283 +0000 UTC m=+18.303047717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmns2" (UniqueName: "kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2") pod "network-check-target-pv5qr" (UID: "281c0b4f-2a67-475a-8a24-ca7e2b78ad84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:00:52.138762 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:52.138726 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:52.138975 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:52.138953 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:00:52.139206 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:52.139187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:52.140112 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:52.140086 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:00:53.133678 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:53.133641 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:53.134045 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:53.133746 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:00:54.133688 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:54.133648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:54.134261 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:54.133786 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:00:54.134306 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:54.134283 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:54.134418 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:54.134391 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:00:55.133859 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:55.133827 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:55.134395 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:55.133956 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:00:56.134105 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:56.134022 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:56.134519 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:56.134194 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:00:56.134519 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:56.134231 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:56.134519 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:56.134329 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:00:57.133599 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:57.133570 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:57.133777 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:57.133672 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:00:58.133352 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:58.133320 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:58.133352 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:58.133336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:58.133851 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:58.133432 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:00:58.133851 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:58.133587 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:00:59.133243 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:59.133204 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:59.133455 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:59.133333 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:00:59.768915 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:59.768877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:00:59.769087 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:59.769038 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:59.769175 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:59.769121 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret podName:c19a616e-7c81-44d3-b76e-91b589f2247b nodeName:}" failed. No retries permitted until 2026-09-11 03:01:15.769099488 +0000 UTC m=+34.161219937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret") pod "global-pull-secret-syncer-bdsfj" (UID: "c19a616e-7c81-44d3-b76e-91b589f2247b") : object "kube-system"/"original-pull-secret" not registered Sep 11 03:00:59.869482 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:59.869393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:00:59.869631 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:59.869571 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:59.869695 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:59.869653 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs podName:01cf8be0-13ee-435e-a356-1409d7acd0ff nodeName:}" failed. No retries permitted until 2026-09-11 03:01:15.86963229 +0000 UTC m=+34.261752736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs") pod "network-metrics-daemon-k2wzg" (UID: "01cf8be0-13ee-435e-a356-1409d7acd0ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:00:59.970123 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:00:59.970075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmns2\" (UniqueName: \"kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2\") pod \"network-check-target-pv5qr\" (UID: \"281c0b4f-2a67-475a-8a24-ca7e2b78ad84\") " pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:00:59.970320 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:59.970258 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 03:00:59.970320 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:59.970282 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 03:00:59.970320 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:59.970294 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmns2 for pod openshift-network-diagnostics/network-check-target-pv5qr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:00:59.970467 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:00:59.970361 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2 podName:281c0b4f-2a67-475a-8a24-ca7e2b78ad84 nodeName:}" failed. No retries permitted until 2026-09-11 03:01:15.9703417 +0000 UTC m=+34.362462150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmns2" (UniqueName: "kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2") pod "network-check-target-pv5qr" (UID: "281c0b4f-2a67-475a-8a24-ca7e2b78ad84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:01:00.133978 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:00.133889 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:00.133978 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:00.133910 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:00.134470 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:00.134006 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:00.134470 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:00.134095 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:01.133863 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:01.133828 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:01.134031 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:01.133969 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:02.134488 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:02.134453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:02.134974 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:02.134561 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:02.134974 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:02.134586 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:02.134974 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:02.134698 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:03.132972 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:03.132938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:03.133201 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:03.133068 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:04.133202 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.132946 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:04.133709 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.132964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:04.133709 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:04.133291 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:04.133709 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:04.133393 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:04.221692 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.221664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kf2hz" event={"ID":"7e2b044a-7d10-4425-aafe-ca363dea77f6","Type":"ContainerStarted","Data":"dd7a3b8a4932ad447aae18802c1192d3dfcea37c2af0cf280c7f6c131f162dec"} Sep 11 03:01:04.223871 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.223844 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-864b8" event={"ID":"e804423a-8c29-40a0-b798-4190c0c623a6","Type":"ContainerStarted","Data":"32871af511ba6795512287e6cb7fb70e76e166ef78a281c00ac5d9fce3946896"} Sep 11 03:01:04.225604 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.225578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5s8k9" event={"ID":"9c08f534-bb6e-4c9a-b96e-9089b7dd7f13","Type":"ContainerStarted","Data":"49d1fcd1420821ebcd0ab797509e2ed5cbd82a1082cc0d3e54c6a7412aeb62ba"} Sep 11 03:01:04.227442 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.227418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8hbq6" event={"ID":"3826679d-a5dd-4ab3-9a8e-be0fb58a45b6","Type":"ContainerStarted","Data":"fda4e5056e16299f647143334d18c1b0f1b250d9a31f71aef46749a5d6b3c678"} Sep 11 03:01:04.229453 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.229431 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" event={"ID":"b6d03a1d-30b1-4814-875b-dd2832235f5b","Type":"ContainerStarted","Data":"76360cf12a564b1f088cb06059d826fc5bf87b76a8d475ecf1534eda0736e13d"} Sep 11 03:01:04.231057 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.231035 2578 generic.go:356] "Generic (PLEG): container finished" podID="3fb21f61-b549-419a-87cb-195db9fae336" containerID="28a35ef326d828347bc8723eeffc93eaf6ae567d261e907f613cabac244a0f08" exitCode=0 Sep 11 03:01:04.231160 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.231097 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk79t" event={"ID":"3fb21f61-b549-419a-87cb-195db9fae336","Type":"ContainerDied","Data":"28a35ef326d828347bc8723eeffc93eaf6ae567d261e907f613cabac244a0f08"} Sep 11 03:01:04.234933 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.234775 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" event={"ID":"53b83871-0cde-4f5f-82ea-041a73274b90","Type":"ContainerStarted","Data":"ab9a23812fa193764ee855ced7db63a0c8406cda3b9f97f186eecbdef1d48879"} Sep 11 03:01:04.234933 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.234871 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" event={"ID":"53b83871-0cde-4f5f-82ea-041a73274b90","Type":"ContainerStarted","Data":"8c3b012555a5dedc789fd58088b3f76dba9c62ad3c27c106081b4f203d50b6a3"} Sep 11 03:01:04.235094 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.234937 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" event={"ID":"53b83871-0cde-4f5f-82ea-041a73274b90","Type":"ContainerStarted","Data":"f8552be6c00aa7622f9ce37795e1fb42cb9facb54d9357fa0a8e3659947d3f07"} Sep 11 03:01:04.235094 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.234999 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" event={"ID":"53b83871-0cde-4f5f-82ea-041a73274b90","Type":"ContainerStarted","Data":"48320690892a60616c2f84c328604f5ddb106556a4fe01164c14627e67e5afc1"} Sep 11 03:01:04.237218 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.237187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b6vc6" event={"ID":"fe5d4f81-2ac2-450d-bea5-cc07ef951b4f","Type":"ContainerStarted","Data":"c0c3f7742b1242c26944dce9717e8a5dd9f44b9b322f72458e76b4128ac2ef2f"} Sep 11 03:01:04.239648 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.239614 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-232.ec2.internal" podStartSLOduration=21.239600506 podStartE2EDuration="21.239600506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:00:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:00:47.204037153 +0000 UTC m=+5.596157624" watchObservedRunningTime="2026-09-11 03:01:04.239600506 +0000 UTC m=+22.631720959" Sep 11 03:01:04.240051 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.240031 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kf2hz" podStartSLOduration=3.114184506 podStartE2EDuration="22.240024183s" totalImagesPullingTime="19.125839677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:04.23946543 +0000 UTC m=+22.631586087" watchObservedRunningTime="2026-09-11 03:01:04.240024183 +0000 UTC m=+22.632144638" Sep 11 03:01:04.276644 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.274498 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b6vc6" podStartSLOduration=4.3472231390000005 podStartE2EDuration="22.2744769s" totalImagesPullingTime="17.927253761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:04.272322924 +0000 UTC m=+22.664443397" watchObservedRunningTime="2026-09-11 03:01:04.2744769 +0000 UTC m=+22.666597356" Sep 11 03:01:04.276881 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.276825 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8hbq6" podStartSLOduration=3.683234858 podStartE2EDuration="22.276806876s" totalImagesPullingTime="18.593572018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:04.257334132 +0000 UTC m=+22.649454577" watchObservedRunningTime="2026-09-11 03:01:04.276806876 +0000 UTC m=+22.668927332" Sep 11 03:01:04.289983 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.289930 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5s8k9" podStartSLOduration=4.365123108 podStartE2EDuration="22.2899112s" totalImagesPullingTime="17.924788092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:04.28898968 +0000 UTC m=+22.681110135" watchObservedRunningTime="2026-09-11 03:01:04.2899112 +0000 UTC m=+22.682031657" Sep 11 03:01:04.332787 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.332732 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-864b8" podStartSLOduration=3.183335705 podStartE2EDuration="22.332713411s" totalImagesPullingTime="19.149377706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:04.308443221 +0000 UTC m=+22.700563675" watchObservedRunningTime="2026-09-11 03:01:04.332713411 +0000 UTC m=+22.724833866" Sep 11 03:01:04.400924 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.400891 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:04.483970 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:04.483927 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:05.133503 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:05.133480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:05.134074 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:05.133600 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:05.244283 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:05.244251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kb29j" event={"ID":"181a399f-574e-4669-a467-43fe5668e62d","Type":"ContainerStarted","Data":"63f4e43bdc37457087fccb5c2dd9506e29041aee6e6f46b8d1b7405c84cf3691"} Sep 11 03:01:05.248559 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:05.248530 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" event={"ID":"53b83871-0cde-4f5f-82ea-041a73274b90","Type":"ContainerStarted","Data":"fb9814d5755bf8914c6438dd686793e0ca86ae6fcd273ffaeaca9547fb8bb39f"} Sep 11 03:01:05.248666 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:05.248615 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" event={"ID":"53b83871-0cde-4f5f-82ea-041a73274b90","Type":"ContainerStarted","Data":"68ab92ab7b6e7c9b6bf7e6ba793877fc6348ccd9a630e32366233fbb0efd5109"} Sep 11 03:01:05.255886 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:05.255850 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 11 03:01:05.265719 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:05.265699 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:05.366067 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:05.366025 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:05.476701 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:05.476624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:05.567382 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:05.567348 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:06.109293 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:06.109192 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T03:01:05.255880011Z","UUID":"9dbd02b7-4d87-4c2a-9c56-c14ebbadc736","Handler":null,"Name":"","Endpoint":""} Sep 11 03:01:06.110920 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:06.110890 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 11 03:01:06.110920 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:06.110921 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 11 03:01:06.133635 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:06.133609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:06.134201 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:06.133609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:06.134201 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:06.133718 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:06.134201 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:06.133802 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:06.253959 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:06.253880 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" event={"ID":"b6d03a1d-30b1-4814-875b-dd2832235f5b","Type":"ContainerStarted","Data":"15dadd29b62d324397373c6994697079e009fb455cb875ff4e98bcb73b4ac401"} Sep 11 03:01:07.132905 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:07.132876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:07.133035 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:07.132976 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:07.259652 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:07.259612 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" event={"ID":"53b83871-0cde-4f5f-82ea-041a73274b90","Type":"ContainerStarted","Data":"889e610e34f60baff5a82ac668eb3f9004b95dcc60574846b9a00fb7fd631fed"} Sep 11 03:01:07.261515 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:07.261487 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" event={"ID":"b6d03a1d-30b1-4814-875b-dd2832235f5b","Type":"ContainerStarted","Data":"ee91750cb8d177f3288933030241a525b9511876bf055b34d10e32a772c13f3f"} Sep 11 03:01:07.277753 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:07.277659 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfrnm" podStartSLOduration=3.880792216 podStartE2EDuration="25.277639623s" totalImagesPullingTime="21.396847407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:07.277538799 +0000 UTC m=+25.669659268" watchObservedRunningTime="2026-09-11 03:01:07.277639623 +0000 UTC m=+25.669760078" Sep 11 03:01:07.278404 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:07.278365 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kb29j" podStartSLOduration=6.150009702 podStartE2EDuration="25.278353172s" totalImagesPullingTime="19.12834347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:05.263349344 +0000 UTC m=+23.655469799" watchObservedRunningTime="2026-09-11 03:01:07.278353172 +0000 UTC m=+25.670473626" Sep 11 03:01:08.133624 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:08.133589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:08.133804 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:08.133589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:08.133804 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:08.133738 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:08.133910 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:08.133810 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:09.095232 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:09.095197 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:01:09.096072 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:09.096052 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:01:09.133185 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:09.133133 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:09.133341 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:09.133274 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:09.267050 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:09.266857 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:01:09.267341 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:09.267322 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kf2hz" Sep 11 03:01:09.333511 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:09.333485 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:10.133182 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:10.133130 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:10.133557 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:10.133131 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:10.133557 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:10.133318 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:10.133557 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:10.133330 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:10.269529 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:10.269490 2578 generic.go:356] "Generic (PLEG): container finished" podID="3fb21f61-b549-419a-87cb-195db9fae336" containerID="d39f6c3b132224246b9b3292a91cfe5c83f027cc557fcd9ded4cd2bc1c5feedb" exitCode=0 Sep 11 03:01:10.269683 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:10.269560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk79t" event={"ID":"3fb21f61-b549-419a-87cb-195db9fae336","Type":"ContainerDied","Data":"d39f6c3b132224246b9b3292a91cfe5c83f027cc557fcd9ded4cd2bc1c5feedb"} Sep 11 03:01:10.274022 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:10.273984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" event={"ID":"53b83871-0cde-4f5f-82ea-041a73274b90","Type":"ContainerStarted","Data":"348b71a914a22dbb2c1b2e214054bac3627a2dcde36f34ec911833a0ad855023"} Sep 11 03:01:10.274277 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:10.274261 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:01:10.274381 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:10.274325 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:01:10.289845 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:10.289826 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:01:10.310931 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:10.310881 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" podStartSLOduration=10.074933098 podStartE2EDuration="28.310862739s" totalImagesPullingTime="18.235929641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:10.310112106 +0000 UTC m=+28.702232577" watchObservedRunningTime="2026-09-11 03:01:10.310862739 +0000 UTC m=+28.702983196" Sep 11 03:01:10.944704 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:10.944412 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:11.133292 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.133264 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:11.133708 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:11.133365 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:11.221138 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.221112 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bdsfj"] Sep 11 03:01:11.221263 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.221249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:11.221378 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:11.221359 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:11.221908 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.221883 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k2wzg"] Sep 11 03:01:11.222025 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.222013 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:11.222158 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:11.222125 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:11.232430 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.232402 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pv5qr"] Sep 11 03:01:11.276054 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.276029 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:11.277529 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.277508 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:01:11.278300 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:11.277759 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:11.292496 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.292476 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:01:11.363901 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.363861 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:11.458244 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.458122 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:11.622615 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.622588 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:11.691712 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.691679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:11.902175 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.902124 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:11.954135 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:11.954105 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:12.280551 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:12.280516 2578 generic.go:356] "Generic (PLEG): container finished" podID="3fb21f61-b549-419a-87cb-195db9fae336" containerID="5e268f1e11980df147f322224dcd7531c52890992668b1d81aa157b2da966f6e" exitCode=0 Sep 11 03:01:12.281219 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:12.280588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk79t" event={"ID":"3fb21f61-b549-419a-87cb-195db9fae336","Type":"ContainerDied","Data":"5e268f1e11980df147f322224dcd7531c52890992668b1d81aa157b2da966f6e"} Sep 11 03:01:12.506695 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:12.506654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:12.588984 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:12.588915 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b6vc6_fe5d4f81-2ac2-450d-bea5-cc07ef951b4f/dns-node-resolver/0.log" Sep 11 03:01:12.609578 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:12.609544 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:12.784049 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:12.784014 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:12.874818 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:12.874732 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:12.974538 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:12.974512 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:13.133055 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:13.132967 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:13.133271 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:13.133066 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:13.133271 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:13.133077 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:13.133271 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:13.132967 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:13.133271 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:13.133214 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:13.133447 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:13.133288 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:13.590557 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:13.590531 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5s8k9_9c08f534-bb6e-4c9a-b96e-9089b7dd7f13/node-ca/0.log" Sep 11 03:01:14.134178 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:14.134134 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:14.912648 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:14.912352 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:15.133553 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:15.133519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:15.133713 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:15.133608 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:15.133713 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:15.133612 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:15.133713 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:15.133636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:15.133875 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:15.133718 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:15.133875 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:15.133814 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:15.289529 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:15.289498 2578 generic.go:356] "Generic (PLEG): container finished" podID="3fb21f61-b549-419a-87cb-195db9fae336" containerID="01fe492169eb6ae9e19b8714858c28400f2effba8bf83b730ccd15cfccbe818d" exitCode=0 Sep 11 03:01:15.289658 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:15.289555 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk79t" event={"ID":"3fb21f61-b549-419a-87cb-195db9fae336","Type":"ContainerDied","Data":"01fe492169eb6ae9e19b8714858c28400f2effba8bf83b730ccd15cfccbe818d"} Sep 11 03:01:15.781604 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:15.781567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:15.781840 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:15.781718 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 03:01:15.781840 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:15.781780 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret podName:c19a616e-7c81-44d3-b76e-91b589f2247b nodeName:}" failed. No retries permitted until 2026-09-11 03:01:47.781765987 +0000 UTC m=+66.173886423 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret") pod "global-pull-secret-syncer-bdsfj" (UID: "c19a616e-7c81-44d3-b76e-91b589f2247b") : object "kube-system"/"original-pull-secret" not registered Sep 11 03:01:15.847780 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:15.847739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:15.882725 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:15.882698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:15.882850 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:15.882835 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:01:15.882901 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:15.882891 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs podName:01cf8be0-13ee-435e-a356-1409d7acd0ff nodeName:}" failed. No retries permitted until 2026-09-11 03:01:47.882878866 +0000 UTC m=+66.274999297 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs") pod "network-metrics-daemon-k2wzg" (UID: "01cf8be0-13ee-435e-a356-1409d7acd0ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 03:01:15.983899 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:15.983874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmns2\" (UniqueName: \"kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2\") pod \"network-check-target-pv5qr\" (UID: \"281c0b4f-2a67-475a-8a24-ca7e2b78ad84\") " pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:15.984237 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:15.983992 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 03:01:15.984237 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:15.984007 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 03:01:15.984237 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:15.984015 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmns2 for pod openshift-network-diagnostics/network-check-target-pv5qr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:01:15.984237 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:15.984060 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2 podName:281c0b4f-2a67-475a-8a24-ca7e2b78ad84 nodeName:}" failed. No retries permitted until 2026-09-11 03:01:47.984048714 +0000 UTC m=+66.376169147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmns2" (UniqueName: "kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2") pod "network-check-target-pv5qr" (UID: "281c0b4f-2a67-475a-8a24-ca7e2b78ad84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 03:01:17.133989 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:17.133942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:17.134439 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:17.133942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:17.134439 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:17.134064 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:17.134439 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:17.133942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:17.134439 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:17.134188 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:17.134439 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:17.134253 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:17.200836 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:17.200805 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:17.260621 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:17.260591 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:17.542689 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:17.542577 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:17.951009 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:17.950919 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:18.148984 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:18.148946 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:18.247671 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:18.247523 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:18.395254 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:18.395216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:18.765926 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:18.765886 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:19.133850 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:19.133761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:19.133850 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:19.133790 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:19.134073 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:19.133777 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:19.134073 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:19.133898 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:19.134073 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:19.133969 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:19.134073 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:19.134061 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:19.146227 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:19.146199 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:19.549205 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:19.549127 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:19.771050 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:19.771014 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:19.945743 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:19.945661 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:20.149329 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:20.149294 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:20.540579 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:20.540548 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:20.641894 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:20.641865 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" limit=1024 Sep 11 03:01:21.134006 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:21.133932 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:21.134166 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:21.134031 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:21.134166 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:21.134041 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:21.134166 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:21.134039 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:21.134166 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:21.134133 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:21.134301 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:21.134215 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:21.305873 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:21.305841 2578 generic.go:356] "Generic (PLEG): container finished" podID="3fb21f61-b549-419a-87cb-195db9fae336" containerID="e25f0a0a3e9f474258cddd75951216139ded6d4568c9d92ee8a56bd23593360a" exitCode=0 Sep 11 03:01:21.306028 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:21.305903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk79t" event={"ID":"3fb21f61-b549-419a-87cb-195db9fae336","Type":"ContainerDied","Data":"e25f0a0a3e9f474258cddd75951216139ded6d4568c9d92ee8a56bd23593360a"} Sep 11 03:01:22.311571 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:22.311539 2578 generic.go:356] "Generic (PLEG): container finished" podID="3fb21f61-b549-419a-87cb-195db9fae336" containerID="451071c057a640f78dff2e63201759258d8d91a32625185dd79021a20cb3437c" exitCode=0 Sep 11 03:01:22.311571 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:22.311575 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk79t" event={"ID":"3fb21f61-b549-419a-87cb-195db9fae336","Type":"ContainerDied","Data":"451071c057a640f78dff2e63201759258d8d91a32625185dd79021a20cb3437c"} Sep 11 03:01:23.133413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:23.133374 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:23.133580 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:23.133492 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:23.133580 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:23.133507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:23.133580 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:23.133510 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:23.133580 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:23.133565 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:23.133712 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:23.133646 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:23.316747 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:23.316715 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk79t" event={"ID":"3fb21f61-b549-419a-87cb-195db9fae336","Type":"ContainerStarted","Data":"a2011567c79f4455bf4ea8eeb2a2e972b4725be585e7ed65042e5a0c880acbe4"} Sep 11 03:01:23.336912 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:23.336866 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gk79t" podStartSLOduration=15.997273071 podStartE2EDuration="41.336850699s" totalImagesPullingTime="25.339577628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:23.336177866 +0000 UTC m=+41.728298329" watchObservedRunningTime="2026-09-11 03:01:23.336850699 +0000 UTC m=+41.728971153" Sep 11 03:01:25.133101 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:25.133073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:25.133505 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:25.133073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:25.133505 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:25.133198 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:25.133505 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:25.133073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:25.133505 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:25.133251 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:25.133505 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:25.133324 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:27.133531 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:27.133495 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:27.134001 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:27.133495 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:27.134001 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:27.133592 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:27.134001 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:27.133503 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:27.134001 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:27.133681 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:27.134001 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:27.133736 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:29.133945 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:29.133908 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:29.133945 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:29.133931 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:29.134428 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:29.134018 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:29.134428 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:29.134030 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:29.134428 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:29.134100 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:29.134428 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:29.134181 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:31.133426 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:31.133394 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:31.133848 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:31.133397 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:31.133848 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:31.133499 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:31.133848 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:31.133398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:31.133848 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:31.133562 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:31.133848 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:31.133638 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:33.133813 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:33.133779 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:33.134405 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:33.133782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:33.134405 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:33.133888 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:33.134405 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:33.133791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:33.134405 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:33.133953 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:33.134405 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:33.134010 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:35.133399 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:35.133370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:35.133399 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:35.133401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:35.133877 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:35.133456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:35.133877 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:35.133467 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:35.133877 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:35.133522 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:35.133877 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:35.133585 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:37.133864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:37.133833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:37.134312 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:37.133871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:37.134312 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:37.133922 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv5qr" podUID="281c0b4f-2a67-475a-8a24-ca7e2b78ad84" Sep 11 03:01:37.134312 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:37.134033 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2wzg" podUID="01cf8be0-13ee-435e-a356-1409d7acd0ff" Sep 11 03:01:37.134312 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:37.134058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:37.134312 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:37.134113 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdsfj" podUID="c19a616e-7c81-44d3-b76e-91b589f2247b" Sep 11 03:01:37.968696 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:37.968620 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-232.ec2.internal" event="NodeReady" Sep 11 03:01:37.968847 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:37.968728 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 11 03:01:38.000996 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.000963 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-857d77cbcb-87wq9"] Sep 11 03:01:38.002990 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.002964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.005032 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.005010 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 11 03:01:38.005171 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.005068 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 11 03:01:38.005171 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.005119 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 11 03:01:38.005283 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.005173 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2rmtr\"" Sep 11 03:01:38.010347 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.010166 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 11 03:01:38.014379 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.014362 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2tnk6"] Sep 11 03:01:38.016084 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.016068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.016948 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.016929 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-857d77cbcb-87wq9"] Sep 11 03:01:38.018059 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.018042 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 11 03:01:38.018210 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.018128 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 11 03:01:38.018284 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.018274 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 11 03:01:38.018342 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.018290 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 11 03:01:38.018342 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.018331 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ktqv2\"" Sep 11 03:01:38.020466 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.020450 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2nxht"] Sep 11 03:01:38.021974 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.021957 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2nxht" Sep 11 03:01:38.023917 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.023897 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 11 03:01:38.024045 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.024028 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 11 03:01:38.024164 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.024135 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tkkcb\"" Sep 11 03:01:38.024233 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.024210 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 11 03:01:38.026725 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.026707 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2tnk6"] Sep 11 03:01:38.033546 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.033528 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2nxht"] Sep 11 03:01:38.051592 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a75a9ee-a647-484c-bda2-af0bf15fd10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.051682 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a75a9ee-a647-484c-bda2-af0bf15fd10a-crio-socket\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.051682 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c43d652d-54bc-4b85-93c3-31fda5738b4d-cert\") pod \"ingress-canary-2nxht\" (UID: \"c43d652d-54bc-4b85-93c3-31fda5738b4d\") " pod="openshift-ingress-canary/ingress-canary-2nxht" Sep 11 03:01:38.051682 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f02fc9c9-6b42-4952-84c6-3d40268fff0e-trusted-ca\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.051799 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f02fc9c9-6b42-4952-84c6-3d40268fff0e-bound-sa-token\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.051799 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a75a9ee-a647-484c-bda2-af0bf15fd10a-data-volume\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.051799 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02fc9c9-6b42-4952-84c6-3d40268fff0e-registry-tls\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.051799 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a75a9ee-a647-484c-bda2-af0bf15fd10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.051799 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6t7q\" (UniqueName: \"kubernetes.io/projected/4a75a9ee-a647-484c-bda2-af0bf15fd10a-kube-api-access-l6t7q\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.051799 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq767\" (UniqueName: \"kubernetes.io/projected/c43d652d-54bc-4b85-93c3-31fda5738b4d-kube-api-access-cq767\") pod \"ingress-canary-2nxht\" (UID: \"c43d652d-54bc-4b85-93c3-31fda5738b4d\") " pod="openshift-ingress-canary/ingress-canary-2nxht" Sep 11 03:01:38.051799 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f02fc9c9-6b42-4952-84c6-3d40268fff0e-image-registry-private-configuration\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.052044 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f02fc9c9-6b42-4952-84c6-3d40268fff0e-registry-certificates\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.052044 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051903 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f02fc9c9-6b42-4952-84c6-3d40268fff0e-ca-trust-extracted\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.052044 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f02fc9c9-6b42-4952-84c6-3d40268fff0e-installation-pull-secrets\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.052044 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.051959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gfd9\" (UniqueName: \"kubernetes.io/projected/f02fc9c9-6b42-4952-84c6-3d40268fff0e-kube-api-access-8gfd9\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.117582 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.117551 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m74xm"] Sep 11 03:01:38.119752 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.119738 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.121823 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.121804 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 11 03:01:38.121966 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.121946 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 11 03:01:38.122021 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.121993 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kqttw\"" Sep 11 03:01:38.130848 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.130825 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m74xm"] Sep 11 03:01:38.152373 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f02fc9c9-6b42-4952-84c6-3d40268fff0e-ca-trust-extracted\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.152724 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f02fc9c9-6b42-4952-84c6-3d40268fff0e-installation-pull-secrets\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.152724 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gfd9\" (UniqueName: \"kubernetes.io/projected/f02fc9c9-6b42-4952-84c6-3d40268fff0e-kube-api-access-8gfd9\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.152724 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a75a9ee-a647-484c-bda2-af0bf15fd10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.152724 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fcf0c4-0268-4723-aa14-f929988cf4d8-config-volume\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.152724 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a75a9ee-a647-484c-bda2-af0bf15fd10a-crio-socket\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.152724 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhgcw\" (UniqueName: \"kubernetes.io/projected/e9fcf0c4-0268-4723-aa14-f929988cf4d8-kube-api-access-bhgcw\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.152724 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c43d652d-54bc-4b85-93c3-31fda5738b4d-cert\") pod \"ingress-canary-2nxht\" (UID: \"c43d652d-54bc-4b85-93c3-31fda5738b4d\") " pod="openshift-ingress-canary/ingress-canary-2nxht" Sep 11 03:01:38.152724 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152673 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a75a9ee-a647-484c-bda2-af0bf15fd10a-crio-socket\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.152724 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f02fc9c9-6b42-4952-84c6-3d40268fff0e-trusted-ca\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.152724 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f02fc9c9-6b42-4952-84c6-3d40268fff0e-bound-sa-token\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.153238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152729 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f02fc9c9-6b42-4952-84c6-3d40268fff0e-ca-trust-extracted\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.153238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a75a9ee-a647-484c-bda2-af0bf15fd10a-data-volume\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.153238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9fcf0c4-0268-4723-aa14-f929988cf4d8-tmp-dir\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.153238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02fc9c9-6b42-4952-84c6-3d40268fff0e-registry-tls\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.153238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a75a9ee-a647-484c-bda2-af0bf15fd10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.153238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6t7q\" (UniqueName: \"kubernetes.io/projected/4a75a9ee-a647-484c-bda2-af0bf15fd10a-kube-api-access-l6t7q\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.153238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fcf0c4-0268-4723-aa14-f929988cf4d8-metrics-tls\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.153238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq767\" (UniqueName: \"kubernetes.io/projected/c43d652d-54bc-4b85-93c3-31fda5738b4d-kube-api-access-cq767\") pod \"ingress-canary-2nxht\" (UID: \"c43d652d-54bc-4b85-93c3-31fda5738b4d\") " pod="openshift-ingress-canary/ingress-canary-2nxht" Sep 11 03:01:38.153238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152944 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f02fc9c9-6b42-4952-84c6-3d40268fff0e-image-registry-private-configuration\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.153238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.152975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f02fc9c9-6b42-4952-84c6-3d40268fff0e-registry-certificates\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.153238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.153069 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a75a9ee-a647-484c-bda2-af0bf15fd10a-data-volume\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.153912 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.153551 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a75a9ee-a647-484c-bda2-af0bf15fd10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.153912 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.153771 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f02fc9c9-6b42-4952-84c6-3d40268fff0e-trusted-ca\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.154343 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.154324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f02fc9c9-6b42-4952-84c6-3d40268fff0e-registry-certificates\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.157107 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.157080 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f02fc9c9-6b42-4952-84c6-3d40268fff0e-image-registry-private-configuration\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.157236 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.157123 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a75a9ee-a647-484c-bda2-af0bf15fd10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.157297 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.157239 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02fc9c9-6b42-4952-84c6-3d40268fff0e-registry-tls\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.157297 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.157286 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f02fc9c9-6b42-4952-84c6-3d40268fff0e-installation-pull-secrets\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.157384 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.157292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c43d652d-54bc-4b85-93c3-31fda5738b4d-cert\") pod \"ingress-canary-2nxht\" (UID: \"c43d652d-54bc-4b85-93c3-31fda5738b4d\") " pod="openshift-ingress-canary/ingress-canary-2nxht" Sep 11 03:01:38.162014 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.161988 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6t7q\" (UniqueName: \"kubernetes.io/projected/4a75a9ee-a647-484c-bda2-af0bf15fd10a-kube-api-access-l6t7q\") pod \"insights-runtime-extractor-2tnk6\" (UID: \"4a75a9ee-a647-484c-bda2-af0bf15fd10a\") " pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.162098 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.161991 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq767\" (UniqueName: \"kubernetes.io/projected/c43d652d-54bc-4b85-93c3-31fda5738b4d-kube-api-access-cq767\") pod \"ingress-canary-2nxht\" (UID: \"c43d652d-54bc-4b85-93c3-31fda5738b4d\") " pod="openshift-ingress-canary/ingress-canary-2nxht" Sep 11 03:01:38.162314 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.162299 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gfd9\" (UniqueName: \"kubernetes.io/projected/f02fc9c9-6b42-4952-84c6-3d40268fff0e-kube-api-access-8gfd9\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.162891 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.162875 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f02fc9c9-6b42-4952-84c6-3d40268fff0e-bound-sa-token\") pod \"image-registry-857d77cbcb-87wq9\" (UID: \"f02fc9c9-6b42-4952-84c6-3d40268fff0e\") " pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.253751 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.253724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fcf0c4-0268-4723-aa14-f929988cf4d8-config-volume\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.253882 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.253757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhgcw\" (UniqueName: \"kubernetes.io/projected/e9fcf0c4-0268-4723-aa14-f929988cf4d8-kube-api-access-bhgcw\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.253882 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.253783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9fcf0c4-0268-4723-aa14-f929988cf4d8-tmp-dir\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.253882 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.253802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fcf0c4-0268-4723-aa14-f929988cf4d8-metrics-tls\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.254071 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.254046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9fcf0c4-0268-4723-aa14-f929988cf4d8-tmp-dir\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.254354 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.254336 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fcf0c4-0268-4723-aa14-f929988cf4d8-config-volume\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.256307 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.256290 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9fcf0c4-0268-4723-aa14-f929988cf4d8-metrics-tls\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.265105 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.265085 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhgcw\" (UniqueName: \"kubernetes.io/projected/e9fcf0c4-0268-4723-aa14-f929988cf4d8-kube-api-access-bhgcw\") pod \"dns-default-m74xm\" (UID: \"e9fcf0c4-0268-4723-aa14-f929988cf4d8\") " pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.313117 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.313090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:38.324598 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.324574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2tnk6" Sep 11 03:01:38.332493 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.332474 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2nxht" Sep 11 03:01:38.427623 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.427597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:38.599631 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.599561 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2tnk6"] Sep 11 03:01:38.602893 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.602846 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-857d77cbcb-87wq9"] Sep 11 03:01:38.603190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:01:38.603166 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a75a9ee_a647_484c_bda2_af0bf15fd10a.slice/crio-c85b8cf54c5e74c05353487999dddda856f39fcbed90bda24d85f8a81fa98207 WatchSource:0}: Error finding container c85b8cf54c5e74c05353487999dddda856f39fcbed90bda24d85f8a81fa98207: Status 404 returned error can't find the container with id c85b8cf54c5e74c05353487999dddda856f39fcbed90bda24d85f8a81fa98207 Sep 11 03:01:38.605987 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:01:38.605967 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02fc9c9_6b42_4952_84c6_3d40268fff0e.slice/crio-05c786601a6e28663b58d14bafd4cd3a41917ea9b3042e4d57c49505351a12be WatchSource:0}: Error finding container 05c786601a6e28663b58d14bafd4cd3a41917ea9b3042e4d57c49505351a12be: Status 404 returned error can't find the container with id 05c786601a6e28663b58d14bafd4cd3a41917ea9b3042e4d57c49505351a12be Sep 11 03:01:38.630006 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.629980 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2nxht"] Sep 11 03:01:38.633002 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:01:38.632973 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43d652d_54bc_4b85_93c3_31fda5738b4d.slice/crio-f02cd1a57882456033774048c7ab73d3c7aac3d46dd20047d80247561ffb6da4 WatchSource:0}: Error finding container f02cd1a57882456033774048c7ab73d3c7aac3d46dd20047d80247561ffb6da4: Status 404 returned error can't find the container with id f02cd1a57882456033774048c7ab73d3c7aac3d46dd20047d80247561ffb6da4 Sep 11 03:01:38.697190 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:38.697164 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m74xm"] Sep 11 03:01:38.700237 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:01:38.700209 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9fcf0c4_0268_4723_aa14_f929988cf4d8.slice/crio-3146b606a332fd9b3406325ab53f3100a86f69701cf49b0527e794e53f15ba33 WatchSource:0}: Error finding container 3146b606a332fd9b3406325ab53f3100a86f69701cf49b0527e794e53f15ba33: Status 404 returned error can't find the container with id 3146b606a332fd9b3406325ab53f3100a86f69701cf49b0527e794e53f15ba33 Sep 11 03:01:39.133852 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.133816 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:39.134032 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.133822 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:39.134032 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.133831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:39.136830 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.136804 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 03:01:39.136830 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.136827 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2c4tf\"" Sep 11 03:01:39.137018 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.136891 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 03:01:39.137018 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.136906 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 03:01:39.137018 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.136938 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 03:01:39.137203 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.137188 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-27pmz\"" Sep 11 03:01:39.353332 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.353301 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2nxht" event={"ID":"c43d652d-54bc-4b85-93c3-31fda5738b4d","Type":"ContainerStarted","Data":"f02cd1a57882456033774048c7ab73d3c7aac3d46dd20047d80247561ffb6da4"} Sep 11 03:01:39.354738 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.354711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" event={"ID":"f02fc9c9-6b42-4952-84c6-3d40268fff0e","Type":"ContainerStarted","Data":"bcb8efc612a0da6dd6fd77511d653045f4018e323f427981981208487ab3f894"} Sep 11 03:01:39.354873 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.354757 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" event={"ID":"f02fc9c9-6b42-4952-84c6-3d40268fff0e","Type":"ContainerStarted","Data":"05c786601a6e28663b58d14bafd4cd3a41917ea9b3042e4d57c49505351a12be"} Sep 11 03:01:39.354873 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.354820 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:01:39.356310 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.356289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tnk6" event={"ID":"4a75a9ee-a647-484c-bda2-af0bf15fd10a","Type":"ContainerStarted","Data":"1b5af094f1c8e31ee1ea60756ab259af5f752d54ed7a746ff1a00ce6d4243d5b"} Sep 11 03:01:39.356408 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.356334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tnk6" event={"ID":"4a75a9ee-a647-484c-bda2-af0bf15fd10a","Type":"ContainerStarted","Data":"c85b8cf54c5e74c05353487999dddda856f39fcbed90bda24d85f8a81fa98207"} Sep 11 03:01:39.357248 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.357228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m74xm" event={"ID":"e9fcf0c4-0268-4723-aa14-f929988cf4d8","Type":"ContainerStarted","Data":"3146b606a332fd9b3406325ab53f3100a86f69701cf49b0527e794e53f15ba33"} Sep 11 03:01:39.374842 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:39.374746 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" podStartSLOduration=3.374732374 podStartE2EDuration="3.374732374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:01:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:39.374366669 +0000 UTC m=+57.766487134" watchObservedRunningTime="2026-09-11 03:01:39.374732374 +0000 UTC m=+57.766852871" Sep 11 03:01:40.361601 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:40.361568 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tnk6" event={"ID":"4a75a9ee-a647-484c-bda2-af0bf15fd10a","Type":"ContainerStarted","Data":"3e2c6b3897052334c25e8594e023830231f4021fded67d3b34993d375b67e5e5"} Sep 11 03:01:43.295769 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:43.295739 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvdjq" Sep 11 03:01:43.372809 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:43.372777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m74xm" event={"ID":"e9fcf0c4-0268-4723-aa14-f929988cf4d8","Type":"ContainerStarted","Data":"c4864458b631c98cae92fcb9775af75c0f3a13a5381f7b1a039a4ced20996a73"} Sep 11 03:01:43.374503 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:43.374477 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2nxht" event={"ID":"c43d652d-54bc-4b85-93c3-31fda5738b4d","Type":"ContainerStarted","Data":"e657913d343aaec748433c891c29e7861c025e0a3f99a6be11bc7f3a4c2d8136"} Sep 11 03:01:43.377226 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:43.377201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tnk6" event={"ID":"4a75a9ee-a647-484c-bda2-af0bf15fd10a","Type":"ContainerStarted","Data":"d73cd683315c5007f7349dac468ebc1da953e1cfc9acd7cb4d4b7fff37b26036"} Sep 11 03:01:43.389798 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:43.389648 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2nxht" podStartSLOduration=0.823794409 podStartE2EDuration="5.389629084s" totalImagesPullingTime="4.565834675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:43.389021431 +0000 UTC m=+61.781141913" watchObservedRunningTime="2026-09-11 03:01:43.389629084 +0000 UTC m=+61.781749540" Sep 11 03:01:43.407860 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:43.407814 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2tnk6" podStartSLOduration=1.925105962 podStartE2EDuration="6.407800305s" totalImagesPullingTime="4.482694343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:01:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:43.40759464 +0000 UTC m=+61.799715087" watchObservedRunningTime="2026-09-11 03:01:43.407800305 +0000 UTC m=+61.799920758" Sep 11 03:01:44.385474 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:44.385442 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m74xm" event={"ID":"e9fcf0c4-0268-4723-aa14-f929988cf4d8","Type":"ContainerStarted","Data":"3899a96ecb3244be8d77e856bf40ba46658eb175a2856eef8496f501ba202921"} Sep 11 03:01:44.385974 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:44.385684 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:44.401866 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:44.401819 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m74xm" podStartSLOduration=1.8982221030000002 podStartE2EDuration="6.401805967s" totalImagesPullingTime="4.503583864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:44.401798102 +0000 UTC m=+62.793918567" watchObservedRunningTime="2026-09-11 03:01:44.401805967 +0000 UTC m=+62.793926449" Sep 11 03:01:47.824324 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:47.824273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:47.826394 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:47.826374 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 03:01:47.837041 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:47.837014 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c19a616e-7c81-44d3-b76e-91b589f2247b-original-pull-secret\") pod \"global-pull-secret-syncer-bdsfj\" (UID: \"c19a616e-7c81-44d3-b76e-91b589f2247b\") " pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:47.853238 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:47.853213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdsfj" Sep 11 03:01:47.925607 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:47.925576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:47.927960 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:47.927940 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 03:01:47.938666 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:47.938643 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01cf8be0-13ee-435e-a356-1409d7acd0ff-metrics-certs\") pod \"network-metrics-daemon-k2wzg\" (UID: \"01cf8be0-13ee-435e-a356-1409d7acd0ff\") " pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:48.026372 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.026326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmns2\" (UniqueName: \"kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2\") pod \"network-check-target-pv5qr\" (UID: \"281c0b4f-2a67-475a-8a24-ca7e2b78ad84\") " pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:48.028663 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.028646 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 03:01:48.039184 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.039166 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 03:01:48.050474 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.050448 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmns2\" (UniqueName: \"kubernetes.io/projected/281c0b4f-2a67-475a-8a24-ca7e2b78ad84-kube-api-access-hmns2\") pod \"network-check-target-pv5qr\" (UID: \"281c0b4f-2a67-475a-8a24-ca7e2b78ad84\") " pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:48.121251 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.121176 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bdsfj"] Sep 11 03:01:48.124722 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:01:48.124701 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19a616e_7c81_44d3_b76e_91b589f2247b.slice/crio-97bbd0db549a61cb19de69c327cfba412cc19e5425cb47764929e8af2f35e0ad WatchSource:0}: Error finding container 97bbd0db549a61cb19de69c327cfba412cc19e5425cb47764929e8af2f35e0ad: Status 404 returned error can't find the container with id 97bbd0db549a61cb19de69c327cfba412cc19e5425cb47764929e8af2f35e0ad Sep 11 03:01:48.145547 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.145528 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2c4tf\"" Sep 11 03:01:48.151040 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.151020 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-27pmz\"" Sep 11 03:01:48.154368 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.154354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2wzg" Sep 11 03:01:48.159973 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.159952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:48.398995 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.398910 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bdsfj" event={"ID":"c19a616e-7c81-44d3-b76e-91b589f2247b","Type":"ContainerStarted","Data":"97bbd0db549a61cb19de69c327cfba412cc19e5425cb47764929e8af2f35e0ad"} Sep 11 03:01:48.428100 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.428071 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k2wzg"] Sep 11 03:01:48.432128 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:01:48.432101 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01cf8be0_13ee_435e_a356_1409d7acd0ff.slice/crio-a8ace872e57fcab0769cd8a253813125c08e0ad41e3d661be69bf87a5c41fec6 WatchSource:0}: Error finding container a8ace872e57fcab0769cd8a253813125c08e0ad41e3d661be69bf87a5c41fec6: Status 404 returned error can't find the container with id a8ace872e57fcab0769cd8a253813125c08e0ad41e3d661be69bf87a5c41fec6 Sep 11 03:01:48.433975 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:48.433953 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pv5qr"] Sep 11 03:01:48.436684 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:01:48.436662 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod281c0b4f_2a67_475a_8a24_ca7e2b78ad84.slice/crio-c3506b695372d27a5a4713b53b55a1bd0b7d7ee8fa5ca5460b5ef1ba2676f9c2 WatchSource:0}: Error finding container c3506b695372d27a5a4713b53b55a1bd0b7d7ee8fa5ca5460b5ef1ba2676f9c2: Status 404 returned error can't find the container with id c3506b695372d27a5a4713b53b55a1bd0b7d7ee8fa5ca5460b5ef1ba2676f9c2 Sep 11 03:01:49.123192 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.123161 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9"] Sep 11 03:01:49.125310 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.125289 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.127345 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.127323 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 11 03:01:49.128308 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.128288 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 11 03:01:49.128438 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.128416 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 11 03:01:49.128660 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.128636 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rtr6z\"" Sep 11 03:01:49.128765 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.128669 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 11 03:01:49.129673 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.129014 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 11 03:01:49.135769 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.135747 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9"] Sep 11 03:01:49.233867 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.233839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/668804ba-29c8-4c24-972a-12b7308ab065-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.233867 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.233870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qszcp\" (UniqueName: \"kubernetes.io/projected/668804ba-29c8-4c24-972a-12b7308ab065-kube-api-access-qszcp\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.234126 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.233897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/668804ba-29c8-4c24-972a-12b7308ab065-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.234126 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.233929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/668804ba-29c8-4c24-972a-12b7308ab065-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.334987 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.334952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/668804ba-29c8-4c24-972a-12b7308ab065-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.334987 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.334987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qszcp\" (UniqueName: \"kubernetes.io/projected/668804ba-29c8-4c24-972a-12b7308ab065-kube-api-access-qszcp\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.335266 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.335010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/668804ba-29c8-4c24-972a-12b7308ab065-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.335266 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.335038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/668804ba-29c8-4c24-972a-12b7308ab065-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.335266 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:49.335178 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 11 03:01:49.335266 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:49.335265 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/668804ba-29c8-4c24-972a-12b7308ab065-prometheus-operator-tls podName:668804ba-29c8-4c24-972a-12b7308ab065 nodeName:}" failed. No retries permitted until 2026-09-11 03:01:49.835245656 +0000 UTC m=+68.227366091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/668804ba-29c8-4c24-972a-12b7308ab065-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-pg8g9" (UID: "668804ba-29c8-4c24-972a-12b7308ab065") : secret "prometheus-operator-tls" not found Sep 11 03:01:49.335771 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.335752 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/668804ba-29c8-4c24-972a-12b7308ab065-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.337773 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.337745 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/668804ba-29c8-4c24-972a-12b7308ab065-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.345930 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.345905 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qszcp\" (UniqueName: \"kubernetes.io/projected/668804ba-29c8-4c24-972a-12b7308ab065-kube-api-access-qszcp\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.403991 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.403908 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k2wzg" event={"ID":"01cf8be0-13ee-435e-a356-1409d7acd0ff","Type":"ContainerStarted","Data":"a8ace872e57fcab0769cd8a253813125c08e0ad41e3d661be69bf87a5c41fec6"} Sep 11 03:01:49.405274 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.405214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pv5qr" event={"ID":"281c0b4f-2a67-475a-8a24-ca7e2b78ad84","Type":"ContainerStarted","Data":"c3506b695372d27a5a4713b53b55a1bd0b7d7ee8fa5ca5460b5ef1ba2676f9c2"} Sep 11 03:01:49.845280 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.844799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/668804ba-29c8-4c24-972a-12b7308ab065-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:49.849443 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:49.849406 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/668804ba-29c8-4c24-972a-12b7308ab065-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-pg8g9\" (UID: \"668804ba-29c8-4c24-972a-12b7308ab065\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:50.037512 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:50.037473 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" Sep 11 03:01:50.339038 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:50.339011 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9"] Sep 11 03:01:50.342393 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:01:50.342362 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668804ba_29c8_4c24_972a_12b7308ab065.slice/crio-0898c1c5098b8cfef2cc1ab6cd1e0f2f0bfe8a45944a5466a7389b8ff6958365 WatchSource:0}: Error finding container 0898c1c5098b8cfef2cc1ab6cd1e0f2f0bfe8a45944a5466a7389b8ff6958365: Status 404 returned error can't find the container with id 0898c1c5098b8cfef2cc1ab6cd1e0f2f0bfe8a45944a5466a7389b8ff6958365 Sep 11 03:01:50.411231 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:50.411133 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" event={"ID":"668804ba-29c8-4c24-972a-12b7308ab065","Type":"ContainerStarted","Data":"0898c1c5098b8cfef2cc1ab6cd1e0f2f0bfe8a45944a5466a7389b8ff6958365"} Sep 11 03:01:50.413310 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:50.413274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k2wzg" event={"ID":"01cf8be0-13ee-435e-a356-1409d7acd0ff","Type":"ContainerStarted","Data":"70aab7162afaa75f3d4421c780d4ae06bfe1d502359a902801c4aeec7bd59c9a"} Sep 11 03:01:50.413432 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:50.413329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k2wzg" event={"ID":"01cf8be0-13ee-435e-a356-1409d7acd0ff","Type":"ContainerStarted","Data":"9fe15fce4dca83df71f5702c2baa6f71e01bd39fbaa1ccb3c7a1ab68dac624d9"} Sep 11 03:01:50.429844 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:50.429796 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k2wzg" podStartSLOduration=66.770957614 podStartE2EDuration="1m8.429780158s" totalImagesPullingTime="1.658822544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:50.429261587 +0000 UTC m=+68.821382064" watchObservedRunningTime="2026-09-11 03:01:50.429780158 +0000 UTC m=+68.821900602" Sep 11 03:01:52.424554 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:52.424516 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pv5qr" event={"ID":"281c0b4f-2a67-475a-8a24-ca7e2b78ad84","Type":"ContainerStarted","Data":"83e8e4063a3410b9e19f6858070115ba5a862adb8961dbe58b4cf649eb38bb58"} Sep 11 03:01:52.425168 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:52.424681 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:01:52.439483 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:52.439265 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pv5qr" podStartSLOduration=67.270825858 podStartE2EDuration="1m10.43924626s" totalImagesPullingTime="3.168420402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:52.438294158 +0000 UTC m=+70.830414637" watchObservedRunningTime="2026-09-11 03:01:52.43924626 +0000 UTC m=+70.831366715" Sep 11 03:01:53.430415 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:53.430371 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" event={"ID":"668804ba-29c8-4c24-972a-12b7308ab065","Type":"ContainerStarted","Data":"9920d38304feed96b81db25a940b0ca32d679f4d2d325924b7fffcc8b2159ccf"} Sep 11 03:01:53.430866 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:53.430471 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" event={"ID":"668804ba-29c8-4c24-972a-12b7308ab065","Type":"ContainerStarted","Data":"fdf05269c8c0ad9bb51d784490349facbf15a556fa3482e8e77fd8190903af04"} Sep 11 03:01:53.446329 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:53.446282 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pg8g9" podStartSLOduration=1.9367160129999998 podStartE2EDuration="4.446264209s" totalImagesPullingTime="2.509548196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:53.445038485 +0000 UTC m=+71.837158952" watchObservedRunningTime="2026-09-11 03:01:53.446264209 +0000 UTC m=+71.838384664" Sep 11 03:01:54.391315 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:54.391283 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m74xm" Sep 11 03:01:55.439998 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.439965 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bdsfj" event={"ID":"c19a616e-7c81-44d3-b76e-91b589f2247b","Type":"ContainerStarted","Data":"7c7a278821a20a02dc9e98071bee81b375e7c2b9a0837cf791e668a088baf136"} Sep 11 03:01:55.463375 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.463317 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bdsfj" podStartSLOduration=67.016330688 podStartE2EDuration="1m13.463298512s" totalImagesPullingTime="6.446967824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:55.463026024 +0000 UTC m=+73.855146480" watchObservedRunningTime="2026-09-11 03:01:55.463298512 +0000 UTC m=+73.855418966" Sep 11 03:01:55.555593 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.555560 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc"] Sep 11 03:01:55.557762 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.557747 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.559649 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.559616 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 11 03:01:55.559761 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.559704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fm8qv\"" Sep 11 03:01:55.560237 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.560218 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 11 03:01:55.569336 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.569317 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc"] Sep 11 03:01:55.584154 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.584128 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c4jhb"] Sep 11 03:01:55.586420 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.586398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.588479 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.588458 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5st24\"" Sep 11 03:01:55.588479 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.588471 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 11 03:01:55.588617 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.588460 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 11 03:01:55.588617 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.588526 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 11 03:01:55.686735 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.686706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d3c667c-099f-42fb-a3ea-f99aa836fed4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.686735 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.686738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a78ba393-eda0-4d6a-9c06-4d862b1ee868-sys\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.686948 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.686760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a78ba393-eda0-4d6a-9c06-4d862b1ee868-root\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.686948 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.686775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-wtmp\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.686948 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.686793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dgh5\" (UniqueName: \"kubernetes.io/projected/9d3c667c-099f-42fb-a3ea-f99aa836fed4-kube-api-access-8dgh5\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.686948 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.686808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.686948 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.686898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a78ba393-eda0-4d6a-9c06-4d862b1ee868-metrics-client-ca\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.686948 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.686926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d3c667c-099f-42fb-a3ea-f99aa836fed4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.687137 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.686951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-tls\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.687137 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.687003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-accelerators-collector-config\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.687137 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.687028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d3c667c-099f-42fb-a3ea-f99aa836fed4-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.687137 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.687048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-textfile\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.687137 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.687065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnfxf\" (UniqueName: \"kubernetes.io/projected/a78ba393-eda0-4d6a-9c06-4d862b1ee868-kube-api-access-cnfxf\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.787754 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.787720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d3c667c-099f-42fb-a3ea-f99aa836fed4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.787909 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.787757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a78ba393-eda0-4d6a-9c06-4d862b1ee868-sys\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.787909 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.787789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a78ba393-eda0-4d6a-9c06-4d862b1ee868-root\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.787909 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.787841 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a78ba393-eda0-4d6a-9c06-4d862b1ee868-root\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.787909 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.787846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a78ba393-eda0-4d6a-9c06-4d862b1ee868-sys\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.787909 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:55.787879 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 11 03:01:55.788101 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:55.787937 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d3c667c-099f-42fb-a3ea-f99aa836fed4-openshift-state-metrics-tls podName:9d3c667c-099f-42fb-a3ea-f99aa836fed4 nodeName:}" failed. No retries permitted until 2026-09-11 03:01:56.28791642 +0000 UTC m=+74.680036852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9d3c667c-099f-42fb-a3ea-f99aa836fed4-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-8pgxc" (UID: "9d3c667c-099f-42fb-a3ea-f99aa836fed4") : secret "openshift-state-metrics-tls" not found Sep 11 03:01:55.788101 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.787884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-wtmp\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.788101 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.787963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dgh5\" (UniqueName: \"kubernetes.io/projected/9d3c667c-099f-42fb-a3ea-f99aa836fed4-kube-api-access-8dgh5\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.788101 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.787964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-wtmp\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.788101 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.787988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.788101 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.788012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a78ba393-eda0-4d6a-9c06-4d862b1ee868-metrics-client-ca\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.788101 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.788031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d3c667c-099f-42fb-a3ea-f99aa836fed4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.788476 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.788100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-tls\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.788476 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.788191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-accelerators-collector-config\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.788476 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.788230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d3c667c-099f-42fb-a3ea-f99aa836fed4-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.788476 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.788267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-textfile\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.788476 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.788298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnfxf\" (UniqueName: \"kubernetes.io/projected/a78ba393-eda0-4d6a-9c06-4d862b1ee868-kube-api-access-cnfxf\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.788773 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.788748 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-accelerators-collector-config\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.788833 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.788748 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a78ba393-eda0-4d6a-9c06-4d862b1ee868-metrics-client-ca\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.788833 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.788800 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-textfile\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.789228 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.789207 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d3c667c-099f-42fb-a3ea-f99aa836fed4-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.790487 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.790468 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.790989 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.790972 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d3c667c-099f-42fb-a3ea-f99aa836fed4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.791064 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.790980 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a78ba393-eda0-4d6a-9c06-4d862b1ee868-node-exporter-tls\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.801016 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.800993 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dgh5\" (UniqueName: \"kubernetes.io/projected/9d3c667c-099f-42fb-a3ea-f99aa836fed4-kube-api-access-8dgh5\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:55.804277 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.804251 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnfxf\" (UniqueName: \"kubernetes.io/projected/a78ba393-eda0-4d6a-9c06-4d862b1ee868-kube-api-access-cnfxf\") pod \"node-exporter-c4jhb\" (UID: \"a78ba393-eda0-4d6a-9c06-4d862b1ee868\") " pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.894631 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:55.894601 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c4jhb" Sep 11 03:01:55.904483 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:01:55.904459 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78ba393_eda0_4d6a_9c06_4d862b1ee868.slice/crio-3782bfe85c489d3f0ad5716d41a1c932da4607f17f7f1d3bcd10b53ecddee7ac WatchSource:0}: Error finding container 3782bfe85c489d3f0ad5716d41a1c932da4607f17f7f1d3bcd10b53ecddee7ac: Status 404 returned error can't find the container with id 3782bfe85c489d3f0ad5716d41a1c932da4607f17f7f1d3bcd10b53ecddee7ac Sep 11 03:01:56.292646 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.292611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d3c667c-099f-42fb-a3ea-f99aa836fed4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:56.295063 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.295045 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d3c667c-099f-42fb-a3ea-f99aa836fed4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-8pgxc\" (UID: \"9d3c667c-099f-42fb-a3ea-f99aa836fed4\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:56.444639 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.444589 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c4jhb" event={"ID":"a78ba393-eda0-4d6a-9c06-4d862b1ee868","Type":"ContainerStarted","Data":"3782bfe85c489d3f0ad5716d41a1c932da4607f17f7f1d3bcd10b53ecddee7ac"} Sep 11 03:01:56.466421 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.466387 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" Sep 11 03:01:56.585261 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.585185 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 03:01:56.589468 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.588041 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.590465 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.590441 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l7m9g\"" Sep 11 03:01:56.590881 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.590845 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 11 03:01:56.591133 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.591114 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 11 03:01:56.591226 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.591207 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 11 03:01:56.591800 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.591521 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 11 03:01:56.591800 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.591650 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 11 03:01:56.591800 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.591656 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 11 03:01:56.591800 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.591782 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 11 03:01:56.591800 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.591783 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 11 03:01:56.592463 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.592442 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 11 03:01:56.610475 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.610448 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 03:01:56.697066 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-web-config\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697066 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697289 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697289 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697289 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697175 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697289 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697289 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697488 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27b66\" (UniqueName: \"kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-kube-api-access-27b66\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697488 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697355 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697488 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-out\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697488 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697643 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.697643 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.697522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.739490 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.739462 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc"] Sep 11 03:01:56.798640 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.798804 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.798804 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.798804 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.798804 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.798804 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.798804 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27b66\" (UniqueName: \"kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-kube-api-access-27b66\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.798804 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.799174 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-out\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.799174 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.799174 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.799174 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.799174 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.798921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-web-config\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.799574 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:01:56.799555 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-trusted-ca-bundle podName:bbf162ad-f1a1-4428-b0c3-acf683cb0344 nodeName:}" failed. No retries permitted until 2026-09-11 03:01:57.299529541 +0000 UTC m=+75.691649987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344") : configmap references non-existent config key: ca-bundle.crt Sep 11 03:01:56.800901 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.800873 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.801089 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.801068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.802589 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.802546 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-out\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.803077 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.803046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.803934 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.803729 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.803934 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.803891 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.804224 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.804083 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.804744 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.804722 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.804853 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.804821 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-web-config\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.805162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.805128 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.805453 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.805433 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.807831 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:56.807811 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27b66\" (UniqueName: \"kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-kube-api-access-27b66\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:56.934961 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:01:56.934891 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3c667c_099f_42fb_a3ea_f99aa836fed4.slice/crio-882b3387cc683605ae2a91db82ef35b770fd79e523778ea8a74927ab9b19e5c0 WatchSource:0}: Error finding container 882b3387cc683605ae2a91db82ef35b770fd79e523778ea8a74927ab9b19e5c0: Status 404 returned error can't find the container with id 882b3387cc683605ae2a91db82ef35b770fd79e523778ea8a74927ab9b19e5c0 Sep 11 03:01:57.303631 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:57.303601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:57.304425 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:57.304403 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:57.449891 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:57.449852 2578 generic.go:356] "Generic (PLEG): container finished" podID="a78ba393-eda0-4d6a-9c06-4d862b1ee868" containerID="2a2fb8efa1cbde294011be63ba9c5acb7de4ac258a88e7ef976409fc9eb7eded" exitCode=0 Sep 11 03:01:57.450377 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:57.449923 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c4jhb" event={"ID":"a78ba393-eda0-4d6a-9c06-4d862b1ee868","Type":"ContainerDied","Data":"2a2fb8efa1cbde294011be63ba9c5acb7de4ac258a88e7ef976409fc9eb7eded"} Sep 11 03:01:57.451862 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:57.451833 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" event={"ID":"9d3c667c-099f-42fb-a3ea-f99aa836fed4","Type":"ContainerStarted","Data":"eb459123fa4801a404fb017b2df57efc46bba85ca6e1178d33b262f8be89eb98"} Sep 11 03:01:57.451952 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:57.451875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" event={"ID":"9d3c667c-099f-42fb-a3ea-f99aa836fed4","Type":"ContainerStarted","Data":"6071ebfad3c6722265b34642384a5132da2223610e79a6b8b42e68a340d1f906"} Sep 11 03:01:57.451952 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:57.451893 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" event={"ID":"9d3c667c-099f-42fb-a3ea-f99aa836fed4","Type":"ContainerStarted","Data":"882b3387cc683605ae2a91db82ef35b770fd79e523778ea8a74927ab9b19e5c0"} Sep 11 03:01:57.501242 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:57.501216 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:01:57.787713 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:57.787682 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 03:01:57.791190 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:01:57.791159 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf162ad_f1a1_4428_b0c3_acf683cb0344.slice/crio-b1086d06010b10c4d91497825219dd0c4a8c7824a6fb0417a575a93ee05fbe7c WatchSource:0}: Error finding container b1086d06010b10c4d91497825219dd0c4a8c7824a6fb0417a575a93ee05fbe7c: Status 404 returned error can't find the container with id b1086d06010b10c4d91497825219dd0c4a8c7824a6fb0417a575a93ee05fbe7c Sep 11 03:01:58.318657 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:58.318571 2578 patch_prober.go:28] interesting pod/image-registry-857d77cbcb-87wq9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 11 03:01:58.318657 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:58.318624 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" podUID="f02fc9c9-6b42-4952-84c6-3d40268fff0e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 11 03:01:58.457566 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:58.457533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerStarted","Data":"b1086d06010b10c4d91497825219dd0c4a8c7824a6fb0417a575a93ee05fbe7c"} Sep 11 03:01:58.460446 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:58.460415 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c4jhb" event={"ID":"a78ba393-eda0-4d6a-9c06-4d862b1ee868","Type":"ContainerStarted","Data":"b058f33bb6ad228529cf640966bc582b034944f1d1b14b9a40a25ba855e85c22"} Sep 11 03:01:58.460576 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:58.460471 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c4jhb" event={"ID":"a78ba393-eda0-4d6a-9c06-4d862b1ee868","Type":"ContainerStarted","Data":"0f6ab35625b3e898f8ffda2a58eea3b2b54d8d4094cb0375a7aeb3b388ee807b"} Sep 11 03:01:58.463178 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:58.463124 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" event={"ID":"9d3c667c-099f-42fb-a3ea-f99aa836fed4","Type":"ContainerStarted","Data":"f3270e03bd4adb231c29117d505b058555ee79b64fdbb23732c932b1dc7de4e2"} Sep 11 03:01:58.482818 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:58.482758 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c4jhb" podStartSLOduration=2.34886308 podStartE2EDuration="3.482741165s" totalImagesPullingTime="1.057754317s" totalInitContainerRuntime="76.123768ms" isStatefulPod=true podCreationTimestamp="2026-09-11 03:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:58.482635919 +0000 UTC m=+76.874756397" watchObservedRunningTime="2026-09-11 03:01:58.482741165 +0000 UTC m=+76.874861620" Sep 11 03:01:58.500183 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:58.500125 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8pgxc" podStartSLOduration=2.540366863 podStartE2EDuration="3.500105051s" totalImagesPullingTime="959.738188ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 03:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:01:58.498971078 +0000 UTC m=+76.891091544" watchObservedRunningTime="2026-09-11 03:01:58.500105051 +0000 UTC m=+76.892225505" Sep 11 03:01:59.468976 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:59.468941 2578 generic.go:356] "Generic (PLEG): container finished" podID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerID="f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac" exitCode=0 Sep 11 03:01:59.469406 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:01:59.469035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerDied","Data":"f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac"} Sep 11 03:02:00.368169 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:00.368119 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-857d77cbcb-87wq9" Sep 11 03:02:01.481572 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.481489 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerStarted","Data":"ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a"} Sep 11 03:02:01.481572 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.481557 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerStarted","Data":"1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653"} Sep 11 03:02:01.481939 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.481592 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerStarted","Data":"f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0"} Sep 11 03:02:01.481939 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.481619 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerStarted","Data":"2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131"} Sep 11 03:02:01.481939 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.481642 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerStarted","Data":"971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b"} Sep 11 03:02:01.735255 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.735163 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 03:02:01.738542 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.738510 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.742310 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.742289 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 03:02:01.742464 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.742289 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6ordauo3eerf6\"" Sep 11 03:02:01.742464 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.742354 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 03:02:01.743774 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.743751 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 03:02:01.743890 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.743759 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 03:02:01.743966 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.743945 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 03:02:01.744071 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.744013 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 03:02:01.744071 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.744063 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 03:02:01.744209 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.744062 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 03:02:01.744270 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.744238 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 03:02:01.744369 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.744351 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-httkr\"" Sep 11 03:02:01.744430 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.744366 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 03:02:01.744571 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.744501 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 03:02:01.744744 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.744724 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 03:02:01.744844 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.744767 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 03:02:01.745299 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.745284 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 03:02:01.748663 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.748639 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 03:02:01.757394 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.757367 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 03:02:01.845486 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.845684 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.845684 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.845684 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.845684 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.845684 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845610 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.845684 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.845684 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845891 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh5lg\" (UniqueName: \"kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-kube-api-access-rh5lg\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.845996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.846444 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.846017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.946958 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.946918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.947135 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.946966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.947135 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.947004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.947135 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.947019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.947135 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.947046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.947828 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.947801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.947942 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.947890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.950310 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.950278 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.950883 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.950856 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.958235 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.951410 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.958235 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.951743 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.958235 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.955106 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.958235 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.956330 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.958499 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.947924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.958499 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.958419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.958499 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.958447 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.958499 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.958494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.958693 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.958530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.958832 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.958772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.959110 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.959084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.959219 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.959161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh5lg\" (UniqueName: \"kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-kube-api-access-rh5lg\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.959219 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.959204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.959341 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.959239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.959341 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.959277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.959341 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.959303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.959341 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.959338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.959530 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.959354 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.959530 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.959374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.960425 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.959757 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.960425 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.960286 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.961862 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.961105 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.961862 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.961783 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.962949 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.962924 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.965034 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.964843 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.965034 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.964892 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.965034 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.964995 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.965952 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.965925 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.966166 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.966111 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.966255 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.966232 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:01.967577 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:01.967555 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh5lg\" (UniqueName: \"kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-kube-api-access-rh5lg\") pod \"prometheus-k8s-0\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:02.051996 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:02.051701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:02.339746 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:02.339701 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 03:02:02.347173 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:02:02.347126 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d77ff2_46e4_42b4_8c84_0d18e2f3a240.slice/crio-2be3cef1e11e51202e54188163e2b3eb67d112b886aa438ab23c5e9f20c31181 WatchSource:0}: Error finding container 2be3cef1e11e51202e54188163e2b3eb67d112b886aa438ab23c5e9f20c31181: Status 404 returned error can't find the container with id 2be3cef1e11e51202e54188163e2b3eb67d112b886aa438ab23c5e9f20c31181 Sep 11 03:02:02.487163 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:02.487121 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerID="a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd" exitCode=0 Sep 11 03:02:02.487495 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:02.487173 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerDied","Data":"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd"} Sep 11 03:02:02.487495 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:02.487234 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerStarted","Data":"2be3cef1e11e51202e54188163e2b3eb67d112b886aa438ab23c5e9f20c31181"} Sep 11 03:02:02.491211 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:02.491182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerStarted","Data":"42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608"} Sep 11 03:02:02.538241 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:02.538192 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.885418408 podStartE2EDuration="6.538177356s" totalImagesPullingTime="3.637004808s" totalInitContainerRuntime="15.75414ms" isStatefulPod=false podCreationTimestamp="2026-09-11 03:01:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:02:02.536770608 +0000 UTC m=+80.928891085" watchObservedRunningTime="2026-09-11 03:02:02.538177356 +0000 UTC m=+80.930297810" Sep 11 03:02:07.523996 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:07.523432 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerStarted","Data":"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3"} Sep 11 03:02:07.523996 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:07.523535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerStarted","Data":"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d"} Sep 11 03:02:09.537223 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:09.537187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerStarted","Data":"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c"} Sep 11 03:02:09.537702 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:09.537273 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerStarted","Data":"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c"} Sep 11 03:02:09.537702 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:09.537319 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerStarted","Data":"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a"} Sep 11 03:02:09.537702 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:09.537363 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerStarted","Data":"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7"} Sep 11 03:02:09.571468 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:09.571416 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.081703213 podStartE2EDuration="8.571400076s" totalImagesPullingTime="6.470858182s" totalInitContainerRuntime="18.838681ms" isStatefulPod=false podCreationTimestamp="2026-09-11 03:02:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:02:09.569985362 +0000 UTC m=+87.962105839" watchObservedRunningTime="2026-09-11 03:02:09.571400076 +0000 UTC m=+87.963520530" Sep 11 03:02:12.053003 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:12.052967 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:02:23.433495 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:02:23.433463 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pv5qr" Sep 11 03:03:02.052474 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:02.052436 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:02.071516 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:02.071492 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:02.748403 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:02.748380 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:15.838513 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:15.838480 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 03:03:15.839018 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:15.838795 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="alertmanager" containerID="cri-o://971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b" gracePeriod=120 Sep 11 03:03:15.839018 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:15.838817 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy-metric" containerID="cri-o://ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a" gracePeriod=120 Sep 11 03:03:15.839018 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:15.838848 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy" containerID="cri-o://1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653" gracePeriod=120 Sep 11 03:03:15.839018 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:15.838817 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy-web" containerID="cri-o://f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0" gracePeriod=120 Sep 11 03:03:15.839018 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:15.838870 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="prom-label-proxy" containerID="cri-o://42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608" gracePeriod=120 Sep 11 03:03:15.839018 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:15.838894 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="config-reloader" containerID="cri-o://2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131" gracePeriod=120 Sep 11 03:03:16.786437 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:16.786402 2578 generic.go:356] "Generic (PLEG): container finished" podID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerID="42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608" exitCode=0 Sep 11 03:03:16.786437 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:16.786431 2578 generic.go:356] "Generic (PLEG): container finished" podID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerID="1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653" exitCode=0 Sep 11 03:03:16.786437 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:16.786437 2578 generic.go:356] "Generic (PLEG): container finished" podID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerID="2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131" exitCode=0 Sep 11 03:03:16.786437 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:16.786442 2578 generic.go:356] "Generic (PLEG): container finished" podID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerID="971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b" exitCode=0 Sep 11 03:03:16.786689 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:16.786477 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerDied","Data":"42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608"} Sep 11 03:03:16.786689 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:16.786549 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerDied","Data":"1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653"} Sep 11 03:03:16.786689 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:16.786577 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerDied","Data":"2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131"} Sep 11 03:03:16.786689 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:16.786601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerDied","Data":"971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b"} Sep 11 03:03:17.078108 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.078084 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:03:17.250939 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.250897 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-main-db\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251108 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.250949 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251108 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.250980 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-volume\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251108 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251011 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-web-config\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251108 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251034 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-web\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251108 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251061 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-trusted-ca-bundle\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251108 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251088 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-main-tls\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251130 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-cluster-tls-config\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251201 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-metrics-client-ca\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251226 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27b66\" (UniqueName: \"kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-kube-api-access-27b66\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251254 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-tls-assets\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251271 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 03:03:17.251449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251288 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-out\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251316 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-metric\") pod \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\" (UID: \"bbf162ad-f1a1-4428-b0c3-acf683cb0344\") " Sep 11 03:03:17.251766 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.251566 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-main-db\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.252235 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.252117 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 03:03:17.252489 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.252318 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 03:03:17.254928 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.254741 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:17.254928 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.254832 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-volume" (OuterVolumeSpecName: "config-volume") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:17.254928 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.254885 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 03:03:17.255385 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.255348 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:17.255645 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.255608 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:17.255879 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.255855 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:17.255970 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.255890 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-kube-api-access-27b66" (OuterVolumeSpecName: "kube-api-access-27b66") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "kube-api-access-27b66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 03:03:17.256613 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.256593 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-out" (OuterVolumeSpecName: "config-out") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 03:03:17.259820 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.259795 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:17.265640 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.265617 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-web-config" (OuterVolumeSpecName: "web-config") pod "bbf162ad-f1a1-4428-b0c3-acf683cb0344" (UID: "bbf162ad-f1a1-4428-b0c3-acf683cb0344"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:17.352138 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352060 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-metrics-client-ca\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.352138 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352089 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27b66\" (UniqueName: \"kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-kube-api-access-27b66\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.352138 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352101 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbf162ad-f1a1-4428-b0c3-acf683cb0344-tls-assets\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.352138 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352109 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-out\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.352138 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352119 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.352138 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352129 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.352138 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352138 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-config-volume\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.352463 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352182 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-web-config\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.352463 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352190 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.352463 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352199 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbf162ad-f1a1-4428-b0c3-acf683cb0344-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.352463 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352207 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-secret-alertmanager-main-tls\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.352463 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.352215 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbf162ad-f1a1-4428-b0c3-acf683cb0344-cluster-tls-config\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:17.793589 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.793555 2578 generic.go:356] "Generic (PLEG): container finished" podID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerID="ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a" exitCode=0 Sep 11 03:03:17.793589 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.793582 2578 generic.go:356] "Generic (PLEG): container finished" podID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerID="f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0" exitCode=0 Sep 11 03:03:17.793782 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.793609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerDied","Data":"ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a"} Sep 11 03:03:17.793782 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.793629 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 03:03:17.793782 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.793673 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerDied","Data":"f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0"} Sep 11 03:03:17.793782 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.793701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbf162ad-f1a1-4428-b0c3-acf683cb0344","Type":"ContainerDied","Data":"b1086d06010b10c4d91497825219dd0c4a8c7824a6fb0417a575a93ee05fbe7c"} Sep 11 03:03:17.793782 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.793742 2578 scope.go:117] "RemoveContainer" containerID="42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608" Sep 11 03:03:17.802263 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.802245 2578 scope.go:117] "RemoveContainer" containerID="ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a" Sep 11 03:03:17.809386 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.809371 2578 scope.go:117] "RemoveContainer" containerID="1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653" Sep 11 03:03:17.816261 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.816214 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 03:03:17.817545 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.817527 2578 scope.go:117] "RemoveContainer" containerID="f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0" Sep 11 03:03:17.820160 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.820117 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 03:03:17.824836 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.824821 2578 scope.go:117] "RemoveContainer" containerID="2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131" Sep 11 03:03:17.831754 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.831739 2578 scope.go:117] "RemoveContainer" containerID="971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b" Sep 11 03:03:17.838950 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.838930 2578 scope.go:117] "RemoveContainer" containerID="f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac" Sep 11 03:03:17.846125 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.846101 2578 scope.go:117] "RemoveContainer" containerID="42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608" Sep 11 03:03:17.846488 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:17.846466 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608\": container with ID starting with 42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608 not found: ID does not exist" containerID="42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608" Sep 11 03:03:17.846561 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.846498 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608"} err="failed to get container status \"42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608\": rpc error: code = NotFound desc = could not find container \"42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608\": container with ID starting with 42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608 not found: ID does not exist" Sep 11 03:03:17.846561 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.846531 2578 scope.go:117] "RemoveContainer" containerID="ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a" Sep 11 03:03:17.846780 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:17.846764 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a\": container with ID starting with ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a not found: ID does not exist" containerID="ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a" Sep 11 03:03:17.846817 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.846786 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a"} err="failed to get container status \"ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a\": rpc error: code = NotFound desc = could not find container \"ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a\": container with ID starting with ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a not found: ID does not exist" Sep 11 03:03:17.846817 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.846809 2578 scope.go:117] "RemoveContainer" containerID="1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653" Sep 11 03:03:17.847030 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:17.847015 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653\": container with ID starting with 1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653 not found: ID does not exist" containerID="1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653" Sep 11 03:03:17.847079 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.847033 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653"} err="failed to get container status \"1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653\": rpc error: code = NotFound desc = could not find container \"1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653\": container with ID starting with 1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653 not found: ID does not exist" Sep 11 03:03:17.847079 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.847045 2578 scope.go:117] "RemoveContainer" containerID="f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0" Sep 11 03:03:17.847329 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:17.847309 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0\": container with ID starting with f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0 not found: ID does not exist" containerID="f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0" Sep 11 03:03:17.847400 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.847337 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0"} err="failed to get container status \"f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0\": rpc error: code = NotFound desc = could not find container \"f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0\": container with ID starting with f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0 not found: ID does not exist" Sep 11 03:03:17.847400 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.847358 2578 scope.go:117] "RemoveContainer" containerID="2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131" Sep 11 03:03:17.847675 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:17.847650 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131\": container with ID starting with 2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131 not found: ID does not exist" containerID="2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131" Sep 11 03:03:17.847756 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.847692 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131"} err="failed to get container status \"2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131\": rpc error: code = NotFound desc = could not find container \"2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131\": container with ID starting with 2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131 not found: ID does not exist" Sep 11 03:03:17.847756 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.847713 2578 scope.go:117] "RemoveContainer" containerID="971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b" Sep 11 03:03:17.849638 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:17.849618 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b\": container with ID starting with 971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b not found: ID does not exist" containerID="971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b" Sep 11 03:03:17.849733 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.849644 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b"} err="failed to get container status \"971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b\": rpc error: code = NotFound desc = could not find container \"971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b\": container with ID starting with 971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b not found: ID does not exist" Sep 11 03:03:17.849733 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.849666 2578 scope.go:117] "RemoveContainer" containerID="f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac" Sep 11 03:03:17.849935 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:17.849918 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac\": container with ID starting with f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac not found: ID does not exist" containerID="f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac" Sep 11 03:03:17.849993 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.849943 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac"} err="failed to get container status \"f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac\": rpc error: code = NotFound desc = could not find container \"f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac\": container with ID starting with f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac not found: ID does not exist" Sep 11 03:03:17.849993 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.849962 2578 scope.go:117] "RemoveContainer" containerID="42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608" Sep 11 03:03:17.850291 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.850273 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608"} err="failed to get container status \"42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608\": rpc error: code = NotFound desc = could not find container \"42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608\": container with ID starting with 42beaa735838d05847c8c8d630bbc6034068e94442d50637c5a71ddab7c2b608 not found: ID does not exist" Sep 11 03:03:17.850291 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.850291 2578 scope.go:117] "RemoveContainer" containerID="ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a" Sep 11 03:03:17.850546 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.850517 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a"} err="failed to get container status \"ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a\": rpc error: code = NotFound desc = could not find container \"ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a\": container with ID starting with ba169462ba27ae4a7c17b83493389ee7c6192d4e85858b2d1f238d08235e8a9a not found: ID does not exist" Sep 11 03:03:17.850546 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.850537 2578 scope.go:117] "RemoveContainer" containerID="1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653" Sep 11 03:03:17.850764 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.850749 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653"} err="failed to get container status \"1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653\": rpc error: code = NotFound desc = could not find container \"1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653\": container with ID starting with 1afab6877a271dd1c7dd5c89e93f3337ed2b9e3caceac43e317ec7ff66835653 not found: ID does not exist" Sep 11 03:03:17.850808 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.850765 2578 scope.go:117] "RemoveContainer" containerID="f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0" Sep 11 03:03:17.850999 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.850984 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0"} err="failed to get container status \"f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0\": rpc error: code = NotFound desc = could not find container \"f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0\": container with ID starting with f3329bc2067a73652d3529934d0b044020a06a28450fd382a86adb6ab46f2cd0 not found: ID does not exist" Sep 11 03:03:17.851041 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.851000 2578 scope.go:117] "RemoveContainer" containerID="2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131" Sep 11 03:03:17.851239 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.851219 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131"} err="failed to get container status \"2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131\": rpc error: code = NotFound desc = could not find container \"2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131\": container with ID starting with 2541210e91aa4891d70f816e5fbcca3d89eca17c3dfb7ffc7bf9119f1ad23131 not found: ID does not exist" Sep 11 03:03:17.851293 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.851241 2578 scope.go:117] "RemoveContainer" containerID="971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b" Sep 11 03:03:17.851468 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.851451 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b"} err="failed to get container status \"971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b\": rpc error: code = NotFound desc = could not find container \"971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b\": container with ID starting with 971ac13a3d10e9c99d46da565d42a7d11fb2ffd9c7612a9638285c5ded039a4b not found: ID does not exist" Sep 11 03:03:17.851531 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.851469 2578 scope.go:117] "RemoveContainer" containerID="f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac" Sep 11 03:03:17.851714 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:17.851695 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac"} err="failed to get container status \"f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac\": rpc error: code = NotFound desc = could not find container \"f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac\": container with ID starting with f7c8788dc24fcb1e206035a81e9fe743aa60d0ee5f661816be4f30273c7c61ac not found: ID does not exist" Sep 11 03:03:18.138091 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:18.138014 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" path="/var/lib/kubelet/pods/bbf162ad-f1a1-4428-b0c3-acf683cb0344/volumes" Sep 11 03:03:20.187341 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.187298 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 03:03:20.187827 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.187697 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="prometheus" containerID="cri-o://e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d" gracePeriod=600 Sep 11 03:03:20.187925 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.187902 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="thanos-sidecar" containerID="cri-o://09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7" gracePeriod=600 Sep 11 03:03:20.187981 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.187910 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy-web" containerID="cri-o://c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a" gracePeriod=600 Sep 11 03:03:20.188027 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.187998 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="config-reloader" containerID="cri-o://50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3" gracePeriod=600 Sep 11 03:03:20.188082 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.188050 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c" gracePeriod=600 Sep 11 03:03:20.188165 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.188128 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy" containerID="cri-o://251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c" gracePeriod=600 Sep 11 03:03:20.432243 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.432208 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.571975 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.571942 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-1\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572191 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.571982 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572191 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572012 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-0\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572191 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572059 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-tls\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572191 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572087 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-tls-assets\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572191 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572109 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-trusted-ca-bundle\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572191 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572130 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-web-config\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572191 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572188 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572216 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-metrics-client-ca\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572245 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-db\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572279 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-2\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572305 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-serving-certs-ca-bundle\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572337 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config-out\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572371 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-kubelet-serving-ca-bundle\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572390 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572404 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-kube-rbac-proxy\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572470 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-metrics-client-certs\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572541 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh5lg\" (UniqueName: \"kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-kube-api-access-rh5lg\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572568 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-thanos-prometheus-http-client-file\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.572609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572601 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-grpc-tls\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.573386 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.572706 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\" (UID: \"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240\") " Sep 11 03:03:20.573386 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.573031 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.573495 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.573461 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 03:03:20.574090 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.573646 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 03:03:20.574264 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.574098 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 03:03:20.575000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.574713 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:20.575000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.574910 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config" (OuterVolumeSpecName: "config") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:20.575000 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.574981 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 03:03:20.575312 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.575064 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:20.575373 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.575348 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 03:03:20.575438 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.575414 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:20.575490 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.575423 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 03:03:20.575945 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.575726 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 03:03:20.576255 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.576203 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 03:03:20.576631 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.576611 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-kube-api-access-rh5lg" (OuterVolumeSpecName: "kube-api-access-rh5lg") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "kube-api-access-rh5lg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 03:03:20.576864 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.576847 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:20.577566 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.577550 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:20.577635 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.577595 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:20.577925 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.577909 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config-out" (OuterVolumeSpecName: "config-out") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 03:03:20.577925 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.577914 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:20.585672 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.585642 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-web-config" (OuterVolumeSpecName: "web-config") pod "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" (UID: "d9d77ff2-46e4-42b4-8c84-0d18e2f3a240"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 03:03:20.673962 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.673928 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.673962 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.673959 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.673974 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config-out\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.673988 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674000 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-kube-rbac-proxy\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674011 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-metrics-client-certs\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674023 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh5lg\" (UniqueName: \"kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-kube-api-access-rh5lg\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674034 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674045 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-grpc-tls\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674056 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674070 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-config\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674084 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674097 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674109 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-tls-assets\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674121 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674133 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-web-config\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674175 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674189 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-configmap-metrics-client-ca\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.674204 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.674202 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240-prometheus-k8s-db\") on node \"ip-10-0-138-232.ec2.internal\" DevicePath \"\"" Sep 11 03:03:20.808342 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808313 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerID="e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c" exitCode=0 Sep 11 03:03:20.808342 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808337 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerID="251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c" exitCode=0 Sep 11 03:03:20.808342 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808345 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerID="c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a" exitCode=0 Sep 11 03:03:20.808616 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808351 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerID="09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7" exitCode=0 Sep 11 03:03:20.808616 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808357 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerID="50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3" exitCode=0 Sep 11 03:03:20.808616 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808362 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerID="e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d" exitCode=0 Sep 11 03:03:20.808616 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808404 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.808616 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808401 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerDied","Data":"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c"} Sep 11 03:03:20.808616 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808542 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerDied","Data":"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c"} Sep 11 03:03:20.808616 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerDied","Data":"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a"} Sep 11 03:03:20.808616 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808598 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerDied","Data":"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7"} Sep 11 03:03:20.808616 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808610 2578 scope.go:117] "RemoveContainer" containerID="e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c" Sep 11 03:03:20.808616 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808622 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerDied","Data":"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3"} Sep 11 03:03:20.809060 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808647 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerDied","Data":"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d"} Sep 11 03:03:20.809060 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.808672 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9d77ff2-46e4-42b4-8c84-0d18e2f3a240","Type":"ContainerDied","Data":"2be3cef1e11e51202e54188163e2b3eb67d112b886aa438ab23c5e9f20c31181"} Sep 11 03:03:20.816003 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.815988 2578 scope.go:117] "RemoveContainer" containerID="251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c" Sep 11 03:03:20.822865 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.822849 2578 scope.go:117] "RemoveContainer" containerID="c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a" Sep 11 03:03:20.831877 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.831851 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 03:03:20.832232 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.832215 2578 scope.go:117] "RemoveContainer" containerID="09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7" Sep 11 03:03:20.837748 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.837722 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 03:03:20.839573 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.839556 2578 scope.go:117] "RemoveContainer" containerID="50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3" Sep 11 03:03:20.845865 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.845850 2578 scope.go:117] "RemoveContainer" containerID="e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d" Sep 11 03:03:20.852610 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.852581 2578 scope.go:117] "RemoveContainer" containerID="a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd" Sep 11 03:03:20.858934 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.858921 2578 scope.go:117] "RemoveContainer" containerID="e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c" Sep 11 03:03:20.859185 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:20.859166 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": container with ID starting with e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c not found: ID does not exist" containerID="e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c" Sep 11 03:03:20.859232 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.859192 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c"} err="failed to get container status \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": rpc error: code = NotFound desc = could not find container \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": container with ID starting with e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c not found: ID does not exist" Sep 11 03:03:20.859232 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.859210 2578 scope.go:117] "RemoveContainer" containerID="251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c" Sep 11 03:03:20.859453 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:20.859434 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": container with ID starting with 251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c not found: ID does not exist" containerID="251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c" Sep 11 03:03:20.859487 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.859460 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c"} err="failed to get container status \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": rpc error: code = NotFound desc = could not find container \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": container with ID starting with 251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c not found: ID does not exist" Sep 11 03:03:20.859487 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.859476 2578 scope.go:117] "RemoveContainer" containerID="c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a" Sep 11 03:03:20.859881 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:20.859853 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": container with ID starting with c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a not found: ID does not exist" containerID="c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a" Sep 11 03:03:20.860440 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.859886 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a"} err="failed to get container status \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": rpc error: code = NotFound desc = could not find container \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": container with ID starting with c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a not found: ID does not exist" Sep 11 03:03:20.860440 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.859908 2578 scope.go:117] "RemoveContainer" containerID="09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7" Sep 11 03:03:20.860440 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:20.860246 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": container with ID starting with 09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7 not found: ID does not exist" containerID="09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7" Sep 11 03:03:20.860440 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.860272 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7"} err="failed to get container status \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": rpc error: code = NotFound desc = could not find container \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": container with ID starting with 09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7 not found: ID does not exist" Sep 11 03:03:20.860440 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.860298 2578 scope.go:117] "RemoveContainer" containerID="50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3" Sep 11 03:03:20.860644 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:20.860572 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": container with ID starting with 50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3 not found: ID does not exist" containerID="50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3" Sep 11 03:03:20.860644 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.860590 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3"} err="failed to get container status \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": rpc error: code = NotFound desc = could not find container \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": container with ID starting with 50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3 not found: ID does not exist" Sep 11 03:03:20.860644 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.860604 2578 scope.go:117] "RemoveContainer" containerID="e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d" Sep 11 03:03:20.860836 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:20.860820 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": container with ID starting with e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d not found: ID does not exist" containerID="e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d" Sep 11 03:03:20.860870 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.860839 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d"} err="failed to get container status \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": rpc error: code = NotFound desc = could not find container \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": container with ID starting with e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d not found: ID does not exist" Sep 11 03:03:20.860870 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.860852 2578 scope.go:117] "RemoveContainer" containerID="a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd" Sep 11 03:03:20.861126 ip-10-0-138-232 kubenswrapper[2578]: E0911 03:03:20.861104 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": container with ID starting with a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd not found: ID does not exist" containerID="a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd" Sep 11 03:03:20.861259 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861135 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd"} err="failed to get container status \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": rpc error: code = NotFound desc = could not find container \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": container with ID starting with a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd not found: ID does not exist" Sep 11 03:03:20.861259 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861177 2578 scope.go:117] "RemoveContainer" containerID="e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c" Sep 11 03:03:20.861423 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861407 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c"} err="failed to get container status \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": rpc error: code = NotFound desc = could not find container \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": container with ID starting with e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c not found: ID does not exist" Sep 11 03:03:20.861472 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861424 2578 scope.go:117] "RemoveContainer" containerID="251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c" Sep 11 03:03:20.861609 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861593 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 03:03:20.861644 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861606 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c"} err="failed to get container status \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": rpc error: code = NotFound desc = could not find container \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": container with ID starting with 251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c not found: ID does not exist" Sep 11 03:03:20.861644 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861618 2578 scope.go:117] "RemoveContainer" containerID="c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a" Sep 11 03:03:20.861814 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861796 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a"} err="failed to get container status \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": rpc error: code = NotFound desc = could not find container \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": container with ID starting with c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a not found: ID does not exist" Sep 11 03:03:20.861857 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861813 2578 scope.go:117] "RemoveContainer" containerID="09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7" Sep 11 03:03:20.861857 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861829 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="alertmanager" Sep 11 03:03:20.861857 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861841 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="alertmanager" Sep 11 03:03:20.861857 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861849 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy-web" Sep 11 03:03:20.861857 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861856 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy-web" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861867 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="prom-label-proxy" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861873 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="prom-label-proxy" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861878 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="init-config-reloader" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861883 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="init-config-reloader" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861890 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861898 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861907 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="prometheus" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861916 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="prometheus" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861925 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="config-reloader" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861931 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="config-reloader" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861937 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy-thanos" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861943 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy-thanos" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861948 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="thanos-sidecar" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861953 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="thanos-sidecar" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861958 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy-web" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861963 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy-web" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861970 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy-metric" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861977 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy-metric" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861990 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="init-config-reloader" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861996 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="init-config-reloader" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862007 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862011 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862020 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="config-reloader" Sep 11 03:03:20.862020 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862024 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="config-reloader" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.861975 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7"} err="failed to get container status \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": rpc error: code = NotFound desc = could not find container \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": container with ID starting with 09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7 not found: ID does not exist" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862059 2578 scope.go:117] "RemoveContainer" containerID="50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862073 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="config-reloader" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862081 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862085 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="prometheus" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862092 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy-web" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862098 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862105 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="alertmanager" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862110 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="thanos-sidecar" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862114 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy-web" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862118 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="kube-rbac-proxy-metric" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862124 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="config-reloader" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862128 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" containerName="kube-rbac-proxy-thanos" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862133 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf162ad-f1a1-4428-b0c3-acf683cb0344" containerName="prom-label-proxy" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862337 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3"} err="failed to get container status \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": rpc error: code = NotFound desc = could not find container \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": container with ID starting with 50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3 not found: ID does not exist" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862348 2578 scope.go:117] "RemoveContainer" containerID="e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862547 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d"} err="failed to get container status \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": rpc error: code = NotFound desc = could not find container \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": container with ID starting with e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d not found: ID does not exist" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862563 2578 scope.go:117] "RemoveContainer" containerID="a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862778 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd"} err="failed to get container status \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": rpc error: code = NotFound desc = could not find container \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": container with ID starting with a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd not found: ID does not exist" Sep 11 03:03:20.862829 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862796 2578 scope.go:117] "RemoveContainer" containerID="e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c" Sep 11 03:03:20.863502 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862979 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c"} err="failed to get container status \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": rpc error: code = NotFound desc = could not find container \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": container with ID starting with e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c not found: ID does not exist" Sep 11 03:03:20.863502 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.862994 2578 scope.go:117] "RemoveContainer" containerID="251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c" Sep 11 03:03:20.863502 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.863217 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c"} err="failed to get container status \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": rpc error: code = NotFound desc = could not find container \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": container with ID starting with 251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c not found: ID does not exist" Sep 11 03:03:20.863502 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.863231 2578 scope.go:117] "RemoveContainer" containerID="c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a" Sep 11 03:03:20.863502 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.863416 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a"} err="failed to get container status \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": rpc error: code = NotFound desc = could not find container \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": container with ID starting with c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a not found: ID does not exist" Sep 11 03:03:20.863502 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.863433 2578 scope.go:117] "RemoveContainer" containerID="09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7" Sep 11 03:03:20.863757 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.863603 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7"} err="failed to get container status \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": rpc error: code = NotFound desc = could not find container \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": container with ID starting with 09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7 not found: ID does not exist" Sep 11 03:03:20.863757 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.863614 2578 scope.go:117] "RemoveContainer" containerID="50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3" Sep 11 03:03:20.863832 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.863786 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3"} err="failed to get container status \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": rpc error: code = NotFound desc = could not find container \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": container with ID starting with 50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3 not found: ID does not exist" Sep 11 03:03:20.863832 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.863798 2578 scope.go:117] "RemoveContainer" containerID="e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d" Sep 11 03:03:20.863985 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.863968 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d"} err="failed to get container status \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": rpc error: code = NotFound desc = could not find container \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": container with ID starting with e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d not found: ID does not exist" Sep 11 03:03:20.864025 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.863985 2578 scope.go:117] "RemoveContainer" containerID="a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd" Sep 11 03:03:20.864198 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.864182 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd"} err="failed to get container status \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": rpc error: code = NotFound desc = could not find container \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": container with ID starting with a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd not found: ID does not exist" Sep 11 03:03:20.864198 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.864198 2578 scope.go:117] "RemoveContainer" containerID="e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c" Sep 11 03:03:20.864537 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.864512 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c"} err="failed to get container status \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": rpc error: code = NotFound desc = could not find container \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": container with ID starting with e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c not found: ID does not exist" Sep 11 03:03:20.864537 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.864538 2578 scope.go:117] "RemoveContainer" containerID="251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c" Sep 11 03:03:20.865416 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.865390 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c"} err="failed to get container status \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": rpc error: code = NotFound desc = could not find container \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": container with ID starting with 251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c not found: ID does not exist" Sep 11 03:03:20.865416 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.865412 2578 scope.go:117] "RemoveContainer" containerID="c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a" Sep 11 03:03:20.865863 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.865695 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a"} err="failed to get container status \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": rpc error: code = NotFound desc = could not find container \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": container with ID starting with c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a not found: ID does not exist" Sep 11 03:03:20.865863 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.865734 2578 scope.go:117] "RemoveContainer" containerID="09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7" Sep 11 03:03:20.866372 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.866009 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7"} err="failed to get container status \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": rpc error: code = NotFound desc = could not find container \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": container with ID starting with 09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7 not found: ID does not exist" Sep 11 03:03:20.866372 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.866065 2578 scope.go:117] "RemoveContainer" containerID="50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3" Sep 11 03:03:20.866372 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.866342 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3"} err="failed to get container status \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": rpc error: code = NotFound desc = could not find container \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": container with ID starting with 50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3 not found: ID does not exist" Sep 11 03:03:20.866372 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.866361 2578 scope.go:117] "RemoveContainer" containerID="e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d" Sep 11 03:03:20.866858 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.866625 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d"} err="failed to get container status \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": rpc error: code = NotFound desc = could not find container \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": container with ID starting with e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d not found: ID does not exist" Sep 11 03:03:20.866858 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.866663 2578 scope.go:117] "RemoveContainer" containerID="a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd" Sep 11 03:03:20.866987 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.866962 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd"} err="failed to get container status \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": rpc error: code = NotFound desc = could not find container \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": container with ID starting with a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd not found: ID does not exist" Sep 11 03:03:20.867030 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.866991 2578 scope.go:117] "RemoveContainer" containerID="e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c" Sep 11 03:03:20.867364 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.867337 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c"} err="failed to get container status \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": rpc error: code = NotFound desc = could not find container \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": container with ID starting with e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c not found: ID does not exist" Sep 11 03:03:20.867442 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.867367 2578 scope.go:117] "RemoveContainer" containerID="251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c" Sep 11 03:03:20.867661 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.867643 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c"} err="failed to get container status \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": rpc error: code = NotFound desc = could not find container \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": container with ID starting with 251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c not found: ID does not exist" Sep 11 03:03:20.867735 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.867661 2578 scope.go:117] "RemoveContainer" containerID="c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a" Sep 11 03:03:20.867941 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.867922 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a"} err="failed to get container status \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": rpc error: code = NotFound desc = could not find container \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": container with ID starting with c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a not found: ID does not exist" Sep 11 03:03:20.867992 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.867944 2578 scope.go:117] "RemoveContainer" containerID="09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7" Sep 11 03:03:20.868227 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.868205 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7"} err="failed to get container status \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": rpc error: code = NotFound desc = could not find container \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": container with ID starting with 09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7 not found: ID does not exist" Sep 11 03:03:20.868227 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.868225 2578 scope.go:117] "RemoveContainer" containerID="50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3" Sep 11 03:03:20.868458 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.868443 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.868567 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.868549 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3"} err="failed to get container status \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": rpc error: code = NotFound desc = could not find container \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": container with ID starting with 50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3 not found: ID does not exist" Sep 11 03:03:20.868630 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.868568 2578 scope.go:117] "RemoveContainer" containerID="e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d" Sep 11 03:03:20.868903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.868870 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d"} err="failed to get container status \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": rpc error: code = NotFound desc = could not find container \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": container with ID starting with e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d not found: ID does not exist" Sep 11 03:03:20.868903 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.868896 2578 scope.go:117] "RemoveContainer" containerID="a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd" Sep 11 03:03:20.869212 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.869187 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd"} err="failed to get container status \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": rpc error: code = NotFound desc = could not find container \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": container with ID starting with a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd not found: ID does not exist" Sep 11 03:03:20.869280 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.869215 2578 scope.go:117] "RemoveContainer" containerID="e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c" Sep 11 03:03:20.869525 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.869505 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c"} err="failed to get container status \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": rpc error: code = NotFound desc = could not find container \"e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c\": container with ID starting with e5fb04184fb38374a439fa09d51fb10c89b99aaf4e4e69ad2252fdf638328b8c not found: ID does not exist" Sep 11 03:03:20.869525 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.869523 2578 scope.go:117] "RemoveContainer" containerID="251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c" Sep 11 03:03:20.869785 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.869762 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c"} err="failed to get container status \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": rpc error: code = NotFound desc = could not find container \"251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c\": container with ID starting with 251644e6bcdb9d5c6d827a1cc44fda627d9dc0c0db9a48be238bd18418deb31c not found: ID does not exist" Sep 11 03:03:20.869836 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.869787 2578 scope.go:117] "RemoveContainer" containerID="c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a" Sep 11 03:03:20.870042 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870025 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a"} err="failed to get container status \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": rpc error: code = NotFound desc = could not find container \"c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a\": container with ID starting with c9a5748bad3e535e9db78dba0299c8667fc46696c1a3ac9540eab9658a7c718a not found: ID does not exist" Sep 11 03:03:20.870103 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870043 2578 scope.go:117] "RemoveContainer" containerID="09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7" Sep 11 03:03:20.870359 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870336 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7"} err="failed to get container status \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": rpc error: code = NotFound desc = could not find container \"09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7\": container with ID starting with 09b00e79066da9fa647371aa75796f7a55851a63d8eba7e5c59c0efa462471f7 not found: ID does not exist" Sep 11 03:03:20.870435 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870361 2578 scope.go:117] "RemoveContainer" containerID="50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3" Sep 11 03:03:20.870518 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870490 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 03:03:20.870518 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870498 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 03:03:20.870618 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870607 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 03:03:20.870666 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870642 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 03:03:20.870711 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870657 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3"} err="failed to get container status \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": rpc error: code = NotFound desc = could not find container \"50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3\": container with ID starting with 50f80d17bc7975918120d64820b23e06a70fa2aff1ba05fa04c51eaeb466fbc3 not found: ID does not exist" Sep 11 03:03:20.870711 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870680 2578 scope.go:117] "RemoveContainer" containerID="e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d" Sep 11 03:03:20.870956 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870937 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 03:03:20.871091 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870950 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d"} err="failed to get container status \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": rpc error: code = NotFound desc = could not find container \"e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d\": container with ID starting with e49c878c491757af80bc4177abbd1cc486f8f252ad51d6369ca367dcdecf999d not found: ID does not exist" Sep 11 03:03:20.871091 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870971 2578 scope.go:117] "RemoveContainer" containerID="a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd" Sep 11 03:03:20.871091 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.870942 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 03:03:20.871091 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.871001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 03:03:20.871447 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.871279 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 03:03:20.871447 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.871322 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 03:03:20.871447 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.871336 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 03:03:20.871447 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.871383 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6ordauo3eerf6\"" Sep 11 03:03:20.871634 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.871457 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 03:03:20.871634 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.871466 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd"} err="failed to get container status \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": rpc error: code = NotFound desc = could not find container \"a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd\": container with ID starting with a6c598aacb16600c3e7190be893ea1474dd0d8f2a22025d79b6be013adb9a2bd not found: ID does not exist" Sep 11 03:03:20.871711 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.871634 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 03:03:20.871711 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.871638 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 03:03:20.871960 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.871945 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-httkr\"" Sep 11 03:03:20.882311 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.882287 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 03:03:20.882855 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.882835 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 03:03:20.884618 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.884456 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 03:03:20.977447 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-config\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977447 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977669 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977669 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977669 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977669 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977669 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977669 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4nwm\" (UniqueName: \"kubernetes.io/projected/ff6715fb-c434-485c-be70-ebcf612bfba8-kube-api-access-d4nwm\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977884 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977884 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977884 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff6715fb-c434-485c-be70-ebcf612bfba8-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977884 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977884 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977796 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977884 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.977884 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.978113 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.978113 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.978113 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977930 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff6715fb-c434-485c-be70-ebcf612bfba8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.978113 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:20.978113 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:20.977997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078516 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078516 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078516 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4nwm\" (UniqueName: \"kubernetes.io/projected/ff6715fb-c434-485c-be70-ebcf612bfba8-kube-api-access-d4nwm\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff6715fb-c434-485c-be70-ebcf612bfba8-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078746 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.078815 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff6715fb-c434-485c-be70-ebcf612bfba8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.079449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078829 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.079449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.079449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-config\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.079449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.079449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.078929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.079449 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.079169 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.080738 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.080253 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.081258 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.080862 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.081723 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.081590 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.081845 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.081798 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.083162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.082204 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.083162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.082448 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.083162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.082638 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff6715fb-c434-485c-be70-ebcf612bfba8-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.083162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.082687 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.083162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.082937 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.083162 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.083050 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.083544 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.083525 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff6715fb-c434-485c-be70-ebcf612bfba8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.083676 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.083659 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-config\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.084125 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.084094 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff6715fb-c434-485c-be70-ebcf612bfba8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.084289 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.084267 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.084413 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.084391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.084492 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.084478 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.085037 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.085023 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.085484 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.085465 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff6715fb-c434-485c-be70-ebcf612bfba8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.087561 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.087540 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4nwm\" (UniqueName: \"kubernetes.io/projected/ff6715fb-c434-485c-be70-ebcf612bfba8-kube-api-access-d4nwm\") pod \"prometheus-k8s-0\" (UID: \"ff6715fb-c434-485c-be70-ebcf612bfba8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.181534 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.181501 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:03:21.463822 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.463750 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 03:03:21.467034 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:03:21.467008 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6715fb_c434_485c_be70_ebcf612bfba8.slice/crio-a3f65ac49cdf49c9f06d232b8e55f410ea785b97a1af05d123f55925a870da0c WatchSource:0}: Error finding container a3f65ac49cdf49c9f06d232b8e55f410ea785b97a1af05d123f55925a870da0c: Status 404 returned error can't find the container with id a3f65ac49cdf49c9f06d232b8e55f410ea785b97a1af05d123f55925a870da0c Sep 11 03:03:21.815452 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.815423 2578 generic.go:356] "Generic (PLEG): container finished" podID="ff6715fb-c434-485c-be70-ebcf612bfba8" containerID="410d526b513a33e3a7675622e40482c4190fbe24157938c903f39ab076ba451f" exitCode=0 Sep 11 03:03:21.815603 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.815466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff6715fb-c434-485c-be70-ebcf612bfba8","Type":"ContainerDied","Data":"410d526b513a33e3a7675622e40482c4190fbe24157938c903f39ab076ba451f"} Sep 11 03:03:21.815603 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:21.815515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff6715fb-c434-485c-be70-ebcf612bfba8","Type":"ContainerStarted","Data":"a3f65ac49cdf49c9f06d232b8e55f410ea785b97a1af05d123f55925a870da0c"} Sep 11 03:03:22.146201 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:22.146115 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9d77ff2-46e4-42b4-8c84-0d18e2f3a240" path="/var/lib/kubelet/pods/d9d77ff2-46e4-42b4-8c84-0d18e2f3a240/volumes" Sep 11 03:03:22.823070 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:22.823036 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff6715fb-c434-485c-be70-ebcf612bfba8","Type":"ContainerStarted","Data":"3adf1931fbc6c06d9a2b1e699061cd926492e97c2f0f6ffa0579e9c2cee4f674"} Sep 11 03:03:22.823444 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:22.823099 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff6715fb-c434-485c-be70-ebcf612bfba8","Type":"ContainerStarted","Data":"950c3b2b404384b56a0ab288d6c50ae099983ee25c16acd90db94539bfaa33b6"} Sep 11 03:03:22.823444 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:22.823125 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff6715fb-c434-485c-be70-ebcf612bfba8","Type":"ContainerStarted","Data":"c1ff1d837da3be601ce3d313376f2dc622305368da605e611b7937175cb35e83"} Sep 11 03:03:22.823444 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:22.823176 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff6715fb-c434-485c-be70-ebcf612bfba8","Type":"ContainerStarted","Data":"41edc860986587bac101784b8e090b99c7823c5fbd184f18afab4a0907eaea68"} Sep 11 03:03:22.823444 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:22.823201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff6715fb-c434-485c-be70-ebcf612bfba8","Type":"ContainerStarted","Data":"272ec253ef98671897cd284ff00d56c655e7e36b9e63ba0f2eb6982bbeb8fe40"} Sep 11 03:03:22.823444 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:22.823223 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff6715fb-c434-485c-be70-ebcf612bfba8","Type":"ContainerStarted","Data":"5e659c8e762366d2f1f5df24ee945903a4182eb06a62b673f14aff17c8b057d1"} Sep 11 03:03:22.856971 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:22.856873 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.838445306 podStartE2EDuration="2.856853037s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.407731ms" isStatefulPod=false podCreationTimestamp="2026-09-11 03:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:03:22.855583765 +0000 UTC m=+161.247704230" watchObservedRunningTime="2026-09-11 03:03:22.856853037 +0000 UTC m=+161.248973493" Sep 11 03:03:26.181773 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:03:26.181737 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:04:21.182474 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:04:21.182386 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:04:21.198105 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:04:21.198082 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:04:22.046410 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:04:22.046383 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 03:05:27.678002 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:27.677971 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bdsfj_c19a616e-7c81-44d3-b76e-91b589f2247b/global-pull-secret-syncer/0.log" Sep 11 03:05:27.856109 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:27.856078 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kf2hz_7e2b044a-7d10-4425-aafe-ca363dea77f6/konnectivity-agent/0.log" Sep 11 03:05:27.967793 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:27.967716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-232.ec2.internal_cfb73c088fb2994699656a729ac976af/haproxy/0.log" Sep 11 03:05:32.413085 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:32.413016 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c4jhb_a78ba393-eda0-4d6a-9c06-4d862b1ee868/node-exporter/0.log" Sep 11 03:05:32.439155 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:32.439128 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c4jhb_a78ba393-eda0-4d6a-9c06-4d862b1ee868/kube-rbac-proxy/0.log" Sep 11 03:05:32.466982 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:32.466961 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c4jhb_a78ba393-eda0-4d6a-9c06-4d862b1ee868/init-textfile/0.log" Sep 11 03:05:32.684394 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:32.684318 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-8pgxc_9d3c667c-099f-42fb-a3ea-f99aa836fed4/kube-rbac-proxy-main/0.log" Sep 11 03:05:32.715216 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:32.715189 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-8pgxc_9d3c667c-099f-42fb-a3ea-f99aa836fed4/kube-rbac-proxy-self/0.log" Sep 11 03:05:32.749325 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:32.749300 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-8pgxc_9d3c667c-099f-42fb-a3ea-f99aa836fed4/openshift-state-metrics/0.log" Sep 11 03:05:32.807896 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:32.807872 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ff6715fb-c434-485c-be70-ebcf612bfba8/prometheus/0.log" Sep 11 03:05:32.863215 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:32.863189 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ff6715fb-c434-485c-be70-ebcf612bfba8/config-reloader/0.log" Sep 11 03:05:32.909320 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:32.909304 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ff6715fb-c434-485c-be70-ebcf612bfba8/thanos-sidecar/0.log" Sep 11 03:05:32.965548 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:32.965526 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ff6715fb-c434-485c-be70-ebcf612bfba8/kube-rbac-proxy-web/0.log" Sep 11 03:05:33.001809 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:33.001788 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ff6715fb-c434-485c-be70-ebcf612bfba8/kube-rbac-proxy/0.log" Sep 11 03:05:33.040377 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:33.040355 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ff6715fb-c434-485c-be70-ebcf612bfba8/kube-rbac-proxy-thanos/0.log" Sep 11 03:05:33.072293 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:33.072239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ff6715fb-c434-485c-be70-ebcf612bfba8/init-config-reloader/0.log" Sep 11 03:05:33.105277 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:33.105258 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-pg8g9_668804ba-29c8-4c24-972a-12b7308ab065/prometheus-operator/0.log" Sep 11 03:05:33.141059 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:33.141036 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-pg8g9_668804ba-29c8-4c24-972a-12b7308ab065/kube-rbac-proxy/0.log" Sep 11 03:05:34.787241 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.787204 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb"] Sep 11 03:05:34.790399 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.790377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.793182 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.793163 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xpmrb\"/\"default-dockercfg-7w4kh\"" Sep 11 03:05:34.793286 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.793163 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpmrb\"/\"openshift-service-ca.crt\"" Sep 11 03:05:34.794042 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.794022 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpmrb\"/\"kube-root-ca.crt\"" Sep 11 03:05:34.802912 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.802892 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb"] Sep 11 03:05:34.853876 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.853841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-lib-modules\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.854051 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.853882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-proc\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.854051 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.853905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpq99\" (UniqueName: \"kubernetes.io/projected/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-kube-api-access-wpq99\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.854051 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.853970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-podres\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.854051 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.854016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-sys\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.955126 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.955092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-lib-modules\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.955275 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.955131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-proc\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.955275 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.955194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpq99\" (UniqueName: \"kubernetes.io/projected/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-kube-api-access-wpq99\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.955275 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.955216 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-proc\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.955275 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.955248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-podres\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.955459 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.955290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-sys\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.955459 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.955371 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-sys\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.955459 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.955372 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-lib-modules\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.955459 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.955401 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-podres\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:34.969986 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:34.969965 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpq99\" (UniqueName: \"kubernetes.io/projected/e2cc73b1-64e6-421c-a72e-bc166b8ccc5d-kube-api-access-wpq99\") pod \"perf-node-gather-daemonset-5vjcb\" (UID: \"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d\") " pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:35.100498 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:35.100422 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:35.380756 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:35.380663 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb"] Sep 11 03:05:35.383262 ip-10-0-138-232 kubenswrapper[2578]: W0911 03:05:35.383233 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode2cc73b1_64e6_421c_a72e_bc166b8ccc5d.slice/crio-8cc29d3d638cc55e74c3a17630a15b4c66d5c863e647daa9fd0264b31904dffe WatchSource:0}: Error finding container 8cc29d3d638cc55e74c3a17630a15b4c66d5c863e647daa9fd0264b31904dffe: Status 404 returned error can't find the container with id 8cc29d3d638cc55e74c3a17630a15b4c66d5c863e647daa9fd0264b31904dffe Sep 11 03:05:36.284064 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:36.284028 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" event={"ID":"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d","Type":"ContainerStarted","Data":"a74bc76ec49a77246b08a3c391c3855fdbf298656c896aaf5589d2562148fedb"} Sep 11 03:05:36.284462 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:36.284081 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" event={"ID":"e2cc73b1-64e6-421c-a72e-bc166b8ccc5d","Type":"ContainerStarted","Data":"8cc29d3d638cc55e74c3a17630a15b4c66d5c863e647daa9fd0264b31904dffe"} Sep 11 03:05:36.284462 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:36.284166 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:36.302854 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:36.302809 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" podStartSLOduration=2.302795847 podStartE2EDuration="2.302795847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 03:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 03:05:36.302315125 +0000 UTC m=+294.694435578" watchObservedRunningTime="2026-09-11 03:05:36.302795847 +0000 UTC m=+294.694916300" Sep 11 03:05:37.308987 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:37.308954 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m74xm_e9fcf0c4-0268-4723-aa14-f929988cf4d8/dns/0.log" Sep 11 03:05:37.334459 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:37.334438 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m74xm_e9fcf0c4-0268-4723-aa14-f929988cf4d8/kube-rbac-proxy/0.log" Sep 11 03:05:37.359918 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:37.359890 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b6vc6_fe5d4f81-2ac2-450d-bea5-cc07ef951b4f/dns-node-resolver/0.log" Sep 11 03:05:37.830707 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:37.830662 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-857d77cbcb-87wq9_f02fc9c9-6b42-4952-84c6-3d40268fff0e/registry/0.log" Sep 11 03:05:37.853554 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:37.853527 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5s8k9_9c08f534-bb6e-4c9a-b96e-9089b7dd7f13/node-ca/0.log" Sep 11 03:05:39.021978 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:39.021938 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2nxht_c43d652d-54bc-4b85-93c3-31fda5738b4d/serve-healthcheck-canary/0.log" Sep 11 03:05:39.489686 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:39.489571 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2tnk6_4a75a9ee-a647-484c-bda2-af0bf15fd10a/kube-rbac-proxy/0.log" Sep 11 03:05:39.515524 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:39.515500 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2tnk6_4a75a9ee-a647-484c-bda2-af0bf15fd10a/exporter/0.log" Sep 11 03:05:39.549356 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:39.549315 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2tnk6_4a75a9ee-a647-484c-bda2-af0bf15fd10a/extractor/0.log" Sep 11 03:05:42.042105 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:42.042074 2578 kubelet.go:1648] "Image garbage collection succeeded" Sep 11 03:05:42.297478 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:42.297421 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xpmrb/perf-node-gather-daemonset-5vjcb" Sep 11 03:05:45.217742 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:45.217705 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8hbq6_3826679d-a5dd-4ab3-9a8e-be0fb58a45b6/kube-multus/0.log" Sep 11 03:05:45.590662 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:45.590605 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gk79t_3fb21f61-b549-419a-87cb-195db9fae336/kube-multus-additional-cni-plugins/0.log" Sep 11 03:05:45.622062 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:45.622022 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gk79t_3fb21f61-b549-419a-87cb-195db9fae336/egress-router-binary-copy/0.log" Sep 11 03:05:45.647665 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:45.647644 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gk79t_3fb21f61-b549-419a-87cb-195db9fae336/cni-plugins/0.log" Sep 11 03:05:45.675610 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:45.675581 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gk79t_3fb21f61-b549-419a-87cb-195db9fae336/bond-cni-plugin/0.log" Sep 11 03:05:45.697793 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:45.697732 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gk79t_3fb21f61-b549-419a-87cb-195db9fae336/routeoverride-cni/0.log" Sep 11 03:05:45.722593 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:45.722570 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gk79t_3fb21f61-b549-419a-87cb-195db9fae336/whereabouts-cni-bincopy/0.log" Sep 11 03:05:45.742528 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:45.742507 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gk79t_3fb21f61-b549-419a-87cb-195db9fae336/whereabouts-cni/0.log" Sep 11 03:05:45.942761 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:45.942738 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k2wzg_01cf8be0-13ee-435e-a356-1409d7acd0ff/network-metrics-daemon/0.log" Sep 11 03:05:45.975240 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:45.975182 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k2wzg_01cf8be0-13ee-435e-a356-1409d7acd0ff/kube-rbac-proxy/0.log" Sep 11 03:05:47.132427 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:47.132401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvdjq_53b83871-0cde-4f5f-82ea-041a73274b90/ovn-controller/0.log" Sep 11 03:05:47.157126 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:47.157081 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvdjq_53b83871-0cde-4f5f-82ea-041a73274b90/ovn-acl-logging/0.log" Sep 11 03:05:47.181952 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:47.181928 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvdjq_53b83871-0cde-4f5f-82ea-041a73274b90/kube-rbac-proxy-node/0.log" Sep 11 03:05:47.225288 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:47.225264 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvdjq_53b83871-0cde-4f5f-82ea-041a73274b90/kube-rbac-proxy-ovn-metrics/0.log" Sep 11 03:05:47.248375 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:47.248353 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvdjq_53b83871-0cde-4f5f-82ea-041a73274b90/northd/0.log" Sep 11 03:05:47.273516 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:47.273496 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvdjq_53b83871-0cde-4f5f-82ea-041a73274b90/nbdb/0.log" Sep 11 03:05:47.297648 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:47.297628 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvdjq_53b83871-0cde-4f5f-82ea-041a73274b90/sbdb/0.log" Sep 11 03:05:47.342317 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:47.342287 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vvdjq_53b83871-0cde-4f5f-82ea-041a73274b90/ovnkube-controller/0.log" Sep 11 03:05:48.348501 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:48.348465 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pv5qr_281c0b4f-2a67-475a-8a24-ca7e2b78ad84/network-check-target-container/0.log" Sep 11 03:05:49.328830 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:49.328803 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-kb29j_181a399f-574e-4669-a467-43fe5668e62d/iptables-alerter/0.log" Sep 11 03:05:49.972475 ip-10-0-138-232 kubenswrapper[2578]: I0911 03:05:49.972449 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-864b8_e804423a-8c29-40a0-b798-4190c0c623a6/tuned/0.log"