Sep 16 19:38:59.951943 ip-10-0-141-132 systemd[1]: Starting Kubernetes Kubelet... Sep 16 19:39:00.383710 ip-10-0-141-132 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 19:39:00.383710 ip-10-0-141-132 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 16 19:39:00.383710 ip-10-0-141-132 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 19:39:00.383710 ip-10-0-141-132 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 16 19:39:00.383710 ip-10-0-141-132 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 19:39:00.385756 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.385655 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 16 19:39:00.389127 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389102 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:39:00.389127 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389124 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:39:00.389127 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389129 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:39:00.389127 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389132 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389136 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389139 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389144 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389149 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389152 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389156 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389158 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389161 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389164 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389176 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389179 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389181 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389184 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389186 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389189 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389192 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389194 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389197 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389199 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:39:00.389256 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389202 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389205 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389208 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389210 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389213 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389216 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389218 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389221 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389224 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389226 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389229 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389232 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389234 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389237 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389240 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389243 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389245 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389248 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389251 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:39:00.389761 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389253 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389257 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389259 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389263 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389265 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389268 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389271 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389273 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389276 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389278 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389281 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389284 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389286 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389289 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389291 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389294 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389297 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389300 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389303 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389307 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:39:00.390224 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389312 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389315 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389319 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389322 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389325 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389328 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389331 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389334 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389337 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389340 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389342 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389345 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389347 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389350 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389353 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389356 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389358 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389363 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389365 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:39:00.391049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389368 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389370 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389373 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389376 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389378 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389381 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389383 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389386 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389389 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389391 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389394 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389397 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389399 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389402 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389404 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389407 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389409 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.389412 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390145 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390152 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:39:00.391686 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390156 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390159 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390161 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390164 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390166 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390169 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390172 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390175 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390178 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.390236 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391504 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391517 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391522 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391526 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391530 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391533 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391537 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391540 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391544 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391547 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:39:00.392195 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391550 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391554 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391557 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391563 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391567 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391570 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391573 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391576 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391579 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391582 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391585 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391589 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391593 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391596 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391600 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391624 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391632 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391635 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391639 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:39:00.392724 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391641 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391644 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391647 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391651 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391654 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391657 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391660 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391663 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391666 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391671 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391676 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391679 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391681 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391685 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391688 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391691 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391694 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391698 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391702 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391705 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:39:00.393329 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391708 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391714 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391717 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391719 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391722 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391725 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391727 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391730 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391733 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391736 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391738 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391741 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391744 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391746 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391751 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391754 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391758 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391761 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391764 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391766 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:39:00.393856 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391769 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391772 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391774 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391778 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391780 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391789 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391793 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391796 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391799 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391803 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391805 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391808 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391811 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391816 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391820 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391824 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391827 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.391834 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392510 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:39:00.394368 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392516 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392520 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392523 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392526 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392529 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392531 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392534 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392537 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392540 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392547 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392550 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392552 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392555 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392558 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392561 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392564 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392567 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392570 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392573 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392576 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:39:00.394890 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392578 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392582 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392587 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392590 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392593 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392596 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392601 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392616 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392619 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392622 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392624 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392627 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392630 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392633 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392638 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392641 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392643 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392646 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392649 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:39:00.395385 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392651 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392654 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392657 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392660 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392663 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392665 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392668 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392671 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392676 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392680 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392683 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392685 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392688 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392691 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392694 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392697 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392699 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392702 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392705 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392708 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:39:00.395870 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392711 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392717 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392720 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392723 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392725 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392728 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392732 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392736 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392739 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392742 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392745 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392747 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392753 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392755 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392758 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392761 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392765 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392768 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392771 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392774 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:39:00.396401 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392777 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392780 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392783 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392788 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392791 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392794 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392798 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392801 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392804 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392807 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392810 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392813 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392816 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392819 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392822 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392824 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392830 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392832 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.392835 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393277 2577 flags.go:64] FLAG: --address="0.0.0.0" Sep 16 19:39:00.396922 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393344 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393353 2577 flags.go:64] FLAG: --anonymous-auth="true" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393359 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393365 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393368 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393373 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393378 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393381 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393385 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393389 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393394 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393397 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393402 2577 flags.go:64] FLAG: --cgroup-root="" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393406 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393410 2577 flags.go:64] FLAG: --client-ca-file="" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393414 2577 flags.go:64] FLAG: --cloud-provider="external" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393417 2577 flags.go:64] FLAG: --cluster-dns="[]" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393422 2577 flags.go:64] FLAG: --cluster-domain="" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393425 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393428 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393431 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393435 2577 flags.go:64] FLAG: --container-log-max-files="5" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393439 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 16 19:39:00.397417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393442 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393446 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393449 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393452 2577 flags.go:64] FLAG: --contention-profiling="false" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393455 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393458 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393462 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393465 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393470 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393473 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393477 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393480 2577 flags.go:64] FLAG: --enable-load-reader="false" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393484 2577 flags.go:64] FLAG: --enable-server="true" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393487 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393492 2577 flags.go:64] FLAG: --event-burst="100" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393495 2577 flags.go:64] FLAG: --event-qps="50" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393499 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393502 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393505 2577 flags.go:64] FLAG: --eviction-hard="" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393509 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393512 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393515 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393518 2577 flags.go:64] FLAG: --eviction-soft="" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393521 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393524 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 16 19:39:00.398075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393527 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393530 2577 flags.go:64] FLAG: --experimental-mounter-path="" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393533 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393536 2577 flags.go:64] FLAG: --fail-swap-on="true" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393539 2577 flags.go:64] FLAG: --feature-gates="" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393543 2577 flags.go:64] FLAG: --file-check-frequency="20s" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393547 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393550 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393553 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393556 2577 flags.go:64] FLAG: --healthz-port="10248" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393559 2577 flags.go:64] FLAG: --help="false" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393562 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393565 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393569 2577 flags.go:64] FLAG: --http-check-frequency="20s" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393572 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393576 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393581 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393585 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393588 2577 flags.go:64] FLAG: --image-service-endpoint="" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393591 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393594 2577 flags.go:64] FLAG: --kube-api-burst="100" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393597 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393600 2577 flags.go:64] FLAG: --kube-api-qps="50" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393615 2577 flags.go:64] FLAG: --kube-reserved="" Sep 16 19:39:00.398735 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393618 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393622 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393625 2577 flags.go:64] FLAG: --kubelet-cgroups="" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393629 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393632 2577 flags.go:64] FLAG: --lock-file="" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393635 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393638 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393641 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393647 2577 flags.go:64] FLAG: --log-json-split-stream="false" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393650 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393653 2577 flags.go:64] FLAG: --log-text-split-stream="false" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393656 2577 flags.go:64] FLAG: --logging-format="text" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393660 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393663 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393666 2577 flags.go:64] FLAG: --manifest-url="" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393669 2577 flags.go:64] FLAG: --manifest-url-header="" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393674 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393678 2577 flags.go:64] FLAG: --max-open-files="1000000" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393682 2577 flags.go:64] FLAG: --max-pods="110" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393686 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393689 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393692 2577 flags.go:64] FLAG: --memory-manager-policy="None" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393695 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393699 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393706 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 16 19:39:00.399338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393709 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393720 2577 flags.go:64] FLAG: --node-status-max-images="50" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393723 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393726 2577 flags.go:64] FLAG: --oom-score-adj="-999" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393729 2577 flags.go:64] FLAG: --pod-cidr="" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393732 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393738 2577 flags.go:64] FLAG: --pod-manifest-path="" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393741 2577 flags.go:64] FLAG: --pod-max-pids="-1" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393744 2577 flags.go:64] FLAG: --pods-per-core="0" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393747 2577 flags.go:64] FLAG: --port="10250" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393751 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393754 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0398bbcd3da26ba84" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393757 2577 flags.go:64] FLAG: --qos-reserved="" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393760 2577 flags.go:64] FLAG: --read-only-port="10255" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393763 2577 flags.go:64] FLAG: --register-node="true" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393766 2577 flags.go:64] FLAG: --register-with-taints="" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393771 2577 flags.go:64] FLAG: --registry-burst="10" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393774 2577 flags.go:64] FLAG: --registry-qps="5" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393776 2577 flags.go:64] FLAG: --reserved-cpus="" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393779 2577 flags.go:64] FLAG: --reserved-memory="" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393783 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393786 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393789 2577 flags.go:64] FLAG: --rotate-certificates="false" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393792 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393795 2577 flags.go:64] FLAG: --runonce="false" Sep 16 19:39:00.399996 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393798 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393802 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393805 2577 flags.go:64] FLAG: --seccomp-default="false" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393810 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393813 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393817 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393820 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393825 2577 flags.go:64] FLAG: --storage-driver-password="root" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393829 2577 flags.go:64] FLAG: --storage-driver-secure="false" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393832 2577 flags.go:64] FLAG: --storage-driver-table="stats" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393835 2577 flags.go:64] FLAG: --storage-driver-user="root" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393838 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393842 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393845 2577 flags.go:64] FLAG: --system-cgroups="" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393848 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393855 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393859 2577 flags.go:64] FLAG: --tls-cert-file="" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393861 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393866 2577 flags.go:64] FLAG: --tls-min-version="" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393869 2577 flags.go:64] FLAG: --tls-private-key-file="" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393873 2577 flags.go:64] FLAG: --topology-manager-policy="none" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393876 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393880 2577 flags.go:64] FLAG: --topology-manager-scope="container" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393883 2577 flags.go:64] FLAG: --v="2" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393887 2577 flags.go:64] FLAG: --version="false" Sep 16 19:39:00.400620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393892 2577 flags.go:64] FLAG: --vmodule="" Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393897 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.393900 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394033 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394038 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394042 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394045 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394048 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394051 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394053 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394056 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394060 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394064 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394067 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394071 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394075 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394080 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394083 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394086 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394089 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:39:00.401287 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394092 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394095 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394098 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394101 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394104 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394106 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394109 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394112 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394114 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394117 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394120 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394123 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394126 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394129 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394132 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394134 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394138 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394140 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394143 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394146 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:39:00.401823 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394149 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394152 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394154 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394157 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394164 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394168 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394173 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394176 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394179 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394182 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394185 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394188 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394190 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394193 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394196 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394199 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394201 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394204 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394207 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:39:00.402335 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394210 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394213 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394216 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394218 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394221 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394225 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394230 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394234 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394238 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394241 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394244 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394248 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394264 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394267 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394270 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394273 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394276 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394283 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394287 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394292 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:39:00.402907 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394295 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394298 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394301 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394304 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394307 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394310 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394312 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394315 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394318 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394321 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394324 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394326 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394329 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394331 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394334 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394337 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394340 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394343 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394345 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394370 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:39:00.403403 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394375 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:39:00.403915 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394379 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:39:00.403915 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.394383 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:39:00.403915 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.395118 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 19:39:00.403915 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.403420 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 16 19:39:00.403915 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.403446 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 16 19:39:00.404310 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.404297 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 16 19:39:00.404349 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.404314 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 16 19:39:00.404382 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404377 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:39:00.404411 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404385 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:39:00.404411 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404388 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:39:00.404411 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404393 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:39:00.404411 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404396 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:39:00.404411 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404399 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:39:00.404411 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404402 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:39:00.404411 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404406 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:39:00.404411 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404409 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:39:00.404411 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404412 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:39:00.404411 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404416 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404419 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404422 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404425 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404428 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404430 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404433 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404435 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404439 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404444 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404446 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404449 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404451 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404454 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404457 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404459 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404462 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404465 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404468 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404472 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:39:00.404670 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404475 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404477 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404481 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404485 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404488 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404492 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404495 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404498 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404501 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404504 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404507 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404510 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404512 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404515 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404520 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404523 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404527 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404530 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404533 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:39:00.405208 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404535 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404538 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404541 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404543 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404546 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404548 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404551 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404554 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404557 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404560 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404562 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404566 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404570 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404575 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404578 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404580 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404583 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404586 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404589 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404592 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:39:00.405700 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404594 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404597 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404600 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404615 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404618 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404621 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404623 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404627 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404630 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404633 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404636 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404638 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404641 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404643 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404646 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404649 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404651 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404654 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404656 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404659 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:39:00.406192 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404661 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404664 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404667 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404670 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404673 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404676 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404680 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404683 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404686 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404688 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.404693 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404819 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404823 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404826 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404829 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 19:39:00.406718 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404832 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404837 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404840 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404844 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404847 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404851 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404854 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404857 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404860 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404863 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404865 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404868 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404871 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404874 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404877 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404880 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404882 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404885 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404887 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 19:39:00.407091 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404890 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404893 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404896 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404900 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404903 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404906 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404909 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404912 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404914 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404917 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404920 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404923 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404925 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404928 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404930 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404933 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404936 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404938 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404941 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 19:39:00.407559 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404944 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404946 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404949 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404952 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404954 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404957 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404959 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404962 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404965 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404967 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404970 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404973 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404975 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404978 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404982 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404985 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404988 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404991 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404994 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404997 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 19:39:00.408049 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.404999 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405003 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405005 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405008 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405011 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405013 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405016 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405018 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405021 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405024 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405027 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405030 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405032 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405035 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405037 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405040 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405043 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405045 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405048 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405050 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 19:39:00.408540 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405053 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405055 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405058 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405060 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405063 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405065 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405068 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405070 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405073 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405075 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405078 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405081 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405084 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405087 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405090 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405093 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 19:39:00.409067 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:00.405096 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 19:39:00.409458 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.405100 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 19:39:00.409458 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.405251 2577 server.go:962] "Client rotation is on, will bootstrap in background" Sep 16 19:39:00.409458 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.408663 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 16 19:39:00.409776 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.409759 2577 server.go:1019] "Starting client certificate rotation" Sep 16 19:39:00.409895 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.409870 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 19:39:00.409940 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.409929 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 19:39:00.413408 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.413387 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 19:39:00.415050 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.415022 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 19:39:00.427472 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.427447 2577 log.go:25] "Validated CRI v1 runtime API" Sep 16 19:39:00.434813 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.434788 2577 log.go:25] "Validated CRI v1 image API" Sep 16 19:39:00.435909 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.435886 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 16 19:39:00.438466 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.438439 2577 fs.go:135] Filesystem UUIDs: map[18d58cee-2f59-441f-bb9c-271cb3471d71:/dev/nvme0n1p4 4d0a48eb-360c-430a-8457-06040bd3dac7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 16 19:39:00.438560 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.438465 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 16 19:39:00.446587 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.446434 2577 manager.go:216] Machine: {Timestamp:2026-09-16 19:39:00.445007527 +0000 UTC m=+0.376966539 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099897 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25ce8946acfb02448de508323b41cc SystemUUID:ec25ce89-46ac-fb02-448d-e508323b41cc BootID:181e87b9-50ae-47ef-8fcb-a57c9e666dcf Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d7:e1:57:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d7:e1:57:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:fc:7e:12:04:1c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 16 19:39:00.446587 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.446558 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 16 19:39:00.446822 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.446682 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 16 19:39:00.450213 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.450187 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 19:39:00.450645 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.450588 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 16 19:39:00.450798 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.450650 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-132.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 16 19:39:00.451553 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.451541 2577 topology_manager.go:138] "Creating topology manager with none policy" Sep 16 19:39:00.451616 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.451555 2577 container_manager_linux.go:309] "Creating device plugin manager" Sep 16 19:39:00.452241 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.452227 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 19:39:00.452289 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.452249 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 19:39:00.454142 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.454127 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 16 19:39:00.459816 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.459791 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 16 19:39:00.459963 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.459952 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 16 19:39:00.460016 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.459986 2577 kubelet.go:486] "Attempting to sync node with API server" Sep 16 19:39:00.460016 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.459997 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 16 19:39:00.460016 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.460014 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 16 19:39:00.460133 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.460026 2577 kubelet.go:398] "Adding apiserver pod source" Sep 16 19:39:00.460133 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.460036 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 16 19:39:00.460443 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.460429 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 19:39:00.460486 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.460455 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 19:39:00.463013 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.462988 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 16 19:39:00.466223 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.466205 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 16 19:39:00.466335 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.466237 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 16 19:39:00.468410 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468391 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 16 19:39:00.468410 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468415 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 16 19:39:00.468532 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468425 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 16 19:39:00.468532 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468433 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 16 19:39:00.468532 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468445 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 16 19:39:00.468532 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468453 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 16 19:39:00.468532 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468470 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 16 19:39:00.468532 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468475 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 16 19:39:00.468532 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468482 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 16 19:39:00.468532 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468488 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 16 19:39:00.468532 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468499 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 16 19:39:00.468532 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.468506 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 16 19:39:00.470262 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.470240 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 16 19:39:00.470262 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.470262 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 16 19:39:00.470982 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.470961 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-132.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 16 19:39:00.471040 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.471014 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 16 19:39:00.474278 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.474261 2577 server.go:1268] "Started kubelet" Sep 16 19:39:00.474386 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.474349 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 16 19:39:00.474444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.474353 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 16 19:39:00.474444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.474438 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 16 19:39:00.475257 ip-10-0-141-132 systemd[1]: Started Kubernetes Kubelet. Sep 16 19:39:00.475564 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.475547 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-132.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 16 19:39:00.476014 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.475857 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 16 19:39:00.477017 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.477000 2577 server.go:310] "Adding debug handlers to kubelet server" Sep 16 19:39:00.479413 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.479392 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 16 19:39:00.483303 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.482142 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-132.ec2.internal.18d5e462ec6e3df0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-132.ec2.internal,UID:ip-10-0-141-132.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-132.ec2.internal,},FirstTimestamp:2026-09-16 19:39:00.47421592 +0000 UTC m=+0.406174935,LastTimestamp:2026-09-16 19:39:00.47421592 +0000 UTC m=+0.406174935,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-132.ec2.internal,}" Sep 16 19:39:00.483773 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.483753 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 16 19:39:00.484463 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.484446 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 16 19:39:00.484633 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.484591 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" Sep 16 19:39:00.485298 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.485267 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 16 19:39:00.486359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.485550 2577 factory.go:55] Registering systemd factory Sep 16 19:39:00.486359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.485567 2577 factory.go:223] Registration of the systemd container factory successfully Sep 16 19:39:00.486359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.485646 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 16 19:39:00.486359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.485659 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 16 19:39:00.486359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.485834 2577 factory.go:153] Registering CRI-O factory Sep 16 19:39:00.486359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.485844 2577 factory.go:223] Registration of the crio container factory successfully Sep 16 19:39:00.486359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.485891 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 16 19:39:00.486359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.485905 2577 factory.go:103] Registering Raw factory Sep 16 19:39:00.486359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.485915 2577 manager.go:1196] Started watching for new ooms in manager Sep 16 19:39:00.486359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.486320 2577 manager.go:349] Starting recovery of all containers Sep 16 19:39:00.486922 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.486826 2577 reconstruct.go:97] "Volume reconstruction finished" Sep 16 19:39:00.486922 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.486837 2577 reconciler.go:29] "Reconciler: start to sync state" Sep 16 19:39:00.492590 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.492548 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2k6ls" Sep 16 19:39:00.496044 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.495988 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-132.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 16 19:39:00.496466 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.496426 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 16 19:39:00.500786 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.500759 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2k6ls" Sep 16 19:39:00.502800 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.502778 2577 manager.go:354] Recovery completed Sep 16 19:39:00.507213 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.507194 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:39:00.509219 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.509203 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:39:00.509278 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.509234 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:39:00.509278 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.509244 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:39:00.509822 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.509808 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 16 19:39:00.509822 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.509820 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 16 19:39:00.509954 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.509826 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:39:00.509954 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.509840 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 16 19:39:00.510554 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.510537 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:39:00.510664 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.510570 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:39:00.510664 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.510586 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:39:00.511408 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.511332 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-132.ec2.internal.18d5e462ee845c35 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-132.ec2.internal,UID:ip-10-0-141-132.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-132.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-132.ec2.internal,},FirstTimestamp:2026-09-16 19:39:00.509219893 +0000 UTC m=+0.441178904,LastTimestamp:2026-09-16 19:39:00.509219893 +0000 UTC m=+0.441178904,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-132.ec2.internal,}" Sep 16 19:39:00.512020 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.512003 2577 policy_none.go:49] "None policy: Start" Sep 16 19:39:00.512093 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.512024 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 16 19:39:00.512093 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.512034 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 16 19:39:00.514099 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.514083 2577 policy_none.go:47] "Start" Sep 16 19:39:00.552375 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.552351 2577 manager.go:337] "Starting Device Plugin manager" Sep 16 19:39:00.568173 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.552403 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 16 19:39:00.568173 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.552417 2577 server.go:87] "Starting device plugin registration server" Sep 16 19:39:00.568173 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.552860 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 16 19:39:00.568173 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.552871 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 16 19:39:00.568173 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.552970 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 16 19:39:00.568173 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.553078 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 16 19:39:00.568173 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.553086 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 16 19:39:00.568173 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.553688 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 16 19:39:00.568173 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.553738 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-132.ec2.internal\" not found" Sep 16 19:39:00.599982 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.599941 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 16 19:39:00.601216 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.601193 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 16 19:39:00.601321 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.601246 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 16 19:39:00.601321 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.601271 2577 kubelet.go:2448] "Starting kubelet main sync loop" Sep 16 19:39:00.601321 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.601315 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 16 19:39:00.604079 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.604055 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:39:00.653339 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.653205 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:39:00.654379 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.654362 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:39:00.654456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.654394 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:39:00.654456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.654408 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:39:00.654456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.654434 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.662938 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.662910 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.663063 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.662947 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-132.ec2.internal\": node \"ip-10-0-141-132.ec2.internal\" not found" Sep 16 19:39:00.691414 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.691382 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" Sep 16 19:39:00.702205 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.702179 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal"] Sep 16 19:39:00.702290 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.702261 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:39:00.703282 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.703247 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:39:00.703282 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.703279 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:39:00.703455 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.703294 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:39:00.705679 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.705662 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:39:00.705791 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.705774 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.705842 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.705802 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:39:00.706508 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.706492 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:39:00.706591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.706518 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:39:00.706591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.706527 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:39:00.706591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.706493 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:39:00.706713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.706593 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:39:00.706713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.706620 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:39:00.708898 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.708882 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.708991 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.708910 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 19:39:00.709826 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.709808 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" Sep 16 19:39:00.709921 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.709832 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 19:39:00.709921 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.709845 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" Sep 16 19:39:00.735585 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.735556 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-132.ec2.internal\" not found" node="ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.740661 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.740634 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-132.ec2.internal\" not found" node="ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.788346 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.788310 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8d32790f2c6baed10f52b7d81f7c1c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"f8d32790f2c6baed10f52b7d81f7c1c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.788346 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.788344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05f2cfd76c2cf0815635289ed034853f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-132.ec2.internal\" (UID: \"05f2cfd76c2cf0815635289ed034853f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.788512 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.788365 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8d32790f2c6baed10f52b7d81f7c1c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"f8d32790f2c6baed10f52b7d81f7c1c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.791498 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.791481 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" Sep 16 19:39:00.889316 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.889282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8d32790f2c6baed10f52b7d81f7c1c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"f8d32790f2c6baed10f52b7d81f7c1c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.889416 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.889322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05f2cfd76c2cf0815635289ed034853f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-132.ec2.internal\" (UID: \"05f2cfd76c2cf0815635289ed034853f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.889416 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.889340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8d32790f2c6baed10f52b7d81f7c1c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"f8d32790f2c6baed10f52b7d81f7c1c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.889416 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.889369 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8d32790f2c6baed10f52b7d81f7c1c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"f8d32790f2c6baed10f52b7d81f7c1c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.889511 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.889376 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8d32790f2c6baed10f52b7d81f7c1c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"f8d32790f2c6baed10f52b7d81f7c1c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.889511 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:00.889376 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05f2cfd76c2cf0815635289ed034853f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-132.ec2.internal\" (UID: \"05f2cfd76c2cf0815635289ed034853f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" Sep 16 19:39:00.892368 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.892347 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" Sep 16 19:39:00.993306 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:00.993239 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" Sep 16 19:39:01.038447 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.038416 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" Sep 16 19:39:01.044528 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.044508 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" Sep 16 19:39:01.093698 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.093662 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" Sep 16 19:39:01.194275 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.194237 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" Sep 16 19:39:01.277678 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.277578 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:39:01.285574 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.285551 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" Sep 16 19:39:01.302153 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.302124 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 19:39:01.303863 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.303844 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" Sep 16 19:39:01.315738 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.315713 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 19:39:01.326166 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.326141 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:39:01.409956 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.409922 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 16 19:39:01.410418 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.410086 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 19:39:01.410418 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.410087 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 19:39:01.410418 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.410126 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 19:39:01.461291 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.461257 2577 apiserver.go:52] "Watching apiserver" Sep 16 19:39:01.483893 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.483865 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 16 19:39:01.485806 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.485787 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 16 19:39:01.486848 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.486827 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c","openshift-cluster-node-tuning-operator/tuned-zff5x","openshift-multus/multus-additional-cni-plugins-27rx4","openshift-network-diagnostics/network-check-target-8dwkj","kube-system/konnectivity-agent-qtbtk","openshift-dns/node-resolver-dtb5f","openshift-image-registry/node-ca-rbd5j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal","openshift-multus/multus-wwj2p","openshift-multus/network-metrics-daemon-z9szj","openshift-network-operator/iptables-alerter-97lj4","openshift-ovn-kubernetes/ovnkube-node-4dk5x","kube-system/global-pull-secret-syncer-dm94l","kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal"] Sep 16 19:39:01.489359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.489328 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rbd5j" Sep 16 19:39:01.491460 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.491438 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:01.491560 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.491504 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:01.493672 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.493653 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.495262 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.495228 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 16 19:39:01.495487 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.495471 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 16 19:39:01.495814 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.495796 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:01.495899 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.495854 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:01.496897 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.496882 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bwrwv\"" Sep 16 19:39:01.498007 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.497988 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:01.498324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.498306 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 16 19:39:01.498384 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.498313 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 16 19:39:01.498439 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.498393 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 16 19:39:01.498439 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.498431 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rbhlg\"" Sep 16 19:39:01.498598 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.498583 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 16 19:39:01.498666 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.498644 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 16 19:39:01.498713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.498695 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 16 19:39:01.500134 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.500118 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dtb5f" Sep 16 19:39:01.500717 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.500690 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 19:39:01.502417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.502397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.504294 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.504260 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 19:34:01 +0000 UTC" deadline="2028-05-28 15:14:18.637297004 +0000 UTC" Sep 16 19:39:01.504294 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.504292 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14875h35m17.133007713s" Sep 16 19:39:01.505050 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.504741 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.507115 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.507097 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.507340 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.507322 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 16 19:39:01.507467 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.507454 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 16 19:39:01.507467 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.507459 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dngwf\"" Sep 16 19:39:01.507762 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.507743 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 16 19:39:01.508010 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.507996 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 16 19:39:01.508643 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.508627 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 16 19:39:01.508717 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.508660 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8l29s\"" Sep 16 19:39:01.508717 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.508667 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hv8w2\"" Sep 16 19:39:01.509118 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.509100 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 16 19:39:01.509118 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.509111 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wwkdq\"" Sep 16 19:39:01.509257 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.509141 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 16 19:39:01.509257 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.509174 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 16 19:39:01.509440 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.509427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:01.509500 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.509483 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:01.512394 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.512371 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-97lj4" Sep 16 19:39:01.513144 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.513124 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2jddg\"" Sep 16 19:39:01.513239 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.513182 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 16 19:39:01.513373 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.513360 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 16 19:39:01.514424 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.514403 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.519745 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.519720 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 16 19:39:01.519954 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.519730 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 16 19:39:01.520177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.520100 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 16 19:39:01.520177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.520166 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 16 19:39:01.522456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.520493 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6c5w4\"" Sep 16 19:39:01.522456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.520515 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 16 19:39:01.522456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.520554 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 16 19:39:01.522456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.521202 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 16 19:39:01.522456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.521403 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xkjqw\"" Sep 16 19:39:01.522456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.521659 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 16 19:39:01.522456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.521855 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 16 19:39:01.541658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.541632 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zd2p8" Sep 16 19:39:01.552966 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.552941 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zd2p8" Sep 16 19:39:01.587007 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.586984 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 16 19:39:01.592381 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-etc-openvswitch\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.592570 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-run-openvswitch\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.592570 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-run-ovn-kubernetes\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.592570 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43fe466d-e2b0-42b2-a5de-749975ccde74-kubelet-config\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:01.592570 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-socket-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.592570 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxh4n\" (UniqueName: \"kubernetes.io/projected/d9cf1ed3-355f-4d5b-b586-efdf563716f6-kube-api-access-xxh4n\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.592570 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592561 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e9c76d7-02d8-4ab9-9cd4-7f983331f938-tmp-dir\") pod \"node-resolver-dtb5f\" (UID: \"9e9c76d7-02d8-4ab9-9cd4-7f983331f938\") " pod="openshift-dns/node-resolver-dtb5f" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-run-ovn\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-node-log\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-log-socket\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-cni-bin\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/109ee397-68be-473b-9ef2-c5452e5bce1c-serviceca\") pod \"node-ca-rbd5j\" (UID: \"109ee397-68be-473b-9ef2-c5452e5bce1c\") " pod="openshift-image-registry/node-ca-rbd5j" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-ovn-node-metrics-cert\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43fe466d-e2b0-42b2-a5de-749975ccde74-dbus\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-multus-conf-dir\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-systemd\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-run-systemd\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-var-lib-kubelet\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.592853 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592849 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-modprobe-d\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-sysctl-d\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592884 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-sysctl-conf\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-kubelet\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592930 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkbjv\" (UniqueName: \"kubernetes.io/projected/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-kube-api-access-pkbjv\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-run-k8s-cni-cncf-io\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-var-lib-cni-multus\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-tuning-conf-dir\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.592992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e9c76d7-02d8-4ab9-9cd4-7f983331f938-hosts-file\") pod \"node-resolver-dtb5f\" (UID: \"9e9c76d7-02d8-4ab9-9cd4-7f983331f938\") " pod="openshift-dns/node-resolver-dtb5f" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-tuned\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593064 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42adfeb-3b56-4672-9925-afa9f94af53a-tmp\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8qrr\" (UniqueName: \"kubernetes.io/projected/9e165e27-f35c-44ab-a2a6-5c342b4d2436-kube-api-access-x8qrr\") pod \"iptables-alerter-97lj4\" (UID: \"9e165e27-f35c-44ab-a2a6-5c342b4d2436\") " pod="openshift-network-operator/iptables-alerter-97lj4" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-ovnkube-config\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-lib-modules\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.593324 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-kubernetes\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593205 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-sys\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f513231e-a653-417f-a71c-667eb54deddd-konnectivity-ca\") pod \"konnectivity-agent-qtbtk\" (UID: \"f513231e-a653-417f-a71c-667eb54deddd\") " pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593261 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/109ee397-68be-473b-9ef2-c5452e5bce1c-host\") pod \"node-ca-rbd5j\" (UID: \"109ee397-68be-473b-9ef2-c5452e5bce1c\") " pod="openshift-image-registry/node-ca-rbd5j" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593293 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvcsn\" (UniqueName: \"kubernetes.io/projected/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-kube-api-access-nvcsn\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-var-lib-kubelet\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhzr7\" (UniqueName: \"kubernetes.io/projected/7719810a-94e9-426e-a62c-59612c727a86-kube-api-access-lhzr7\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s246x\" (UniqueName: \"kubernetes.io/projected/9e9c76d7-02d8-4ab9-9cd4-7f983331f938-kube-api-access-s246x\") pod \"node-resolver-dtb5f\" (UID: \"9e9c76d7-02d8-4ab9-9cd4-7f983331f938\") " pod="openshift-dns/node-resolver-dtb5f" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-cni-netd\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-system-cni-dir\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-run\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-host\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-registration-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-multus-cni-dir\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-multus-socket-dir-parent\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-hostroot\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.594066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-cni-binary-copy\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-systemd-units\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-var-lib-cni-bin\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-var-lib-openvswitch\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-env-overrides\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-etc-kubernetes\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqt9c\" (UniqueName: \"kubernetes.io/projected/d59f8428-b82a-4081-aca2-8a277b37066c-kube-api-access-xqt9c\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnzmg\" (UniqueName: \"kubernetes.io/projected/109ee397-68be-473b-9ef2-c5452e5bce1c-kube-api-access-hnzmg\") pod \"node-ca-rbd5j\" (UID: \"109ee397-68be-473b-9ef2-c5452e5bce1c\") " pod="openshift-image-registry/node-ca-rbd5j" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-ovnkube-script-lib\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72v7v\" (UniqueName: \"kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v\") pod \"network-check-target-8dwkj\" (UID: \"86e7d337-42ba-46be-92ab-a8ddf79b3df5\") " pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-system-cni-dir\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7719810a-94e9-426e-a62c-59612c727a86-multus-daemon-config\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-sys-fs\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.593981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:01.594658 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e165e27-f35c-44ab-a2a6-5c342b4d2436-host-slash\") pod \"iptables-alerter-97lj4\" (UID: \"9e165e27-f35c-44ab-a2a6-5c342b4d2436\") " pod="openshift-network-operator/iptables-alerter-97lj4" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-device-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f513231e-a653-417f-a71c-667eb54deddd-agent-certs\") pod \"konnectivity-agent-qtbtk\" (UID: \"f513231e-a653-417f-a71c-667eb54deddd\") " pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7719810a-94e9-426e-a62c-59612c727a86-cni-binary-copy\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-run-netns\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-run-multus-certs\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-cnibin\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e165e27-f35c-44ab-a2a6-5c342b4d2436-iptables-alerter-script\") pod \"iptables-alerter-97lj4\" (UID: \"9e165e27-f35c-44ab-a2a6-5c342b4d2436\") " pod="openshift-network-operator/iptables-alerter-97lj4" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-slash\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-cnibin\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-sysconfig\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lcvl\" (UniqueName: \"kubernetes.io/projected/a42adfeb-3b56-4672-9925-afa9f94af53a-kube-api-access-2lcvl\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.595177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.594275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-run-netns\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.600062 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:01.600000 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f2cfd76c2cf0815635289ed034853f.slice/crio-8160197614dcd89153ea5e9b5a91062435551e028a64836fa64b4e19d54fd603 WatchSource:0}: Error finding container 8160197614dcd89153ea5e9b5a91062435551e028a64836fa64b4e19d54fd603: Status 404 returned error can't find the container with id 8160197614dcd89153ea5e9b5a91062435551e028a64836fa64b4e19d54fd603 Sep 16 19:39:01.600545 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:01.600486 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d32790f2c6baed10f52b7d81f7c1c1.slice/crio-7caef7ea2d2f5c816de15bfef6d2a10441ec4b0070a3c71f9732f225164ccecd WatchSource:0}: Error finding container 7caef7ea2d2f5c816de15bfef6d2a10441ec4b0070a3c71f9732f225164ccecd: Status 404 returned error can't find the container with id 7caef7ea2d2f5c816de15bfef6d2a10441ec4b0070a3c71f9732f225164ccecd Sep 16 19:39:01.606453 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.606433 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 19:39:01.695333 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72v7v\" (UniqueName: \"kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v\") pod \"network-check-target-8dwkj\" (UID: \"86e7d337-42ba-46be-92ab-a8ddf79b3df5\") " pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:01.695513 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-system-cni-dir\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.695513 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7719810a-94e9-426e-a62c-59612c727a86-multus-daemon-config\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.695513 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.695513 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-sys-fs\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.695513 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:01.695513 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.695513 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e165e27-f35c-44ab-a2a6-5c342b4d2436-host-slash\") pod \"iptables-alerter-97lj4\" (UID: \"9e165e27-f35c-44ab-a2a6-5c342b4d2436\") " pod="openshift-network-operator/iptables-alerter-97lj4" Sep 16 19:39:01.695513 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-device-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.695513 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f513231e-a653-417f-a71c-667eb54deddd-agent-certs\") pod \"konnectivity-agent-qtbtk\" (UID: \"f513231e-a653-417f-a71c-667eb54deddd\") " pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7719810a-94e9-426e-a62c-59612c727a86-cni-binary-copy\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-run-netns\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695580 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-system-cni-dir\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695588 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e165e27-f35c-44ab-a2a6-5c342b4d2436-host-slash\") pod \"iptables-alerter-97lj4\" (UID: \"9e165e27-f35c-44ab-a2a6-5c342b4d2436\") " pod="openshift-network-operator/iptables-alerter-97lj4" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695580 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695586 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-device-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-run-multus-certs\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695671 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-sys-fs\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695673 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-run-netns\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-cnibin\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695706 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-run-multus-certs\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e165e27-f35c-44ab-a2a6-5c342b4d2436-iptables-alerter-script\") pod \"iptables-alerter-97lj4\" (UID: \"9e165e27-f35c-44ab-a2a6-5c342b4d2436\") " pod="openshift-network-operator/iptables-alerter-97lj4" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-slash\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-cnibin\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-sysconfig\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lcvl\" (UniqueName: \"kubernetes.io/projected/a42adfeb-3b56-4672-9925-afa9f94af53a-kube-api-access-2lcvl\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-run-netns\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.695979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-etc-openvswitch\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.695979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-run-openvswitch\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-run-ovn-kubernetes\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43fe466d-e2b0-42b2-a5de-749975ccde74-kubelet-config\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-socket-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxh4n\" (UniqueName: \"kubernetes.io/projected/d9cf1ed3-355f-4d5b-b586-efdf563716f6-kube-api-access-xxh4n\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e9c76d7-02d8-4ab9-9cd4-7f983331f938-tmp-dir\") pod \"node-resolver-dtb5f\" (UID: \"9e9c76d7-02d8-4ab9-9cd4-7f983331f938\") " pod="openshift-dns/node-resolver-dtb5f" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-run-ovn\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-node-log\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-log-socket\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-cni-bin\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/109ee397-68be-473b-9ef2-c5452e5bce1c-serviceca\") pod \"node-ca-rbd5j\" (UID: \"109ee397-68be-473b-9ef2-c5452e5bce1c\") " pod="openshift-image-registry/node-ca-rbd5j" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696527 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-cnibin\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696532 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-slash\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-ovn-node-metrics-cert\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43fe466d-e2b0-42b2-a5de-749975ccde74-dbus\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696741 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-cnibin\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.696805 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.696746 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696832 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e165e27-f35c-44ab-a2a6-5c342b4d2436-iptables-alerter-script\") pod \"iptables-alerter-97lj4\" (UID: \"9e165e27-f35c-44ab-a2a6-5c342b4d2436\") " pod="openshift-network-operator/iptables-alerter-97lj4" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.696886 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs podName:d59f8428-b82a-4081-aca2-8a277b37066c nodeName:}" failed. No retries permitted until 2026-09-16 19:39:02.196829917 +0000 UTC m=+2.128788936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs") pod "network-metrics-daemon-z9szj" (UID: "d59f8428-b82a-4081-aca2-8a277b37066c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696897 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7719810a-94e9-426e-a62c-59612c727a86-cni-binary-copy\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.696954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-multus-conf-dir\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697015 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-run-netns\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697029 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-sysconfig\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697057 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-etc-openvswitch\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697103 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-multus-conf-dir\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697112 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43fe466d-e2b0-42b2-a5de-749975ccde74-kubelet-config\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-systemd\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-run-systemd\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697210 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-socket-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-var-lib-kubelet\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697273 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-node-log\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697281 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-var-lib-kubelet\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-modprobe-d\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.697623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-sysctl-d\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697347 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-run-ovn\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-sysctl-conf\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697399 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-run-systemd\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697460 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43fe466d-e2b0-42b2-a5de-749975ccde74-dbus\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697492 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-kubelet\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697573 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-cni-bin\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697645 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697658 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-sysctl-d\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697707 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-run-openvswitch\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697718 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-sysctl-conf\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697719 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-kubelet\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697764 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-systemd\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697769 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-log-socket\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkbjv\" (UniqueName: \"kubernetes.io/projected/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-kube-api-access-pkbjv\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-run-k8s-cni-cncf-io\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697940 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7719810a-94e9-426e-a62c-59612c727a86-multus-daemon-config\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.698368 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.697968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-var-lib-cni-multus\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698015 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-var-lib-cni-multus\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698058 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-run-k8s-cni-cncf-io\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-tuning-conf-dir\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e9c76d7-02d8-4ab9-9cd4-7f983331f938-hosts-file\") pod \"node-resolver-dtb5f\" (UID: \"9e9c76d7-02d8-4ab9-9cd4-7f983331f938\") " pod="openshift-dns/node-resolver-dtb5f" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-tuned\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42adfeb-3b56-4672-9925-afa9f94af53a-tmp\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8qrr\" (UniqueName: \"kubernetes.io/projected/9e165e27-f35c-44ab-a2a6-5c342b4d2436-kube-api-access-x8qrr\") pod \"iptables-alerter-97lj4\" (UID: \"9e165e27-f35c-44ab-a2a6-5c342b4d2436\") " pod="openshift-network-operator/iptables-alerter-97lj4" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-ovnkube-config\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-lib-modules\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698478 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/109ee397-68be-473b-9ef2-c5452e5bce1c-serviceca\") pod \"node-ca-rbd5j\" (UID: \"109ee397-68be-473b-9ef2-c5452e5bce1c\") " pod="openshift-image-registry/node-ca-rbd5j" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698522 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-lib-modules\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698583 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-modprobe-d\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698862 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e9c76d7-02d8-4ab9-9cd4-7f983331f938-tmp-dir\") pod \"node-resolver-dtb5f\" (UID: \"9e9c76d7-02d8-4ab9-9cd4-7f983331f938\") " pod="openshift-dns/node-resolver-dtb5f" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698936 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.699207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.698997 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.700547 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700156 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-tuning-conf-dir\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.700547 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700217 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-run-ovn-kubernetes\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.700547 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700272 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e9c76d7-02d8-4ab9-9cd4-7f983331f938-hosts-file\") pod \"node-resolver-dtb5f\" (UID: \"9e9c76d7-02d8-4ab9-9cd4-7f983331f938\") " pod="openshift-dns/node-resolver-dtb5f" Sep 16 19:39:01.700547 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.700357 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:01.700547 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.700413 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret podName:43fe466d-e2b0-42b2-a5de-749975ccde74 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:02.200390483 +0000 UTC m=+2.132349502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret") pod "global-pull-secret-syncer-dm94l" (UID: "43fe466d-e2b0-42b2-a5de-749975ccde74") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:01.700547 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-kubernetes\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700596 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-kubernetes\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-sys\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f513231e-a653-417f-a71c-667eb54deddd-konnectivity-ca\") pod \"konnectivity-agent-qtbtk\" (UID: \"f513231e-a653-417f-a71c-667eb54deddd\") " pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/109ee397-68be-473b-9ef2-c5452e5bce1c-host\") pod \"node-ca-rbd5j\" (UID: \"109ee397-68be-473b-9ef2-c5452e5bce1c\") " pod="openshift-image-registry/node-ca-rbd5j" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvcsn\" (UniqueName: \"kubernetes.io/projected/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-kube-api-access-nvcsn\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-var-lib-kubelet\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhzr7\" (UniqueName: \"kubernetes.io/projected/7719810a-94e9-426e-a62c-59612c727a86-kube-api-access-lhzr7\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700848 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-ovnkube-config\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700917 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/109ee397-68be-473b-9ef2-c5452e5bce1c-host\") pod \"node-ca-rbd5j\" (UID: \"109ee397-68be-473b-9ef2-c5452e5bce1c\") " pod="openshift-image-registry/node-ca-rbd5j" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.700991 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-var-lib-kubelet\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701007 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-sys\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s246x\" (UniqueName: \"kubernetes.io/projected/9e9c76d7-02d8-4ab9-9cd4-7f983331f938-kube-api-access-s246x\") pod \"node-resolver-dtb5f\" (UID: \"9e9c76d7-02d8-4ab9-9cd4-7f983331f938\") " pod="openshift-dns/node-resolver-dtb5f" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-cni-netd\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701279 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-cni-netd\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-system-cni-dir\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-run\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-host\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.702700 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701485 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-system-cni-dir\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701499 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-run\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-registration-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701549 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a42adfeb-3b56-4672-9925-afa9f94af53a-host\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-multus-cni-dir\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701615 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f513231e-a653-417f-a71c-667eb54deddd-konnectivity-ca\") pod \"konnectivity-agent-qtbtk\" (UID: \"f513231e-a653-417f-a71c-667eb54deddd\") " pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701625 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9cf1ed3-355f-4d5b-b586-efdf563716f6-registration-dir\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701696 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-multus-cni-dir\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-multus-socket-dir-parent\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-hostroot\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-cni-binary-copy\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-systemd-units\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701858 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-hostroot\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701886 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-var-lib-cni-bin\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-var-lib-openvswitch\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701826 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-multus-socket-dir-parent\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701947 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-systemd-units\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.701976 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-var-lib-openvswitch\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.703507 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.702011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.702042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-env-overrides\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.702074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-etc-kubernetes\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.702108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqt9c\" (UniqueName: \"kubernetes.io/projected/d59f8428-b82a-4081-aca2-8a277b37066c-kube-api-access-xqt9c\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.702110 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-host-var-lib-cni-bin\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.702119 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.702171 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7719810a-94e9-426e-a62c-59612c727a86-etc-kubernetes\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.702517 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-env-overrides\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.703052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnzmg\" (UniqueName: \"kubernetes.io/projected/109ee397-68be-473b-9ef2-c5452e5bce1c-kube-api-access-hnzmg\") pod \"node-ca-rbd5j\" (UID: \"109ee397-68be-473b-9ef2-c5452e5bce1c\") " pod="openshift-image-registry/node-ca-rbd5j" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.703098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-ovnkube-script-lib\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.703278 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42adfeb-3b56-4672-9925-afa9f94af53a-tmp\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.703056 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-cni-binary-copy\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.703422 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a42adfeb-3b56-4672-9925-afa9f94af53a-etc-tuned\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.703434 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-ovn-node-metrics-cert\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.703601 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-ovnkube-script-lib\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.704041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.703536 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f513231e-a653-417f-a71c-667eb54deddd-agent-certs\") pod \"konnectivity-agent-qtbtk\" (UID: \"f513231e-a653-417f-a71c-667eb54deddd\") " pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:01.716375 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.716343 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxh4n\" (UniqueName: \"kubernetes.io/projected/d9cf1ed3-355f-4d5b-b586-efdf563716f6-kube-api-access-xxh4n\") pod \"aws-ebs-csi-driver-node-69r8c\" (UID: \"d9cf1ed3-355f-4d5b-b586-efdf563716f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.716595 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.716575 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s246x\" (UniqueName: \"kubernetes.io/projected/9e9c76d7-02d8-4ab9-9cd4-7f983331f938-kube-api-access-s246x\") pod \"node-resolver-dtb5f\" (UID: \"9e9c76d7-02d8-4ab9-9cd4-7f983331f938\") " pod="openshift-dns/node-resolver-dtb5f" Sep 16 19:39:01.717721 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.717701 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkbjv\" (UniqueName: \"kubernetes.io/projected/012becf2-a2fe-4cc9-a3cc-9f5978cf917d-kube-api-access-pkbjv\") pod \"ovnkube-node-4dk5x\" (UID: \"012becf2-a2fe-4cc9-a3cc-9f5978cf917d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.717872 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.717857 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8qrr\" (UniqueName: \"kubernetes.io/projected/9e165e27-f35c-44ab-a2a6-5c342b4d2436-kube-api-access-x8qrr\") pod \"iptables-alerter-97lj4\" (UID: \"9e165e27-f35c-44ab-a2a6-5c342b4d2436\") " pod="openshift-network-operator/iptables-alerter-97lj4" Sep 16 19:39:01.719947 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.719929 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:39:01.719998 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.719951 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:39:01.719998 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.719962 2577 projected.go:196] Error preparing data for projected volume kube-api-access-72v7v for pod openshift-network-diagnostics/network-check-target-8dwkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:01.720069 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:01.720015 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v podName:86e7d337-42ba-46be-92ab-a8ddf79b3df5 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:02.220002174 +0000 UTC m=+2.151961206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-72v7v" (UniqueName: "kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v") pod "network-check-target-8dwkj" (UID: "86e7d337-42ba-46be-92ab-a8ddf79b3df5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:01.724701 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.724677 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhzr7\" (UniqueName: \"kubernetes.io/projected/7719810a-94e9-426e-a62c-59612c727a86-kube-api-access-lhzr7\") pod \"multus-wwj2p\" (UID: \"7719810a-94e9-426e-a62c-59612c727a86\") " pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.725352 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.725335 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvcsn\" (UniqueName: \"kubernetes.io/projected/d52a3e1b-d963-4f1d-8edf-1a37b947ef18-kube-api-access-nvcsn\") pod \"multus-additional-cni-plugins-27rx4\" (UID: \"d52a3e1b-d963-4f1d-8edf-1a37b947ef18\") " pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.728390 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.728370 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqt9c\" (UniqueName: \"kubernetes.io/projected/d59f8428-b82a-4081-aca2-8a277b37066c-kube-api-access-xqt9c\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:01.728759 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.728743 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnzmg\" (UniqueName: \"kubernetes.io/projected/109ee397-68be-473b-9ef2-c5452e5bce1c-kube-api-access-hnzmg\") pod \"node-ca-rbd5j\" (UID: \"109ee397-68be-473b-9ef2-c5452e5bce1c\") " pod="openshift-image-registry/node-ca-rbd5j" Sep 16 19:39:01.734270 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.734242 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lcvl\" (UniqueName: \"kubernetes.io/projected/a42adfeb-3b56-4672-9925-afa9f94af53a-kube-api-access-2lcvl\") pod \"tuned-zff5x\" (UID: \"a42adfeb-3b56-4672-9925-afa9f94af53a\") " pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.816463 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.816374 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rbd5j" Sep 16 19:39:01.822897 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.822878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-27rx4" Sep 16 19:39:01.827150 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:01.827120 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109ee397_68be_473b_9ef2_c5452e5bce1c.slice/crio-c5e220b8c5aa65645adbffcd0b8067bd1dc43f5a28202f1b5c61fca4eebdfad6 WatchSource:0}: Error finding container c5e220b8c5aa65645adbffcd0b8067bd1dc43f5a28202f1b5c61fca4eebdfad6: Status 404 returned error can't find the container with id c5e220b8c5aa65645adbffcd0b8067bd1dc43f5a28202f1b5c61fca4eebdfad6 Sep 16 19:39:01.832918 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:01.832876 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52a3e1b_d963_4f1d_8edf_1a37b947ef18.slice/crio-c3a99246e2c5765d0b157a6bc14909ca05afc2c08e130460d8ce322172bbab1a WatchSource:0}: Error finding container c3a99246e2c5765d0b157a6bc14909ca05afc2c08e130460d8ce322172bbab1a: Status 404 returned error can't find the container with id c3a99246e2c5765d0b157a6bc14909ca05afc2c08e130460d8ce322172bbab1a Sep 16 19:39:01.854012 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.853973 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:01.863324 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:01.863297 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf513231e_a653_417f_a71c_667eb54deddd.slice/crio-7f199838108cf31674be40fadabca1eab533fac2445cb686f015c7753cfb26af WatchSource:0}: Error finding container 7f199838108cf31674be40fadabca1eab533fac2445cb686f015c7753cfb26af: Status 404 returned error can't find the container with id 7f199838108cf31674be40fadabca1eab533fac2445cb686f015c7753cfb26af Sep 16 19:39:01.868582 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.868557 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dtb5f" Sep 16 19:39:01.876900 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:01.876874 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e9c76d7_02d8_4ab9_9cd4_7f983331f938.slice/crio-d2ce8dd2771d582aa07bffeccd92b3dabbaee339a2f90a98e52ea43be55077b5 WatchSource:0}: Error finding container d2ce8dd2771d582aa07bffeccd92b3dabbaee339a2f90a98e52ea43be55077b5: Status 404 returned error can't find the container with id d2ce8dd2771d582aa07bffeccd92b3dabbaee339a2f90a98e52ea43be55077b5 Sep 16 19:39:01.883468 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.883443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wwj2p" Sep 16 19:39:01.891911 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:01.891880 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7719810a_94e9_426e_a62c_59612c727a86.slice/crio-433a36591b111934a113d722f9e538d63e605622d87583d9e23f63974c14f9dc WatchSource:0}: Error finding container 433a36591b111934a113d722f9e538d63e605622d87583d9e23f63974c14f9dc: Status 404 returned error can't find the container with id 433a36591b111934a113d722f9e538d63e605622d87583d9e23f63974c14f9dc Sep 16 19:39:01.906712 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.906687 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" Sep 16 19:39:01.912744 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.912720 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zff5x" Sep 16 19:39:01.916117 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:01.916093 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cf1ed3_355f_4d5b_b586_efdf563716f6.slice/crio-f809f02f39619cba220af6fa87e5526ef902ec3a862e96fca7309bff034eab66 WatchSource:0}: Error finding container f809f02f39619cba220af6fa87e5526ef902ec3a862e96fca7309bff034eab66: Status 404 returned error can't find the container with id f809f02f39619cba220af6fa87e5526ef902ec3a862e96fca7309bff034eab66 Sep 16 19:39:01.919565 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.919546 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-97lj4" Sep 16 19:39:01.921357 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:01.921330 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42adfeb_3b56_4672_9925_afa9f94af53a.slice/crio-d3b894075abdbce083c4991b3afcb3e7adbe784ffe8132e15d20c18f2645fffd WatchSource:0}: Error finding container d3b894075abdbce083c4991b3afcb3e7adbe784ffe8132e15d20c18f2645fffd: Status 404 returned error can't find the container with id d3b894075abdbce083c4991b3afcb3e7adbe784ffe8132e15d20c18f2645fffd Sep 16 19:39:01.924205 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.924184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:01.929486 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:01.929452 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e165e27_f35c_44ab_a2a6_5c342b4d2436.slice/crio-0c6f3cd41095dc07cf624059f609bb28edc8a5cf32229e8e53b476d9152d12a2 WatchSource:0}: Error finding container 0c6f3cd41095dc07cf624059f609bb28edc8a5cf32229e8e53b476d9152d12a2: Status 404 returned error can't find the container with id 0c6f3cd41095dc07cf624059f609bb28edc8a5cf32229e8e53b476d9152d12a2 Sep 16 19:39:01.933669 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:01.933642 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012becf2_a2fe_4cc9_a3cc_9f5978cf917d.slice/crio-65d11d080b192f63fcf5be4c183daf52871921537072b29db298cac69679c7da WatchSource:0}: Error finding container 65d11d080b192f63fcf5be4c183daf52871921537072b29db298cac69679c7da: Status 404 returned error can't find the container with id 65d11d080b192f63fcf5be4c183daf52871921537072b29db298cac69679c7da Sep 16 19:39:01.938746 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:01.938724 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:39:02.208053 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.207902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:02.208225 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:02.208084 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:02.208225 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.208100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:02.208225 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:02.208158 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret podName:43fe466d-e2b0-42b2-a5de-749975ccde74 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:03.208139194 +0000 UTC m=+3.140098209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret") pod "global-pull-secret-syncer-dm94l" (UID: "43fe466d-e2b0-42b2-a5de-749975ccde74") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:02.208225 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:02.208218 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:02.208437 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:02.208272 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs podName:d59f8428-b82a-4081-aca2-8a277b37066c nodeName:}" failed. No retries permitted until 2026-09-16 19:39:03.20825643 +0000 UTC m=+3.140215451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs") pod "network-metrics-daemon-z9szj" (UID: "d59f8428-b82a-4081-aca2-8a277b37066c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:02.309002 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.308959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72v7v\" (UniqueName: \"kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v\") pod \"network-check-target-8dwkj\" (UID: \"86e7d337-42ba-46be-92ab-a8ddf79b3df5\") " pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:02.309264 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:02.309238 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:39:02.309352 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:02.309268 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:39:02.309352 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:02.309282 2577 projected.go:196] Error preparing data for projected volume kube-api-access-72v7v for pod openshift-network-diagnostics/network-check-target-8dwkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:02.309352 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:02.309343 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v podName:86e7d337-42ba-46be-92ab-a8ddf79b3df5 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:03.309322825 +0000 UTC m=+3.241281832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-72v7v" (UniqueName: "kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v") pod "network-check-target-8dwkj" (UID: "86e7d337-42ba-46be-92ab-a8ddf79b3df5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:02.436434 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.436398 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:39:02.556629 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.556333 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 19:34:02 +0000 UTC" deadline="2028-03-28 03:46:43.078407 +0000 UTC" Sep 16 19:39:02.556629 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.556409 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13400h7m40.522003699s" Sep 16 19:39:02.604338 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.604300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:02.604506 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:02.604483 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:02.630660 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.629953 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zff5x" event={"ID":"a42adfeb-3b56-4672-9925-afa9f94af53a","Type":"ContainerStarted","Data":"d3b894075abdbce083c4991b3afcb3e7adbe784ffe8132e15d20c18f2645fffd"} Sep 16 19:39:02.634435 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.634391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" event={"ID":"d9cf1ed3-355f-4d5b-b586-efdf563716f6","Type":"ContainerStarted","Data":"f809f02f39619cba220af6fa87e5526ef902ec3a862e96fca7309bff034eab66"} Sep 16 19:39:02.660565 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.660520 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dtb5f" event={"ID":"9e9c76d7-02d8-4ab9-9cd4-7f983331f938","Type":"ContainerStarted","Data":"d2ce8dd2771d582aa07bffeccd92b3dabbaee339a2f90a98e52ea43be55077b5"} Sep 16 19:39:02.671352 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.671309 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qtbtk" event={"ID":"f513231e-a653-417f-a71c-667eb54deddd","Type":"ContainerStarted","Data":"7f199838108cf31674be40fadabca1eab533fac2445cb686f015c7753cfb26af"} Sep 16 19:39:02.689448 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.689405 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" event={"ID":"05f2cfd76c2cf0815635289ed034853f","Type":"ContainerStarted","Data":"8160197614dcd89153ea5e9b5a91062435551e028a64836fa64b4e19d54fd603"} Sep 16 19:39:02.711286 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.711225 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wwj2p" event={"ID":"7719810a-94e9-426e-a62c-59612c727a86","Type":"ContainerStarted","Data":"433a36591b111934a113d722f9e538d63e605622d87583d9e23f63974c14f9dc"} Sep 16 19:39:02.720238 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.720140 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27rx4" event={"ID":"d52a3e1b-d963-4f1d-8edf-1a37b947ef18","Type":"ContainerStarted","Data":"c3a99246e2c5765d0b157a6bc14909ca05afc2c08e130460d8ce322172bbab1a"} Sep 16 19:39:02.726072 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.725986 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rbd5j" event={"ID":"109ee397-68be-473b-9ef2-c5452e5bce1c","Type":"ContainerStarted","Data":"c5e220b8c5aa65645adbffcd0b8067bd1dc43f5a28202f1b5c61fca4eebdfad6"} Sep 16 19:39:02.748976 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.748934 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" event={"ID":"f8d32790f2c6baed10f52b7d81f7c1c1","Type":"ContainerStarted","Data":"7caef7ea2d2f5c816de15bfef6d2a10441ec4b0070a3c71f9732f225164ccecd"} Sep 16 19:39:02.760053 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.760015 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" event={"ID":"012becf2-a2fe-4cc9-a3cc-9f5978cf917d","Type":"ContainerStarted","Data":"65d11d080b192f63fcf5be4c183daf52871921537072b29db298cac69679c7da"} Sep 16 19:39:02.766255 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:02.766214 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-97lj4" event={"ID":"9e165e27-f35c-44ab-a2a6-5c342b4d2436","Type":"ContainerStarted","Data":"0c6f3cd41095dc07cf624059f609bb28edc8a5cf32229e8e53b476d9152d12a2"} Sep 16 19:39:03.217228 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:03.217187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:03.217439 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:03.217272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:03.217439 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:03.217414 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:03.217559 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:03.217483 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs podName:d59f8428-b82a-4081-aca2-8a277b37066c nodeName:}" failed. No retries permitted until 2026-09-16 19:39:05.217462175 +0000 UTC m=+5.149421192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs") pod "network-metrics-daemon-z9szj" (UID: "d59f8428-b82a-4081-aca2-8a277b37066c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:03.217967 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:03.217943 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:03.218067 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:03.218001 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret podName:43fe466d-e2b0-42b2-a5de-749975ccde74 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:05.217985989 +0000 UTC m=+5.149945008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret") pod "global-pull-secret-syncer-dm94l" (UID: "43fe466d-e2b0-42b2-a5de-749975ccde74") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:03.318907 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:03.318864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72v7v\" (UniqueName: \"kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v\") pod \"network-check-target-8dwkj\" (UID: \"86e7d337-42ba-46be-92ab-a8ddf79b3df5\") " pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:03.319124 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:03.319105 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:39:03.319205 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:03.319132 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:39:03.319205 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:03.319147 2577 projected.go:196] Error preparing data for projected volume kube-api-access-72v7v for pod openshift-network-diagnostics/network-check-target-8dwkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:03.319311 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:03.319208 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v podName:86e7d337-42ba-46be-92ab-a8ddf79b3df5 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:05.319190441 +0000 UTC m=+5.251149466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-72v7v" (UniqueName: "kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v") pod "network-check-target-8dwkj" (UID: "86e7d337-42ba-46be-92ab-a8ddf79b3df5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:03.556885 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:03.556779 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 19:34:02 +0000 UTC" deadline="2028-04-12 21:58:34.831077567 +0000 UTC" Sep 16 19:39:03.556885 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:03.556829 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13778h19m31.274254538s" Sep 16 19:39:03.603155 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:03.602316 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:03.603155 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:03.602456 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:03.603155 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:03.602866 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:03.603155 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:03.602978 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:04.010086 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:04.009970 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:39:04.244939 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:04.244905 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 19:39:04.604787 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:04.603969 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:04.604787 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:04.604123 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:05.242189 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:05.242154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:05.242391 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:05.242225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:05.242391 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:05.242380 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:05.242516 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:05.242445 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret podName:43fe466d-e2b0-42b2-a5de-749975ccde74 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:09.242426404 +0000 UTC m=+9.174385410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret") pod "global-pull-secret-syncer-dm94l" (UID: "43fe466d-e2b0-42b2-a5de-749975ccde74") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:05.242907 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:05.242887 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:05.242982 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:05.242947 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs podName:d59f8428-b82a-4081-aca2-8a277b37066c nodeName:}" failed. No retries permitted until 2026-09-16 19:39:09.242930049 +0000 UTC m=+9.174889066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs") pod "network-metrics-daemon-z9szj" (UID: "d59f8428-b82a-4081-aca2-8a277b37066c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:05.343516 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:05.342737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72v7v\" (UniqueName: \"kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v\") pod \"network-check-target-8dwkj\" (UID: \"86e7d337-42ba-46be-92ab-a8ddf79b3df5\") " pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:05.343516 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:05.342953 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:39:05.343516 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:05.342978 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:39:05.343516 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:05.342993 2577 projected.go:196] Error preparing data for projected volume kube-api-access-72v7v for pod openshift-network-diagnostics/network-check-target-8dwkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:05.343516 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:05.343060 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v podName:86e7d337-42ba-46be-92ab-a8ddf79b3df5 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:09.343039245 +0000 UTC m=+9.274998262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-72v7v" (UniqueName: "kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v") pod "network-check-target-8dwkj" (UID: "86e7d337-42ba-46be-92ab-a8ddf79b3df5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:05.602206 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:05.602124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:05.602388 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:05.602277 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:05.602935 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:05.602707 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:05.602935 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:05.602812 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:06.602485 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:06.602239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:06.602485 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:06.602386 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:07.602185 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:07.602085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:07.602395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:07.602085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:07.602395 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:07.602246 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:07.602395 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:07.602338 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:08.602618 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:08.602557 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:08.603138 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:08.602732 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:09.277611 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:09.276961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:09.277611 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:09.277049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:09.277611 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:09.277191 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:09.277611 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:09.277259 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs podName:d59f8428-b82a-4081-aca2-8a277b37066c nodeName:}" failed. No retries permitted until 2026-09-16 19:39:17.277237812 +0000 UTC m=+17.209196854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs") pod "network-metrics-daemon-z9szj" (UID: "d59f8428-b82a-4081-aca2-8a277b37066c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:09.277611 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:09.277445 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:09.277611 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:09.277512 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret podName:43fe466d-e2b0-42b2-a5de-749975ccde74 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:17.277492161 +0000 UTC m=+17.209451185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret") pod "global-pull-secret-syncer-dm94l" (UID: "43fe466d-e2b0-42b2-a5de-749975ccde74") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:09.378581 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:09.378479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72v7v\" (UniqueName: \"kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v\") pod \"network-check-target-8dwkj\" (UID: \"86e7d337-42ba-46be-92ab-a8ddf79b3df5\") " pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:09.378782 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:09.378708 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:39:09.378782 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:09.378731 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:39:09.378782 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:09.378744 2577 projected.go:196] Error preparing data for projected volume kube-api-access-72v7v for pod openshift-network-diagnostics/network-check-target-8dwkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:09.378973 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:09.378813 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v podName:86e7d337-42ba-46be-92ab-a8ddf79b3df5 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:17.378794707 +0000 UTC m=+17.310753728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-72v7v" (UniqueName: "kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v") pod "network-check-target-8dwkj" (UID: "86e7d337-42ba-46be-92ab-a8ddf79b3df5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:09.602444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:09.602364 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:09.602444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:09.602398 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:09.602668 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:09.602544 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:09.603047 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:09.602742 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:10.603314 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:10.603276 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:10.603949 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:10.603396 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:11.602555 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:11.602516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:11.602555 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:11.602538 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:11.602767 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:11.602672 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:11.602901 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:11.602853 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:12.601757 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:12.601717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:12.602273 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:12.601842 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:13.601742 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:13.601708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:13.601903 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:13.601752 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:13.601903 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:13.601862 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:13.602322 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:13.601960 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:14.602382 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:14.602294 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:14.602829 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:14.602440 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:15.602006 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:15.601964 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:15.602006 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:15.602022 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:15.602253 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:15.602111 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:15.602303 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:15.602242 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:16.602310 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:16.602274 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:16.602733 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:16.602407 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:17.344573 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:17.344535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:17.344806 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:17.344589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:17.344806 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:17.344713 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:17.344806 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:17.344769 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret podName:43fe466d-e2b0-42b2-a5de-749975ccde74 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:33.344755717 +0000 UTC m=+33.276714730 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret") pod "global-pull-secret-syncer-dm94l" (UID: "43fe466d-e2b0-42b2-a5de-749975ccde74") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:17.344806 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:17.344714 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:17.344984 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:17.344854 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs podName:d59f8428-b82a-4081-aca2-8a277b37066c nodeName:}" failed. No retries permitted until 2026-09-16 19:39:33.34483469 +0000 UTC m=+33.276793692 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs") pod "network-metrics-daemon-z9szj" (UID: "d59f8428-b82a-4081-aca2-8a277b37066c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:17.445789 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:17.445747 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72v7v\" (UniqueName: \"kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v\") pod \"network-check-target-8dwkj\" (UID: \"86e7d337-42ba-46be-92ab-a8ddf79b3df5\") " pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:17.446009 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:17.445906 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:39:17.446009 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:17.445927 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:39:17.446009 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:17.445940 2577 projected.go:196] Error preparing data for projected volume kube-api-access-72v7v for pod openshift-network-diagnostics/network-check-target-8dwkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:17.446009 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:17.446004 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v podName:86e7d337-42ba-46be-92ab-a8ddf79b3df5 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:33.445986134 +0000 UTC m=+33.377945158 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-72v7v" (UniqueName: "kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v") pod "network-check-target-8dwkj" (UID: "86e7d337-42ba-46be-92ab-a8ddf79b3df5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:17.602406 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:17.602320 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:17.602406 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:17.602368 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:17.602928 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:17.602464 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:17.602928 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:17.602569 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:18.601720 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:18.601684 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:18.601900 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:18.601803 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:19.602154 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:19.602113 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:19.602673 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:19.602113 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:19.602673 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:19.602278 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:19.602673 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:19.602328 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:20.603252 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:20.603214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:20.603677 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:20.603340 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:21.601784 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:21.601759 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:21.601891 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:21.601757 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:21.601891 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:21.601866 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:21.601987 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:21.601933 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:21.830752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:21.830446 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" event={"ID":"05f2cfd76c2cf0815635289ed034853f","Type":"ContainerStarted","Data":"b6ead4e0f43133ff2e9a0572e935a358c050b8e744d866bbd269513938c81960"} Sep 16 19:39:21.834702 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:21.834651 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wwj2p" event={"ID":"7719810a-94e9-426e-a62c-59612c727a86","Type":"ContainerStarted","Data":"5de98d43506561a5df3683e20674aaf1847b6341d7e2e5450a5f9846c3c76bbc"} Sep 16 19:39:21.850552 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:21.849496 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" event={"ID":"012becf2-a2fe-4cc9-a3cc-9f5978cf917d","Type":"ContainerStarted","Data":"cc5de06309a384bcaaabe52e0dac2e530cbd7580c15218567ea9c2b84bb2e0d6"} Sep 16 19:39:21.857989 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:21.857955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zff5x" event={"ID":"a42adfeb-3b56-4672-9925-afa9f94af53a","Type":"ContainerStarted","Data":"d39df94ab184f0a0223c15810bda3e13f170e2a613c6ed0c34259855ebce946f"} Sep 16 19:39:21.883326 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:21.883243 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wwj2p" podStartSLOduration=1.152907253 podStartE2EDuration="20.883221155s" totalImagesPullingTime="19.730313902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:21.882377314 +0000 UTC m=+21.814336351" watchObservedRunningTime="2026-09-16 19:39:21.883221155 +0000 UTC m=+21.815180177" Sep 16 19:39:21.884185 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:21.883798 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" podStartSLOduration=19.883786494 podStartE2EDuration="19.883786494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:39:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:21.851314224 +0000 UTC m=+21.783273248" watchObservedRunningTime="2026-09-16 19:39:21.883786494 +0000 UTC m=+21.815745517" Sep 16 19:39:21.904693 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:21.904564 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zff5x" podStartSLOduration=1.237808901 podStartE2EDuration="20.904536953s" totalImagesPullingTime="19.666728052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:21.904232368 +0000 UTC m=+21.836191392" watchObservedRunningTime="2026-09-16 19:39:21.904536953 +0000 UTC m=+21.836495976" Sep 16 19:39:22.602811 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.602544 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:22.603001 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:22.602930 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:22.861903 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.861828 2577 generic.go:356] "Generic (PLEG): container finished" podID="d52a3e1b-d963-4f1d-8edf-1a37b947ef18" containerID="d0173b73da06dc7ce6b366a32975cca028a424b83f9e8522cb6a51927352909a" exitCode=0 Sep 16 19:39:22.862697 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.861913 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27rx4" event={"ID":"d52a3e1b-d963-4f1d-8edf-1a37b947ef18","Type":"ContainerDied","Data":"d0173b73da06dc7ce6b366a32975cca028a424b83f9e8522cb6a51927352909a"} Sep 16 19:39:22.863537 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.863511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rbd5j" event={"ID":"109ee397-68be-473b-9ef2-c5452e5bce1c","Type":"ContainerStarted","Data":"e718220fd0a18be7aec29b3ada96af994f8df30196b958e94735929e35e1e3a3"} Sep 16 19:39:22.865167 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.865141 2577 generic.go:356] "Generic (PLEG): container finished" podID="f8d32790f2c6baed10f52b7d81f7c1c1" containerID="f39a295571523a8bb8872f22ec7ea6a0fc8bda5566793508c0c6e701a80bdb5c" exitCode=0 Sep 16 19:39:22.865245 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.865221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" event={"ID":"f8d32790f2c6baed10f52b7d81f7c1c1","Type":"ContainerDied","Data":"f39a295571523a8bb8872f22ec7ea6a0fc8bda5566793508c0c6e701a80bdb5c"} Sep 16 19:39:22.868518 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.868488 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" event={"ID":"012becf2-a2fe-4cc9-a3cc-9f5978cf917d","Type":"ContainerStarted","Data":"5ffd596f96026730f922e852bdf2b692c5e6b7b277ac74fa12b5a0cd0a04c96c"} Sep 16 19:39:22.868646 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.868576 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" event={"ID":"012becf2-a2fe-4cc9-a3cc-9f5978cf917d","Type":"ContainerStarted","Data":"fe7bf15b53ac22f6856774c770a8c6d5fb9fc3e94efd208250652f38aeb2fe15"} Sep 16 19:39:22.868646 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.868635 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" event={"ID":"012becf2-a2fe-4cc9-a3cc-9f5978cf917d","Type":"ContainerStarted","Data":"22e2528e41b361d70ff64dbd40b591023f1013c75c06c1f8fb864ee48e5fb9d9"} Sep 16 19:39:22.868762 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.868668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" event={"ID":"012becf2-a2fe-4cc9-a3cc-9f5978cf917d","Type":"ContainerStarted","Data":"8d79aadc7372ffb718c9a58f71bd4850f38cc4de9130fd4a455fdbf688ce109d"} Sep 16 19:39:22.868762 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.868711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" event={"ID":"012becf2-a2fe-4cc9-a3cc-9f5978cf917d","Type":"ContainerStarted","Data":"729d9d19f6dd21159765781d1215a3a2a4bd6956f4ec6dd07c245c4c3355b943"} Sep 16 19:39:22.869850 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.869829 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" event={"ID":"d9cf1ed3-355f-4d5b-b586-efdf563716f6","Type":"ContainerStarted","Data":"457296fb57c5f278436260273d46c918a68afcb3d17d164ae7a2e0502e7267f0"} Sep 16 19:39:22.871247 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.871228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dtb5f" event={"ID":"9e9c76d7-02d8-4ab9-9cd4-7f983331f938","Type":"ContainerStarted","Data":"d0664b3498ca76e2f9ba5e63b3650954c5e66ec5221ff4c5b3a33d5ce7c5e894"} Sep 16 19:39:22.872737 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.872711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qtbtk" event={"ID":"f513231e-a653-417f-a71c-667eb54deddd","Type":"ContainerStarted","Data":"c1db9a208f9dd511535e07cceb08635aea38e473ac6df10eb2ffc3f9574b107c"} Sep 16 19:39:22.906930 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.906744 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qtbtk" podStartSLOduration=2.178187612 podStartE2EDuration="21.906721468s" totalImagesPullingTime="19.728533856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:22.906093767 +0000 UTC m=+22.838052853" watchObservedRunningTime="2026-09-16 19:39:22.906721468 +0000 UTC m=+22.838680491" Sep 16 19:39:22.943596 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.943519 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rbd5j" podStartSLOduration=2.182849402 podStartE2EDuration="21.943499542s" totalImagesPullingTime="19.76065014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:22.942970118 +0000 UTC m=+22.874929152" watchObservedRunningTime="2026-09-16 19:39:22.943499542 +0000 UTC m=+22.875458564" Sep 16 19:39:22.958316 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:22.958269 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dtb5f" podStartSLOduration=2.23913111 podStartE2EDuration="21.958252959s" totalImagesPullingTime="19.719121849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:22.958191336 +0000 UTC m=+22.890150361" watchObservedRunningTime="2026-09-16 19:39:22.958252959 +0000 UTC m=+22.890211981" Sep 16 19:39:23.288737 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:23.288709 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 16 19:39:23.566438 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:23.566273 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T19:39:23.288727765Z","UUID":"3f44ec44-7794-4ff9-b5aa-ab4ab19e31df","Handler":null,"Name":"","Endpoint":""} Sep 16 19:39:23.568022 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:23.567993 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 16 19:39:23.568022 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:23.568026 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 16 19:39:23.601776 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:23.601749 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:23.602036 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:23.601870 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:23.602036 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:23.601915 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:23.602036 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:23.602021 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:23.876855 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:23.876764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-97lj4" event={"ID":"9e165e27-f35c-44ab-a2a6-5c342b4d2436","Type":"ContainerStarted","Data":"e1c2aedd55418e90423bc09f38229840d99082000c657f68f9e29acd10288664"} Sep 16 19:39:23.878968 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:23.878944 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" event={"ID":"d9cf1ed3-355f-4d5b-b586-efdf563716f6","Type":"ContainerStarted","Data":"9f4c757fbabc9d296d06d094486f900d16170c2db3d3eafb3ccdf91530583b99"} Sep 16 19:39:23.881023 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:23.880965 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" event={"ID":"f8d32790f2c6baed10f52b7d81f7c1c1","Type":"ContainerStarted","Data":"fc7ccb2d551e9062bcb03770dd95f9545da89a18556b8c276ecd3d80298258cf"} Sep 16 19:39:23.896098 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:23.896053 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-97lj4" podStartSLOduration=3.232429803 podStartE2EDuration="22.896036755s" totalImagesPullingTime="19.663606952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:23.895788318 +0000 UTC m=+23.827747351" watchObservedRunningTime="2026-09-16 19:39:23.896036755 +0000 UTC m=+23.827995756" Sep 16 19:39:23.917117 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:23.917058 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" podStartSLOduration=21.917040334 podStartE2EDuration="21.917040334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:39:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:23.916834103 +0000 UTC m=+23.848793126" watchObservedRunningTime="2026-09-16 19:39:23.917040334 +0000 UTC m=+23.848999355" Sep 16 19:39:24.602269 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:24.601990 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:24.602498 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:24.602472 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:24.809305 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:24.809177 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:24.810070 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:24.810031 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:24.888443 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:24.888391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" event={"ID":"012becf2-a2fe-4cc9-a3cc-9f5978cf917d","Type":"ContainerStarted","Data":"837ff3d0cb0b1fd0c0c05570f7cc6c453857abdb42278ddbfb181d7219e1bc1f"} Sep 16 19:39:25.601514 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:25.601472 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:25.601745 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:25.601597 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:25.601745 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:25.601641 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:25.601852 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:25.601762 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:25.893194 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:25.893105 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" event={"ID":"d9cf1ed3-355f-4d5b-b586-efdf563716f6","Type":"ContainerStarted","Data":"a4bd50f0e5b3dc3a46e20617716183c4d9f22f9bbb7daf7b22c6bd38d0eeb5f9"} Sep 16 19:39:25.893194 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:25.893150 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 16 19:39:25.914864 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:25.914814 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69r8c" podStartSLOduration=2.600402582 podStartE2EDuration="24.914792092s" totalImagesPullingTime="22.31438951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:25.913162587 +0000 UTC m=+25.845121608" watchObservedRunningTime="2026-09-16 19:39:25.914792092 +0000 UTC m=+25.846751208" Sep 16 19:39:26.601575 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:26.601534 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:26.601760 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:26.601671 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:27.602752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:27.602492 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:27.603200 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:27.602504 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:27.603200 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:27.602860 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:27.603200 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:27.602974 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:27.901454 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:27.901360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" event={"ID":"012becf2-a2fe-4cc9-a3cc-9f5978cf917d","Type":"ContainerStarted","Data":"6d19a66c8f1a249818076e6396a2374fbc5c4e70a90b3b11eb0eeb7a05919dc6"} Sep 16 19:39:27.901712 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:27.901588 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:27.901712 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:27.901678 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:27.903318 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:27.903292 2577 generic.go:356] "Generic (PLEG): container finished" podID="d52a3e1b-d963-4f1d-8edf-1a37b947ef18" containerID="5da6107d85c45c8fc691c6091cc66812a716f7ba4582dc26e706054d708c3a66" exitCode=0 Sep 16 19:39:27.903427 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:27.903335 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27rx4" event={"ID":"d52a3e1b-d963-4f1d-8edf-1a37b947ef18","Type":"ContainerDied","Data":"5da6107d85c45c8fc691c6091cc66812a716f7ba4582dc26e706054d708c3a66"} Sep 16 19:39:27.917369 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:27.917343 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:27.936546 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:27.936491 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" podStartSLOduration=7.201417231 podStartE2EDuration="26.936473826s" totalImagesPullingTime="19.735056595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:27.934769285 +0000 UTC m=+27.866728309" watchObservedRunningTime="2026-09-16 19:39:27.936473826 +0000 UTC m=+27.868432847" Sep 16 19:39:28.602127 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:28.602090 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:28.602394 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:28.602234 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:28.671807 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:28.671763 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:28.672586 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:28.671899 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 16 19:39:28.672586 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:28.672361 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qtbtk" Sep 16 19:39:28.906186 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:28.906095 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:28.921454 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:28.921429 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:39:29.025873 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:29.025840 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8dwkj"] Sep 16 19:39:29.026018 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:29.025978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:29.026125 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:29.026101 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:29.029248 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:29.029218 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dm94l"] Sep 16 19:39:29.029389 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:29.029331 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:29.029456 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:29.029438 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:29.029955 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:29.029933 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z9szj"] Sep 16 19:39:29.030062 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:29.030049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:29.030186 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:29.030165 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:29.910314 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:29.910124 2577 generic.go:356] "Generic (PLEG): container finished" podID="d52a3e1b-d963-4f1d-8edf-1a37b947ef18" containerID="53dc2b1e94bae5403037dd3f790550963ad0eb90dd2ee9e0b97612c38b4e8135" exitCode=0 Sep 16 19:39:29.910890 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:29.910203 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27rx4" event={"ID":"d52a3e1b-d963-4f1d-8edf-1a37b947ef18","Type":"ContainerDied","Data":"53dc2b1e94bae5403037dd3f790550963ad0eb90dd2ee9e0b97612c38b4e8135"} Sep 16 19:39:30.602257 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:30.602229 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:30.602401 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:30.602264 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:30.602401 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:30.602319 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:30.602401 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:30.602393 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:30.602567 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:30.602480 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:30.602621 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:30.602564 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:30.914718 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:30.914675 2577 generic.go:356] "Generic (PLEG): container finished" podID="d52a3e1b-d963-4f1d-8edf-1a37b947ef18" containerID="8d5d4ef0973ec41f4158f6a48836b5728664b7132d6a9ba4f17725b6c5c3aff7" exitCode=0 Sep 16 19:39:30.915182 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:30.914721 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27rx4" event={"ID":"d52a3e1b-d963-4f1d-8edf-1a37b947ef18","Type":"ContainerDied","Data":"8d5d4ef0973ec41f4158f6a48836b5728664b7132d6a9ba4f17725b6c5c3aff7"} Sep 16 19:39:32.601879 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:32.601836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:32.602313 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:32.601980 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dwkj" podUID="86e7d337-42ba-46be-92ab-a8ddf79b3df5" Sep 16 19:39:32.602378 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:32.602329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:32.602460 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:32.602439 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:39:32.602503 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:32.602495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:32.602572 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:32.602558 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm94l" podUID="43fe466d-e2b0-42b2-a5de-749975ccde74" Sep 16 19:39:33.365766 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:33.365728 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:33.365969 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:33.365798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:33.365969 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:33.365900 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:33.365969 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:33.365941 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:33.366124 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:33.365977 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs podName:d59f8428-b82a-4081-aca2-8a277b37066c nodeName:}" failed. No retries permitted until 2026-09-16 19:40:05.365961405 +0000 UTC m=+65.297920405 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs") pod "network-metrics-daemon-z9szj" (UID: "d59f8428-b82a-4081-aca2-8a277b37066c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 19:39:33.366124 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:33.365993 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret podName:43fe466d-e2b0-42b2-a5de-749975ccde74 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:05.36598646 +0000 UTC m=+65.297945459 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret") pod "global-pull-secret-syncer-dm94l" (UID: "43fe466d-e2b0-42b2-a5de-749975ccde74") : object "kube-system"/"original-pull-secret" not registered Sep 16 19:39:33.467135 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:33.467096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72v7v\" (UniqueName: \"kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v\") pod \"network-check-target-8dwkj\" (UID: \"86e7d337-42ba-46be-92ab-a8ddf79b3df5\") " pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:33.467296 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:33.467277 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 19:39:33.467357 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:33.467303 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 19:39:33.467357 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:33.467315 2577 projected.go:196] Error preparing data for projected volume kube-api-access-72v7v for pod openshift-network-diagnostics/network-check-target-8dwkj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:33.467427 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:33.467375 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v podName:86e7d337-42ba-46be-92ab-a8ddf79b3df5 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:05.467355278 +0000 UTC m=+65.399314296 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-72v7v" (UniqueName: "kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v") pod "network-check-target-8dwkj" (UID: "86e7d337-42ba-46be-92ab-a8ddf79b3df5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 19:39:34.396947 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.396915 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeReady" Sep 16 19:39:34.397384 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.397073 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 16 19:39:34.456506 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.456409 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kf5ns"] Sep 16 19:39:34.462081 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.462051 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kpsrf"] Sep 16 19:39:34.462283 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.462200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kf5ns" Sep 16 19:39:34.465069 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.465044 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.468554 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.468528 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 16 19:39:34.468834 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.468814 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 16 19:39:34.468941 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.468832 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 16 19:39:34.470214 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.470042 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8zc66\"" Sep 16 19:39:34.470214 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.470062 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 16 19:39:34.472801 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.472777 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kf5ns"] Sep 16 19:39:34.474782 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.474749 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ktzv9\"" Sep 16 19:39:34.474905 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.474807 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 16 19:39:34.481199 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.481173 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kpsrf"] Sep 16 19:39:34.576058 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.576023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5aa726c3-75c4-434a-a04b-cffda55507fe-cert\") pod \"ingress-canary-kf5ns\" (UID: \"5aa726c3-75c4-434a-a04b-cffda55507fe\") " pod="openshift-ingress-canary/ingress-canary-kf5ns" Sep 16 19:39:34.576058 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.576061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.576303 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.576080 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca9d42a-96da-433e-a05c-92942a97dc59-config-volume\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.576303 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.576105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca9d42a-96da-433e-a05c-92942a97dc59-tmp-dir\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.576303 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.576132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xs5j\" (UniqueName: \"kubernetes.io/projected/8ca9d42a-96da-433e-a05c-92942a97dc59-kube-api-access-2xs5j\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.576303 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.576169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4vv8\" (UniqueName: \"kubernetes.io/projected/5aa726c3-75c4-434a-a04b-cffda55507fe-kube-api-access-q4vv8\") pod \"ingress-canary-kf5ns\" (UID: \"5aa726c3-75c4-434a-a04b-cffda55507fe\") " pod="openshift-ingress-canary/ingress-canary-kf5ns" Sep 16 19:39:34.602382 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.602349 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:39:34.602565 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.602355 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:39:34.602690 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.602355 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:39:34.605623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.605578 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pq7mv\"" Sep 16 19:39:34.605762 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.605578 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 19:39:34.605762 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.605649 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 19:39:34.605762 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.605657 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zgq28\"" Sep 16 19:39:34.605762 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.605733 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 19:39:34.605762 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.605579 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 19:39:34.676919 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.676885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5aa726c3-75c4-434a-a04b-cffda55507fe-cert\") pod \"ingress-canary-kf5ns\" (UID: \"5aa726c3-75c4-434a-a04b-cffda55507fe\") " pod="openshift-ingress-canary/ingress-canary-kf5ns" Sep 16 19:39:34.676919 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.676923 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.677417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.676949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca9d42a-96da-433e-a05c-92942a97dc59-config-volume\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.677417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.676982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca9d42a-96da-433e-a05c-92942a97dc59-tmp-dir\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.677417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.677006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xs5j\" (UniqueName: \"kubernetes.io/projected/8ca9d42a-96da-433e-a05c-92942a97dc59-kube-api-access-2xs5j\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.677417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.677030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4vv8\" (UniqueName: \"kubernetes.io/projected/5aa726c3-75c4-434a-a04b-cffda55507fe-kube-api-access-q4vv8\") pod \"ingress-canary-kf5ns\" (UID: \"5aa726c3-75c4-434a-a04b-cffda55507fe\") " pod="openshift-ingress-canary/ingress-canary-kf5ns" Sep 16 19:39:34.677417 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:34.677068 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:34.677417 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:34.677143 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls podName:8ca9d42a-96da-433e-a05c-92942a97dc59 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:35.177120442 +0000 UTC m=+35.109079448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls") pod "dns-default-kpsrf" (UID: "8ca9d42a-96da-433e-a05c-92942a97dc59") : secret "dns-default-metrics-tls" not found Sep 16 19:39:34.677677 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.677654 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca9d42a-96da-433e-a05c-92942a97dc59-config-volume\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.677746 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.677660 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca9d42a-96da-433e-a05c-92942a97dc59-tmp-dir\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.682167 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.682139 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5aa726c3-75c4-434a-a04b-cffda55507fe-cert\") pod \"ingress-canary-kf5ns\" (UID: \"5aa726c3-75c4-434a-a04b-cffda55507fe\") " pod="openshift-ingress-canary/ingress-canary-kf5ns" Sep 16 19:39:34.691014 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.690976 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xs5j\" (UniqueName: \"kubernetes.io/projected/8ca9d42a-96da-433e-a05c-92942a97dc59-kube-api-access-2xs5j\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:34.693178 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.693147 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4vv8\" (UniqueName: \"kubernetes.io/projected/5aa726c3-75c4-434a-a04b-cffda55507fe-kube-api-access-q4vv8\") pod \"ingress-canary-kf5ns\" (UID: \"5aa726c3-75c4-434a-a04b-cffda55507fe\") " pod="openshift-ingress-canary/ingress-canary-kf5ns" Sep 16 19:39:34.775071 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:34.775028 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kf5ns" Sep 16 19:39:35.104721 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:35.104424 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kf5ns"] Sep 16 19:39:35.109016 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:39:35.108978 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa726c3_75c4_434a_a04b_cffda55507fe.slice/crio-385c74f7971430297fe371993c8c4d9c998c73d7343500db6a6c7ed5a55746e3 WatchSource:0}: Error finding container 385c74f7971430297fe371993c8c4d9c998c73d7343500db6a6c7ed5a55746e3: Status 404 returned error can't find the container with id 385c74f7971430297fe371993c8c4d9c998c73d7343500db6a6c7ed5a55746e3 Sep 16 19:39:35.181921 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:35.181881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:35.182100 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:35.182039 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:35.182157 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:35.182116 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls podName:8ca9d42a-96da-433e-a05c-92942a97dc59 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:36.182093833 +0000 UTC m=+36.114052850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls") pod "dns-default-kpsrf" (UID: "8ca9d42a-96da-433e-a05c-92942a97dc59") : secret "dns-default-metrics-tls" not found Sep 16 19:39:35.931673 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:35.931630 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kf5ns" event={"ID":"5aa726c3-75c4-434a-a04b-cffda55507fe","Type":"ContainerStarted","Data":"385c74f7971430297fe371993c8c4d9c998c73d7343500db6a6c7ed5a55746e3"} Sep 16 19:39:35.934811 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:35.934778 2577 generic.go:356] "Generic (PLEG): container finished" podID="d52a3e1b-d963-4f1d-8edf-1a37b947ef18" containerID="a198fdeef2d7f72d6a6b16aa37ace1bc0f9e2ad4b1561265fc61bb13f636194a" exitCode=0 Sep 16 19:39:35.934959 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:35.934850 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27rx4" event={"ID":"d52a3e1b-d963-4f1d-8edf-1a37b947ef18","Type":"ContainerDied","Data":"a198fdeef2d7f72d6a6b16aa37ace1bc0f9e2ad4b1561265fc61bb13f636194a"} Sep 16 19:39:36.191636 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:36.191536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:36.191801 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:36.191726 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:36.191856 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:36.191812 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls podName:8ca9d42a-96da-433e-a05c-92942a97dc59 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:38.191790593 +0000 UTC m=+38.123749597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls") pod "dns-default-kpsrf" (UID: "8ca9d42a-96da-433e-a05c-92942a97dc59") : secret "dns-default-metrics-tls" not found Sep 16 19:39:36.941776 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:36.941738 2577 generic.go:356] "Generic (PLEG): container finished" podID="d52a3e1b-d963-4f1d-8edf-1a37b947ef18" containerID="c837f29f4e47e9c4f57d5491e022d1d685f221903a61462cee84d55b96030914" exitCode=0 Sep 16 19:39:36.941776 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:36.941760 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27rx4" event={"ID":"d52a3e1b-d963-4f1d-8edf-1a37b947ef18","Type":"ContainerDied","Data":"c837f29f4e47e9c4f57d5491e022d1d685f221903a61462cee84d55b96030914"} Sep 16 19:39:37.946007 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:37.945906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kf5ns" event={"ID":"5aa726c3-75c4-434a-a04b-cffda55507fe","Type":"ContainerStarted","Data":"a27bc62020fbc771cb85ffdca710f478cbe90a0a460b7b57ebe8d1a78077f9c8"} Sep 16 19:39:37.949293 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:37.949261 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-27rx4" event={"ID":"d52a3e1b-d963-4f1d-8edf-1a37b947ef18","Type":"ContainerStarted","Data":"42ad21efbcacab288eff34cc1899b6637d419639386d6756204704738412ea3b"} Sep 16 19:39:37.964031 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:37.963972 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kf5ns" podStartSLOduration=1.6340917259999999 podStartE2EDuration="3.963954849s" totalImagesPullingTime="2.329863123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:37.963912308 +0000 UTC m=+37.895871330" watchObservedRunningTime="2026-09-16 19:39:37.963954849 +0000 UTC m=+37.895913873" Sep 16 19:39:37.985679 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:37.985595 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-27rx4" podStartSLOduration=7.020863761 podStartE2EDuration="36.985576208s" totalImagesPullingTime="29.964712447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:39:37.983868107 +0000 UTC m=+37.915827129" watchObservedRunningTime="2026-09-16 19:39:37.985576208 +0000 UTC m=+37.917535232" Sep 16 19:39:38.206273 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:38.206186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:38.206418 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:38.206339 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:38.206418 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:38.206400 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls podName:8ca9d42a-96da-433e-a05c-92942a97dc59 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:42.206385332 +0000 UTC m=+42.138344331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls") pod "dns-default-kpsrf" (UID: "8ca9d42a-96da-433e-a05c-92942a97dc59") : secret "dns-default-metrics-tls" not found Sep 16 19:39:42.235677 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:42.235634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:42.236089 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:42.235797 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:42.236089 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:42.235905 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls podName:8ca9d42a-96da-433e-a05c-92942a97dc59 nodeName:}" failed. No retries permitted until 2026-09-16 19:39:50.235883842 +0000 UTC m=+50.167842862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls") pod "dns-default-kpsrf" (UID: "8ca9d42a-96da-433e-a05c-92942a97dc59") : secret "dns-default-metrics-tls" not found Sep 16 19:39:50.290397 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:39:50.290353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:39:50.290884 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:50.290475 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:39:50.290884 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:39:50.290531 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls podName:8ca9d42a-96da-433e-a05c-92942a97dc59 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:06.290517658 +0000 UTC m=+66.222476657 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls") pod "dns-default-kpsrf" (UID: "8ca9d42a-96da-433e-a05c-92942a97dc59") : secret "dns-default-metrics-tls" not found Sep 16 19:40:00.926308 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:00.926272 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dk5x" Sep 16 19:40:05.398470 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.398425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:40:05.398931 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.398511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:40:05.401650 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.401624 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 19:40:05.401765 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.401624 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 19:40:05.409097 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:40:05.409069 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 16 19:40:05.409220 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:40:05.409172 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs podName:d59f8428-b82a-4081-aca2-8a277b37066c nodeName:}" failed. No retries permitted until 2026-09-16 19:41:09.409147673 +0000 UTC m=+129.341106690 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs") pod "network-metrics-daemon-z9szj" (UID: "d59f8428-b82a-4081-aca2-8a277b37066c") : secret "metrics-daemon-secret" not found Sep 16 19:40:05.412441 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.412411 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43fe466d-e2b0-42b2-a5de-749975ccde74-original-pull-secret\") pod \"global-pull-secret-syncer-dm94l\" (UID: \"43fe466d-e2b0-42b2-a5de-749975ccde74\") " pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:40:05.499388 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.499340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72v7v\" (UniqueName: \"kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v\") pod \"network-check-target-8dwkj\" (UID: \"86e7d337-42ba-46be-92ab-a8ddf79b3df5\") " pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:40:05.502241 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.502217 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 19:40:05.513273 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.513241 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 19:40:05.523528 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.523493 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72v7v\" (UniqueName: \"kubernetes.io/projected/86e7d337-42ba-46be-92ab-a8ddf79b3df5-kube-api-access-72v7v\") pod \"network-check-target-8dwkj\" (UID: \"86e7d337-42ba-46be-92ab-a8ddf79b3df5\") " pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:40:05.527229 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.527204 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm94l" Sep 16 19:40:05.817560 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.817531 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zgq28\"" Sep 16 19:40:05.825170 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.825144 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:40:05.833270 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:05.833238 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dm94l"] Sep 16 19:40:05.838172 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:40:05.838143 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43fe466d_e2b0_42b2_a5de_749975ccde74.slice/crio-af5afbd47c7e84d8bcea58c36a00deab2a1599c9b18298ec0bbdc80475a8afa0 WatchSource:0}: Error finding container af5afbd47c7e84d8bcea58c36a00deab2a1599c9b18298ec0bbdc80475a8afa0: Status 404 returned error can't find the container with id af5afbd47c7e84d8bcea58c36a00deab2a1599c9b18298ec0bbdc80475a8afa0 Sep 16 19:40:06.014581 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:06.014544 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dm94l" event={"ID":"43fe466d-e2b0-42b2-a5de-749975ccde74","Type":"ContainerStarted","Data":"af5afbd47c7e84d8bcea58c36a00deab2a1599c9b18298ec0bbdc80475a8afa0"} Sep 16 19:40:06.119920 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:06.119833 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8dwkj"] Sep 16 19:40:06.122708 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:40:06.122680 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e7d337_42ba_46be_92ab_a8ddf79b3df5.slice/crio-a485fe288248f230b36fece1efbde9dd3f855ab99d9345a442629382da59a06b WatchSource:0}: Error finding container a485fe288248f230b36fece1efbde9dd3f855ab99d9345a442629382da59a06b: Status 404 returned error can't find the container with id a485fe288248f230b36fece1efbde9dd3f855ab99d9345a442629382da59a06b Sep 16 19:40:06.305971 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:06.305929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:40:06.306169 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:40:06.306128 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:40:06.306227 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:40:06.306218 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls podName:8ca9d42a-96da-433e-a05c-92942a97dc59 nodeName:}" failed. No retries permitted until 2026-09-16 19:40:38.30619283 +0000 UTC m=+98.238151833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls") pod "dns-default-kpsrf" (UID: "8ca9d42a-96da-433e-a05c-92942a97dc59") : secret "dns-default-metrics-tls" not found Sep 16 19:40:07.019395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:07.019355 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8dwkj" event={"ID":"86e7d337-42ba-46be-92ab-a8ddf79b3df5","Type":"ContainerStarted","Data":"a485fe288248f230b36fece1efbde9dd3f855ab99d9345a442629382da59a06b"} Sep 16 19:40:11.032498 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:11.032458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dm94l" event={"ID":"43fe466d-e2b0-42b2-a5de-749975ccde74","Type":"ContainerStarted","Data":"0b5d295c202e02a594ea3a4f737d5e6d04a900c2a8a397c307e6436a074d000b"} Sep 16 19:40:11.033998 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:11.033974 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8dwkj" event={"ID":"86e7d337-42ba-46be-92ab-a8ddf79b3df5","Type":"ContainerStarted","Data":"8b10303fabd325f405336849d42b751f09f948047217c0672d3f0aa8ac158c16"} Sep 16 19:40:11.034131 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:11.034033 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:40:11.050512 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:11.050457 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dm94l" podStartSLOduration=65.351554324 podStartE2EDuration="1m10.050438252s" totalImagesPullingTime="4.698883928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:40:11.050107003 +0000 UTC m=+70.982066026" watchObservedRunningTime="2026-09-16 19:40:11.050438252 +0000 UTC m=+70.982397277" Sep 16 19:40:11.067119 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:11.067052 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8dwkj" podStartSLOduration=65.653318119 podStartE2EDuration="1m10.067033609s" totalImagesPullingTime="4.41371549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:40:11.066278338 +0000 UTC m=+70.998237362" watchObservedRunningTime="2026-09-16 19:40:11.067033609 +0000 UTC m=+70.998992630" Sep 16 19:40:38.341709 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:38.341662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:40:38.342192 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:40:38.341798 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 19:40:38.342192 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:40:38.341852 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls podName:8ca9d42a-96da-433e-a05c-92942a97dc59 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:42.341837965 +0000 UTC m=+162.273796970 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls") pod "dns-default-kpsrf" (UID: "8ca9d42a-96da-433e-a05c-92942a97dc59") : secret "dns-default-metrics-tls" not found Sep 16 19:40:42.038586 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:40:42.038544 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8dwkj" Sep 16 19:41:09.354815 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.354771 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8"] Sep 16 19:41:09.356593 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.356576 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:09.363149 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.363127 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 16 19:41:09.364197 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.364182 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-czljr\"" Sep 16 19:41:09.364269 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.364189 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 16 19:41:09.364365 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.364348 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 16 19:41:09.364423 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.364385 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 16 19:41:09.373799 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.373771 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8"] Sep 16 19:41:09.455388 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.455350 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-785cbd56cd-8m7w4"] Sep 16 19:41:09.458196 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.458177 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.463787 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.463750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbzdz\" (UniqueName: \"kubernetes.io/projected/54b51f48-ffca-4337-be57-06003f3e7dcc-kube-api-access-pbzdz\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:09.463959 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.463795 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:41:09.463959 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.463848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/54b51f48-ffca-4337-be57-06003f3e7dcc-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:09.463959 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.463866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:09.463959 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:09.463947 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 16 19:41:09.464186 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:09.464024 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs podName:d59f8428-b82a-4081-aca2-8a277b37066c nodeName:}" failed. No retries permitted until 2026-09-16 19:43:11.464002537 +0000 UTC m=+251.395961558 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs") pod "network-metrics-daemon-z9szj" (UID: "d59f8428-b82a-4081-aca2-8a277b37066c") : secret "metrics-daemon-secret" not found Sep 16 19:41:09.464701 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.464678 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 16 19:41:09.464818 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.464770 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 16 19:41:09.464818 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.464791 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 16 19:41:09.464818 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.464770 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 16 19:41:09.465098 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.465081 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 16 19:41:09.465195 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.465136 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wcfhq\"" Sep 16 19:41:09.465276 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.465203 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 16 19:41:09.473059 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.473032 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-785cbd56cd-8m7w4"] Sep 16 19:41:09.564850 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.564805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9tx6\" (UniqueName: \"kubernetes.io/projected/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-kube-api-access-d9tx6\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.564850 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.564851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.565110 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.564878 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbzdz\" (UniqueName: \"kubernetes.io/projected/54b51f48-ffca-4337-be57-06003f3e7dcc-kube-api-access-pbzdz\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:09.565110 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.564895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.565110 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.565036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/54b51f48-ffca-4337-be57-06003f3e7dcc-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:09.565110 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.565076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:09.565110 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.565095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-default-certificate\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.565341 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.565147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-stats-auth\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.565341 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:09.565173 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:09.565341 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:09.565222 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls podName:54b51f48-ffca-4337-be57-06003f3e7dcc nodeName:}" failed. No retries permitted until 2026-09-16 19:41:10.065208342 +0000 UTC m=+129.997167343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-6g5t8" (UID: "54b51f48-ffca-4337-be57-06003f3e7dcc") : secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:09.565824 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.565806 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/54b51f48-ffca-4337-be57-06003f3e7dcc-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:09.575908 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.575873 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbzdz\" (UniqueName: \"kubernetes.io/projected/54b51f48-ffca-4337-be57-06003f3e7dcc-kube-api-access-pbzdz\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:09.666207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.666116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-stats-auth\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.666207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.666158 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9tx6\" (UniqueName: \"kubernetes.io/projected/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-kube-api-access-d9tx6\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.666207 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.666176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.666489 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.666216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.666489 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.666265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-default-certificate\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.666489 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:09.666286 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 19:41:09.666489 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:09.666349 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:10.166333556 +0000 UTC m=+130.098292556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : secret "router-metrics-certs-default" not found Sep 16 19:41:09.666489 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:09.666438 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:10.166417952 +0000 UTC m=+130.098376967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : configmap references non-existent config key: service-ca.crt Sep 16 19:41:09.668728 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.668703 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-stats-auth\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.668728 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.668727 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-default-certificate\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:09.679860 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:09.679828 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9tx6\" (UniqueName: \"kubernetes.io/projected/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-kube-api-access-d9tx6\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:10.069176 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.069131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:10.069355 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:10.069282 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:10.069405 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:10.069365 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls podName:54b51f48-ffca-4337-be57-06003f3e7dcc nodeName:}" failed. No retries permitted until 2026-09-16 19:41:11.069347322 +0000 UTC m=+131.001306322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-6g5t8" (UID: "54b51f48-ffca-4337-be57-06003f3e7dcc") : secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:10.170442 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.170402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:10.170442 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.170443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:10.170600 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:10.170559 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 19:41:10.170658 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:10.170643 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:11.170622444 +0000 UTC m=+131.102581458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : secret "router-metrics-certs-default" not found Sep 16 19:41:10.170698 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:10.170659 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:11.170653301 +0000 UTC m=+131.102612301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : configmap references non-existent config key: service-ca.crt Sep 16 19:41:10.455594 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.455511 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m"] Sep 16 19:41:10.458689 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.458668 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:10.461512 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.461475 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 16 19:41:10.463122 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.463094 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 16 19:41:10.463122 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.463106 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rvvqm\"" Sep 16 19:41:10.463122 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.463096 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 16 19:41:10.474479 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.474446 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m"] Sep 16 19:41:10.573770 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.573733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:10.573955 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.573801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v56h8\" (UniqueName: \"kubernetes.io/projected/a7692bd6-5db5-4841-b17a-8934b43ae2b3-kube-api-access-v56h8\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:10.674489 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.674435 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v56h8\" (UniqueName: \"kubernetes.io/projected/a7692bd6-5db5-4841-b17a-8934b43ae2b3-kube-api-access-v56h8\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:10.674697 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.674546 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:10.674697 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:10.674676 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 19:41:10.674777 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:10.674729 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls podName:a7692bd6-5db5-4841-b17a-8934b43ae2b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:11.174716639 +0000 UTC m=+131.106675638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-2766m" (UID: "a7692bd6-5db5-4841-b17a-8934b43ae2b3") : secret "samples-operator-tls" not found Sep 16 19:41:10.688382 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:10.688343 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v56h8\" (UniqueName: \"kubernetes.io/projected/a7692bd6-5db5-4841-b17a-8934b43ae2b3-kube-api-access-v56h8\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:11.079093 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.079039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:11.079290 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:11.079192 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:11.079290 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:11.079252 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls podName:54b51f48-ffca-4337-be57-06003f3e7dcc nodeName:}" failed. No retries permitted until 2026-09-16 19:41:13.079238093 +0000 UTC m=+133.011197097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-6g5t8" (UID: "54b51f48-ffca-4337-be57-06003f3e7dcc") : secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:11.179671 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.179642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:11.179861 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.179686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:11.179861 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:11.179828 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:13.179811007 +0000 UTC m=+133.111770027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : configmap references non-existent config key: service-ca.crt Sep 16 19:41:11.179861 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.179849 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:11.180034 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:11.179872 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 19:41:11.180034 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:11.179936 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:13.179919741 +0000 UTC m=+133.111878758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : secret "router-metrics-certs-default" not found Sep 16 19:41:11.180034 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:11.179944 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 19:41:11.180034 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:11.179984 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls podName:a7692bd6-5db5-4841-b17a-8934b43ae2b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:12.179970015 +0000 UTC m=+132.111929029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-2766m" (UID: "a7692bd6-5db5-4841-b17a-8934b43ae2b3") : secret "samples-operator-tls" not found Sep 16 19:41:11.403469 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.403391 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ll9g2"] Sep 16 19:41:11.406235 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.406214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.410574 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.410547 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 16 19:41:11.410574 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.410547 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 16 19:41:11.410804 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.410585 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 16 19:41:11.411810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.411783 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rmq78\"" Sep 16 19:41:11.412683 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.412639 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 16 19:41:11.418355 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.418329 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 16 19:41:11.420265 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.420240 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ll9g2"] Sep 16 19:41:11.583308 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.583260 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcf8j\" (UniqueName: \"kubernetes.io/projected/d58305b4-569b-4c7c-a6ce-9f714256b632-kube-api-access-lcf8j\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.583308 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.583321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d58305b4-569b-4c7c-a6ce-9f714256b632-config\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.583788 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.583340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d58305b4-569b-4c7c-a6ce-9f714256b632-serving-cert\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.583788 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.583365 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d58305b4-569b-4c7c-a6ce-9f714256b632-trusted-ca\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.684579 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.684494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d58305b4-569b-4c7c-a6ce-9f714256b632-config\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.684579 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.684533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d58305b4-569b-4c7c-a6ce-9f714256b632-serving-cert\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.684579 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.684563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d58305b4-569b-4c7c-a6ce-9f714256b632-trusted-ca\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.684872 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.684695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcf8j\" (UniqueName: \"kubernetes.io/projected/d58305b4-569b-4c7c-a6ce-9f714256b632-kube-api-access-lcf8j\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.685313 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.685286 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d58305b4-569b-4c7c-a6ce-9f714256b632-config\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.685436 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.685412 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d58305b4-569b-4c7c-a6ce-9f714256b632-trusted-ca\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.686924 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.686904 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d58305b4-569b-4c7c-a6ce-9f714256b632-serving-cert\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.697620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.697569 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcf8j\" (UniqueName: \"kubernetes.io/projected/d58305b4-569b-4c7c-a6ce-9f714256b632-kube-api-access-lcf8j\") pod \"console-operator-696884fb9c-ll9g2\" (UID: \"d58305b4-569b-4c7c-a6ce-9f714256b632\") " pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.715288 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.715253 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:11.989731 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:11.989641 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ll9g2"] Sep 16 19:41:11.992682 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:11.992651 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58305b4_569b_4c7c_a6ce_9f714256b632.slice/crio-fc1363ed5b7f205789343e757865c7930ed69067cd0857a8b3158f1611811a23 WatchSource:0}: Error finding container fc1363ed5b7f205789343e757865c7930ed69067cd0857a8b3158f1611811a23: Status 404 returned error can't find the container with id fc1363ed5b7f205789343e757865c7930ed69067cd0857a8b3158f1611811a23 Sep 16 19:41:12.184268 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:12.184226 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" event={"ID":"d58305b4-569b-4c7c-a6ce-9f714256b632","Type":"ContainerStarted","Data":"fc1363ed5b7f205789343e757865c7930ed69067cd0857a8b3158f1611811a23"} Sep 16 19:41:12.190665 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:12.190632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:12.190806 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:12.190786 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 19:41:12.190867 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:12.190855 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls podName:a7692bd6-5db5-4841-b17a-8934b43ae2b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:14.190838635 +0000 UTC m=+134.122797635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-2766m" (UID: "a7692bd6-5db5-4841-b17a-8934b43ae2b3") : secret "samples-operator-tls" not found Sep 16 19:41:13.098875 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.098828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:13.099280 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:13.098985 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:13.099280 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:13.099053 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls podName:54b51f48-ffca-4337-be57-06003f3e7dcc nodeName:}" failed. No retries permitted until 2026-09-16 19:41:17.099037437 +0000 UTC m=+137.030996437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-6g5t8" (UID: "54b51f48-ffca-4337-be57-06003f3e7dcc") : secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:13.200211 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.200169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:13.200384 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.200222 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:13.200384 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:13.200329 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 19:41:13.200458 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:13.200399 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:17.200382569 +0000 UTC m=+137.132341578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : secret "router-metrics-certs-default" not found Sep 16 19:41:13.200458 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:13.200413 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:17.200407158 +0000 UTC m=+137.132366157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : configmap references non-existent config key: service-ca.crt Sep 16 19:41:13.510132 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.510098 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p96zq"] Sep 16 19:41:13.514741 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.514710 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.520395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.520240 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 16 19:41:13.520395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.520264 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 16 19:41:13.520942 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.520916 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 16 19:41:13.521059 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.520916 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hrdn2\"" Sep 16 19:41:13.521650 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.521629 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 16 19:41:13.532947 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.532862 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p96zq"] Sep 16 19:41:13.703275 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.703241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrx5p\" (UniqueName: \"kubernetes.io/projected/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-api-access-wrx5p\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.703441 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.703306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.703441 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.703379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/042234ca-6b29-43e4-b3a6-8a595ed34992-crio-socket\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.703517 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.703431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/042234ca-6b29-43e4-b3a6-8a595ed34992-data-volume\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.703517 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.703471 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.804311 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.804284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/042234ca-6b29-43e4-b3a6-8a595ed34992-data-volume\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.804466 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.804316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.804466 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.804335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrx5p\" (UniqueName: \"kubernetes.io/projected/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-api-access-wrx5p\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.804466 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.804450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.804584 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:13.804458 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 19:41:13.804584 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.804565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/042234ca-6b29-43e4-b3a6-8a595ed34992-crio-socket\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.804678 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:13.804554 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 19:41:13.804678 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:13.804633 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls podName:042234ca-6b29-43e4-b3a6-8a595ed34992 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:14.304596603 +0000 UTC m=+134.236555613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p96zq" (UID: "042234ca-6b29-43e4-b3a6-8a595ed34992") : secret "insights-runtime-extractor-tls" not found Sep 16 19:41:13.804678 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:13.804666 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm podName:042234ca-6b29-43e4-b3a6-8a595ed34992 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:14.304649613 +0000 UTC m=+134.236608631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p96zq" (UID: "042234ca-6b29-43e4-b3a6-8a595ed34992") : configmap "kube-rbac-proxy" not found Sep 16 19:41:13.804784 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.804678 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/042234ca-6b29-43e4-b3a6-8a595ed34992-crio-socket\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.804784 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.804756 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/042234ca-6b29-43e4-b3a6-8a595ed34992-data-volume\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:13.813366 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:13.813334 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrx5p\" (UniqueName: \"kubernetes.io/projected/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-api-access-wrx5p\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:14.191907 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:14.191825 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ll9g2_d58305b4-569b-4c7c-a6ce-9f714256b632/console-operator/0.log" Sep 16 19:41:14.191907 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:14.191869 2577 generic.go:356] "Generic (PLEG): container finished" podID="d58305b4-569b-4c7c-a6ce-9f714256b632" containerID="795028fe7a439adc1e35ebf6afcce63711c25a30cb407db0934f3366dd250e8f" exitCode=255 Sep 16 19:41:14.192299 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:14.191915 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" event={"ID":"d58305b4-569b-4c7c-a6ce-9f714256b632","Type":"ContainerDied","Data":"795028fe7a439adc1e35ebf6afcce63711c25a30cb407db0934f3366dd250e8f"} Sep 16 19:41:14.192299 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:14.192132 2577 scope.go:117] "RemoveContainer" containerID="795028fe7a439adc1e35ebf6afcce63711c25a30cb407db0934f3366dd250e8f" Sep 16 19:41:14.208470 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:14.208438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:14.208621 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:14.208590 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 19:41:14.208708 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:14.208691 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls podName:a7692bd6-5db5-4841-b17a-8934b43ae2b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:18.208669359 +0000 UTC m=+138.140628359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-2766m" (UID: "a7692bd6-5db5-4841-b17a-8934b43ae2b3") : secret "samples-operator-tls" not found Sep 16 19:41:14.309325 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:14.309293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:14.309443 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:14.309389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:14.309443 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:14.309421 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 19:41:14.309556 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:14.309494 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls podName:042234ca-6b29-43e4-b3a6-8a595ed34992 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:15.309471524 +0000 UTC m=+135.241430541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p96zq" (UID: "042234ca-6b29-43e4-b3a6-8a595ed34992") : secret "insights-runtime-extractor-tls" not found Sep 16 19:41:14.309556 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:14.309512 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 19:41:14.309698 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:14.309562 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm podName:042234ca-6b29-43e4-b3a6-8a595ed34992 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:15.309546933 +0000 UTC m=+135.241505949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p96zq" (UID: "042234ca-6b29-43e4-b3a6-8a595ed34992") : configmap "kube-rbac-proxy" not found Sep 16 19:41:15.195459 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:15.195429 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ll9g2_d58305b4-569b-4c7c-a6ce-9f714256b632/console-operator/1.log" Sep 16 19:41:15.195915 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:15.195902 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ll9g2_d58305b4-569b-4c7c-a6ce-9f714256b632/console-operator/0.log" Sep 16 19:41:15.195997 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:15.195948 2577 generic.go:356] "Generic (PLEG): container finished" podID="d58305b4-569b-4c7c-a6ce-9f714256b632" containerID="06dfd25190005f38f01a99ec83746f67a1e917c55014bb761b17ac4fd207b096" exitCode=255 Sep 16 19:41:15.195997 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:15.195984 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" event={"ID":"d58305b4-569b-4c7c-a6ce-9f714256b632","Type":"ContainerDied","Data":"06dfd25190005f38f01a99ec83746f67a1e917c55014bb761b17ac4fd207b096"} Sep 16 19:41:15.196094 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:15.196040 2577 scope.go:117] "RemoveContainer" containerID="795028fe7a439adc1e35ebf6afcce63711c25a30cb407db0934f3366dd250e8f" Sep 16 19:41:15.196276 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:15.196254 2577 scope.go:117] "RemoveContainer" containerID="06dfd25190005f38f01a99ec83746f67a1e917c55014bb761b17ac4fd207b096" Sep 16 19:41:15.196461 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:15.196442 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ll9g2_openshift-console-operator(d58305b4-569b-4c7c-a6ce-9f714256b632)\"" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" podUID="d58305b4-569b-4c7c-a6ce-9f714256b632" Sep 16 19:41:15.319162 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:15.319121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:15.319351 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:15.319205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:15.319351 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:15.319303 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 19:41:15.319351 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:15.319308 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 19:41:15.319453 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:15.319376 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls podName:042234ca-6b29-43e4-b3a6-8a595ed34992 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:17.319359611 +0000 UTC m=+137.251318616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p96zq" (UID: "042234ca-6b29-43e4-b3a6-8a595ed34992") : secret "insights-runtime-extractor-tls" not found Sep 16 19:41:15.319453 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:15.319392 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm podName:042234ca-6b29-43e4-b3a6-8a595ed34992 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:17.319385228 +0000 UTC m=+137.251344228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p96zq" (UID: "042234ca-6b29-43e4-b3a6-8a595ed34992") : configmap "kube-rbac-proxy" not found Sep 16 19:41:15.467138 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:15.467070 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dtb5f_9e9c76d7-02d8-4ab9-9cd4-7f983331f938/dns-node-resolver/0.log" Sep 16 19:41:16.200066 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:16.200029 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ll9g2_d58305b4-569b-4c7c-a6ce-9f714256b632/console-operator/1.log" Sep 16 19:41:16.200514 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:16.200375 2577 scope.go:117] "RemoveContainer" containerID="06dfd25190005f38f01a99ec83746f67a1e917c55014bb761b17ac4fd207b096" Sep 16 19:41:16.200563 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:16.200526 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ll9g2_openshift-console-operator(d58305b4-569b-4c7c-a6ce-9f714256b632)\"" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" podUID="d58305b4-569b-4c7c-a6ce-9f714256b632" Sep 16 19:41:16.666203 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:16.666175 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rbd5j_109ee397-68be-473b-9ef2-c5452e5bce1c/node-ca/0.log" Sep 16 19:41:16.845790 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:16.845757 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-5nwwc"] Sep 16 19:41:16.849942 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:16.849921 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-5nwwc" Sep 16 19:41:16.853397 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:16.853376 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wrbsf\"" Sep 16 19:41:16.860160 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:16.860130 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-5nwwc"] Sep 16 19:41:16.930843 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:16.930741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp4x4\" (UniqueName: \"kubernetes.io/projected/c90678cc-1181-482a-8cc9-f8e11b3d63b2-kube-api-access-xp4x4\") pod \"network-check-source-6f8b768455-5nwwc\" (UID: \"c90678cc-1181-482a-8cc9-f8e11b3d63b2\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-5nwwc" Sep 16 19:41:17.031117 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:17.031077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp4x4\" (UniqueName: \"kubernetes.io/projected/c90678cc-1181-482a-8cc9-f8e11b3d63b2-kube-api-access-xp4x4\") pod \"network-check-source-6f8b768455-5nwwc\" (UID: \"c90678cc-1181-482a-8cc9-f8e11b3d63b2\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-5nwwc" Sep 16 19:41:17.041536 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:17.041500 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp4x4\" (UniqueName: \"kubernetes.io/projected/c90678cc-1181-482a-8cc9-f8e11b3d63b2-kube-api-access-xp4x4\") pod \"network-check-source-6f8b768455-5nwwc\" (UID: \"c90678cc-1181-482a-8cc9-f8e11b3d63b2\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-5nwwc" Sep 16 19:41:17.067752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:17.067722 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kf5ns_5aa726c3-75c4-434a-a04b-cffda55507fe/serve-healthcheck-canary/0.log" Sep 16 19:41:17.132241 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:17.132200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:17.132378 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:17.132341 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:17.132450 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:17.132417 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls podName:54b51f48-ffca-4337-be57-06003f3e7dcc nodeName:}" failed. No retries permitted until 2026-09-16 19:41:25.132401266 +0000 UTC m=+145.064360279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-6g5t8" (UID: "54b51f48-ffca-4337-be57-06003f3e7dcc") : secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:17.159069 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:17.159032 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-5nwwc" Sep 16 19:41:17.233270 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:17.233237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:17.233649 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:17.233289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:17.233649 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:17.233391 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 19:41:17.233649 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:17.233457 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:25.233438685 +0000 UTC m=+145.165397698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : secret "router-metrics-certs-default" not found Sep 16 19:41:17.233649 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:17.233475 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:25.233467273 +0000 UTC m=+145.165426273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : configmap references non-existent config key: service-ca.crt Sep 16 19:41:17.334297 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:17.334252 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:17.334478 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:17.334359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:17.334478 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:17.334366 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 19:41:17.334478 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:17.334427 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm podName:042234ca-6b29-43e4-b3a6-8a595ed34992 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:21.334412293 +0000 UTC m=+141.266371297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p96zq" (UID: "042234ca-6b29-43e4-b3a6-8a595ed34992") : configmap "kube-rbac-proxy" not found Sep 16 19:41:17.334478 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:17.334460 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 19:41:17.334647 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:17.334508 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls podName:042234ca-6b29-43e4-b3a6-8a595ed34992 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:21.334493134 +0000 UTC m=+141.266452153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p96zq" (UID: "042234ca-6b29-43e4-b3a6-8a595ed34992") : secret "insights-runtime-extractor-tls" not found Sep 16 19:41:17.430466 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:17.430286 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-5nwwc"] Sep 16 19:41:17.433119 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:17.433082 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90678cc_1181_482a_8cc9_f8e11b3d63b2.slice/crio-4ad2f201c1b703b4f74527a6039ccf76d64f052092ed27ef1c60946cb6270d49 WatchSource:0}: Error finding container 4ad2f201c1b703b4f74527a6039ccf76d64f052092ed27ef1c60946cb6270d49: Status 404 returned error can't find the container with id 4ad2f201c1b703b4f74527a6039ccf76d64f052092ed27ef1c60946cb6270d49 Sep 16 19:41:18.206987 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:18.206953 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-5nwwc" event={"ID":"c90678cc-1181-482a-8cc9-f8e11b3d63b2","Type":"ContainerStarted","Data":"2adcd497886057fedbad2615b7c541d5c5d3a6057c3af11dfef119cbe6893030"} Sep 16 19:41:18.207164 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:18.207005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-5nwwc" event={"ID":"c90678cc-1181-482a-8cc9-f8e11b3d63b2","Type":"ContainerStarted","Data":"4ad2f201c1b703b4f74527a6039ccf76d64f052092ed27ef1c60946cb6270d49"} Sep 16 19:41:18.230537 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:18.230481 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-5nwwc" podStartSLOduration=2.230461523 podStartE2EDuration="2.230461523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:18.229215261 +0000 UTC m=+138.161174284" watchObservedRunningTime="2026-09-16 19:41:18.230461523 +0000 UTC m=+138.162420544" Sep 16 19:41:18.240468 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:18.240433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:18.240893 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:18.240587 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 19:41:18.240893 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:18.240676 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls podName:a7692bd6-5db5-4841-b17a-8934b43ae2b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:26.240656262 +0000 UTC m=+146.172615266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-2766m" (UID: "a7692bd6-5db5-4841-b17a-8934b43ae2b3") : secret "samples-operator-tls" not found Sep 16 19:41:20.620307 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:20.620270 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l"] Sep 16 19:41:20.623345 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:20.623322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l" Sep 16 19:41:20.632530 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:20.632507 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 16 19:41:20.633421 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:20.633404 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 16 19:41:20.634005 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:20.633988 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-svcfb\"" Sep 16 19:41:20.659056 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:20.659020 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l"] Sep 16 19:41:20.661957 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:20.661930 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2nrv\" (UniqueName: \"kubernetes.io/projected/17e2b27f-8d97-4980-b072-83e452563c0a-kube-api-access-x2nrv\") pod \"migrator-8b4d697c5-brv8l\" (UID: \"17e2b27f-8d97-4980-b072-83e452563c0a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l" Sep 16 19:41:20.762792 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:20.762738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2nrv\" (UniqueName: \"kubernetes.io/projected/17e2b27f-8d97-4980-b072-83e452563c0a-kube-api-access-x2nrv\") pod \"migrator-8b4d697c5-brv8l\" (UID: \"17e2b27f-8d97-4980-b072-83e452563c0a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l" Sep 16 19:41:20.772689 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:20.772662 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2nrv\" (UniqueName: \"kubernetes.io/projected/17e2b27f-8d97-4980-b072-83e452563c0a-kube-api-access-x2nrv\") pod \"migrator-8b4d697c5-brv8l\" (UID: \"17e2b27f-8d97-4980-b072-83e452563c0a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l" Sep 16 19:41:20.931848 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:20.931738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l" Sep 16 19:41:21.205424 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:21.205343 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l"] Sep 16 19:41:21.209663 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:21.209632 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e2b27f_8d97_4980_b072_83e452563c0a.slice/crio-699961bcb8b957d880316207702e0dc4da336da35ff61fdeaa1e99428cb1190e WatchSource:0}: Error finding container 699961bcb8b957d880316207702e0dc4da336da35ff61fdeaa1e99428cb1190e: Status 404 returned error can't find the container with id 699961bcb8b957d880316207702e0dc4da336da35ff61fdeaa1e99428cb1190e Sep 16 19:41:21.215120 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:21.215088 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l" event={"ID":"17e2b27f-8d97-4980-b072-83e452563c0a","Type":"ContainerStarted","Data":"699961bcb8b957d880316207702e0dc4da336da35ff61fdeaa1e99428cb1190e"} Sep 16 19:41:21.367493 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:21.367454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:21.367701 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:21.367521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:21.367701 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:21.367641 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 19:41:21.367777 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:21.367703 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 19:41:21.367777 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:21.367712 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls podName:042234ca-6b29-43e4-b3a6-8a595ed34992 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:29.367694825 +0000 UTC m=+149.299653825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p96zq" (UID: "042234ca-6b29-43e4-b3a6-8a595ed34992") : secret "insights-runtime-extractor-tls" not found Sep 16 19:41:21.367851 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:21.367778 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm podName:042234ca-6b29-43e4-b3a6-8a595ed34992 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:29.367763176 +0000 UTC m=+149.299722180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p96zq" (UID: "042234ca-6b29-43e4-b3a6-8a595ed34992") : configmap "kube-rbac-proxy" not found Sep 16 19:41:21.715640 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:21.715578 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:21.716040 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:21.715668 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:21.716102 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:21.716080 2577 scope.go:117] "RemoveContainer" containerID="06dfd25190005f38f01a99ec83746f67a1e917c55014bb761b17ac4fd207b096" Sep 16 19:41:21.716273 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:21.716251 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ll9g2_openshift-console-operator(d58305b4-569b-4c7c-a6ce-9f714256b632)\"" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" podUID="d58305b4-569b-4c7c-a6ce-9f714256b632" Sep 16 19:41:23.222125 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:23.222091 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l" event={"ID":"17e2b27f-8d97-4980-b072-83e452563c0a","Type":"ContainerStarted","Data":"d0146d747ad2c7dbd9b8b5d5a6a0422f7ab889a8831a02a4cd13ef32e58719ac"} Sep 16 19:41:23.222502 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:23.222148 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l" event={"ID":"17e2b27f-8d97-4980-b072-83e452563c0a","Type":"ContainerStarted","Data":"b90b6efedca1db705734b668d11210a2f69be63db55c27f52ff1e4c743d7fc2f"} Sep 16 19:41:23.261821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:23.261769 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-brv8l" podStartSLOduration=2.236150528 podStartE2EDuration="3.261749702s" totalImagesPullingTime="1.025599174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:23.261482005 +0000 UTC m=+143.193441028" watchObservedRunningTime="2026-09-16 19:41:23.261749702 +0000 UTC m=+143.193708723" Sep 16 19:41:25.198097 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:25.198053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:25.198625 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:25.198242 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:25.198625 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:25.198335 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls podName:54b51f48-ffca-4337-be57-06003f3e7dcc nodeName:}" failed. No retries permitted until 2026-09-16 19:41:41.198312866 +0000 UTC m=+161.130271886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-6g5t8" (UID: "54b51f48-ffca-4337-be57-06003f3e7dcc") : secret "cluster-monitoring-operator-tls" not found Sep 16 19:41:25.299075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:25.299031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:25.299075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:25.299082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:25.299271 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:25.299198 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 19:41:25.299271 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:25.299231 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:41.299217271 +0000 UTC m=+161.231176271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : configmap references non-existent config key: service-ca.crt Sep 16 19:41:25.299381 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:25.299289 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs podName:2054f1c2-87ed-4a30-a88e-c5a901a78f9d nodeName:}" failed. No retries permitted until 2026-09-16 19:41:41.299274894 +0000 UTC m=+161.231233896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs") pod "router-default-785cbd56cd-8m7w4" (UID: "2054f1c2-87ed-4a30-a88e-c5a901a78f9d") : secret "router-metrics-certs-default" not found Sep 16 19:41:26.308383 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:26.308336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:26.308799 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:26.308494 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 19:41:26.308799 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:26.308557 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls podName:a7692bd6-5db5-4841-b17a-8934b43ae2b3 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:42.308542103 +0000 UTC m=+162.240501103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-2766m" (UID: "a7692bd6-5db5-4841-b17a-8934b43ae2b3") : secret "samples-operator-tls" not found Sep 16 19:41:29.434249 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:29.434201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:29.434663 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:29.434271 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:29.434663 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:29.434358 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 19:41:29.434663 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:29.434417 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls podName:042234ca-6b29-43e4-b3a6-8a595ed34992 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:45.434399301 +0000 UTC m=+165.366358301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p96zq" (UID: "042234ca-6b29-43e4-b3a6-8a595ed34992") : secret "insights-runtime-extractor-tls" not found Sep 16 19:41:29.434771 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:29.434726 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/042234ca-6b29-43e4-b3a6-8a595ed34992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:34.601880 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:34.601848 2577 scope.go:117] "RemoveContainer" containerID="06dfd25190005f38f01a99ec83746f67a1e917c55014bb761b17ac4fd207b096" Sep 16 19:41:35.258354 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:35.258323 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ll9g2_d58305b4-569b-4c7c-a6ce-9f714256b632/console-operator/1.log" Sep 16 19:41:35.258537 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:35.258388 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" event={"ID":"d58305b4-569b-4c7c-a6ce-9f714256b632","Type":"ContainerStarted","Data":"77e460987d405e9bf749c39846dedec064410965b27eaf9e7780d85490fdea46"} Sep 16 19:41:35.258682 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:35.258662 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:35.263520 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:35.263497 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" Sep 16 19:41:35.285105 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:35.285043 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-ll9g2" podStartSLOduration=22.545558937 podStartE2EDuration="24.285028959s" totalImagesPullingTime="1.739470022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:35.283585855 +0000 UTC m=+155.215544878" watchObservedRunningTime="2026-09-16 19:41:35.285028959 +0000 UTC m=+155.216987981" Sep 16 19:41:37.481753 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:37.481710 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kpsrf" podUID="8ca9d42a-96da-433e-a05c-92942a97dc59" Sep 16 19:41:37.620987 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:37.620940 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z9szj" podUID="d59f8428-b82a-4081-aca2-8a277b37066c" Sep 16 19:41:38.269832 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:38.269799 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpsrf" Sep 16 19:41:41.233620 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:41.233564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:41.236003 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:41.235980 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/54b51f48-ffca-4337-be57-06003f3e7dcc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-6g5t8\" (UID: \"54b51f48-ffca-4337-be57-06003f3e7dcc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:41.334276 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:41.334218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:41.334276 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:41.334279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:41.334957 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:41.334936 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-service-ca-bundle\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:41.336689 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:41.336666 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2054f1c2-87ed-4a30-a88e-c5a901a78f9d-metrics-certs\") pod \"router-default-785cbd56cd-8m7w4\" (UID: \"2054f1c2-87ed-4a30-a88e-c5a901a78f9d\") " pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:41.465524 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:41.465482 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" Sep 16 19:41:41.567130 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:41.567083 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:41.740883 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:41.740845 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8"] Sep 16 19:41:41.744102 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:41.744065 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b51f48_ffca_4337_be57_06003f3e7dcc.slice/crio-e1dd789558b218be959d8ff5350583d9de0e62f8a6ba49bd2abde12255d0b9b5 WatchSource:0}: Error finding container e1dd789558b218be959d8ff5350583d9de0e62f8a6ba49bd2abde12255d0b9b5: Status 404 returned error can't find the container with id e1dd789558b218be959d8ff5350583d9de0e62f8a6ba49bd2abde12255d0b9b5 Sep 16 19:41:41.842451 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:41.842364 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-785cbd56cd-8m7w4"] Sep 16 19:41:41.845276 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:41.845246 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2054f1c2_87ed_4a30_a88e_c5a901a78f9d.slice/crio-57d208aad30c22a4d33cd38fae72e3b676d610cb70970ef1d7fabcdddaf2bbf9 WatchSource:0}: Error finding container 57d208aad30c22a4d33cd38fae72e3b676d610cb70970ef1d7fabcdddaf2bbf9: Status 404 returned error can't find the container with id 57d208aad30c22a4d33cd38fae72e3b676d610cb70970ef1d7fabcdddaf2bbf9 Sep 16 19:41:42.284205 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.284168 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" event={"ID":"54b51f48-ffca-4337-be57-06003f3e7dcc","Type":"ContainerStarted","Data":"e1dd789558b218be959d8ff5350583d9de0e62f8a6ba49bd2abde12255d0b9b5"} Sep 16 19:41:42.285741 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.285711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-785cbd56cd-8m7w4" event={"ID":"2054f1c2-87ed-4a30-a88e-c5a901a78f9d","Type":"ContainerStarted","Data":"682f6cdd8d2ed17396881dcd84ca64a8e0200f612ab2d865d9dba0e8182c62e5"} Sep 16 19:41:42.285864 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.285764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-785cbd56cd-8m7w4" event={"ID":"2054f1c2-87ed-4a30-a88e-c5a901a78f9d","Type":"ContainerStarted","Data":"57d208aad30c22a4d33cd38fae72e3b676d610cb70970ef1d7fabcdddaf2bbf9"} Sep 16 19:41:42.320383 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.320329 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-785cbd56cd-8m7w4" podStartSLOduration=33.320309373 podStartE2EDuration="33.320309373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:42.318291757 +0000 UTC m=+162.250250780" watchObservedRunningTime="2026-09-16 19:41:42.320309373 +0000 UTC m=+162.252268394" Sep 16 19:41:42.343271 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.343232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:41:42.343466 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.343319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:42.345908 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.345875 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca9d42a-96da-433e-a05c-92942a97dc59-metrics-tls\") pod \"dns-default-kpsrf\" (UID: \"8ca9d42a-96da-433e-a05c-92942a97dc59\") " pod="openshift-dns/dns-default-kpsrf" Sep 16 19:41:42.346027 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.345924 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7692bd6-5db5-4841-b17a-8934b43ae2b3-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-2766m\" (UID: \"a7692bd6-5db5-4841-b17a-8934b43ae2b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:42.473232 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.473198 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8zc66\"" Sep 16 19:41:42.480655 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.480589 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpsrf" Sep 16 19:41:42.568160 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.568032 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" Sep 16 19:41:42.568160 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.568080 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:42.571994 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.571961 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:42.760845 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.760804 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kpsrf"] Sep 16 19:41:42.763878 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:42.763844 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca9d42a_96da_433e_a05c_92942a97dc59.slice/crio-5075e1b7447e8535cc7b386bffb902ae5746a5533b2f0bbcadde14857fe1b0d1 WatchSource:0}: Error finding container 5075e1b7447e8535cc7b386bffb902ae5746a5533b2f0bbcadde14857fe1b0d1: Status 404 returned error can't find the container with id 5075e1b7447e8535cc7b386bffb902ae5746a5533b2f0bbcadde14857fe1b0d1 Sep 16 19:41:42.850778 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:42.850691 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m"] Sep 16 19:41:43.290359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:43.290317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" event={"ID":"a7692bd6-5db5-4841-b17a-8934b43ae2b3","Type":"ContainerStarted","Data":"1d74302009879a483d88ca945cde71fd7ed5bab8a8453102ab23a27634f01746"} Sep 16 19:41:43.291702 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:43.291666 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpsrf" event={"ID":"8ca9d42a-96da-433e-a05c-92942a97dc59","Type":"ContainerStarted","Data":"5075e1b7447e8535cc7b386bffb902ae5746a5533b2f0bbcadde14857fe1b0d1"} Sep 16 19:41:43.292009 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:43.291989 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:43.293409 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:43.293388 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-785cbd56cd-8m7w4" Sep 16 19:41:44.298047 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:44.297827 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" event={"ID":"54b51f48-ffca-4337-be57-06003f3e7dcc","Type":"ContainerStarted","Data":"f06c052f410a9d12e2712b465e94d5c2019d40b10b552d6d6dcfd0930f852416"} Sep 16 19:41:45.387433 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.387349 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-6g5t8" podStartSLOduration=34.610293495 podStartE2EDuration="36.387305405s" totalImagesPullingTime="1.77701191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:44.321132926 +0000 UTC m=+164.253091939" watchObservedRunningTime="2026-09-16 19:41:45.387305405 +0000 UTC m=+165.319264428" Sep 16 19:41:45.388824 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.388799 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-j6ntv"] Sep 16 19:41:45.394160 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.394041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-j6ntv" Sep 16 19:41:45.397454 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.397333 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 16 19:41:45.397752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.397729 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wbmlq\"" Sep 16 19:41:45.398008 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.397986 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 16 19:41:45.415678 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.413752 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-j6ntv"] Sep 16 19:41:45.470977 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.470941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrww9\" (UniqueName: \"kubernetes.io/projected/dd255aaa-8ad1-4728-941f-fa6a61e0cf46-kube-api-access-hrww9\") pod \"downloads-76f99584f4-j6ntv\" (UID: \"dd255aaa-8ad1-4728-941f-fa6a61e0cf46\") " pod="openshift-console/downloads-76f99584f4-j6ntv" Sep 16 19:41:45.471169 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.471095 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:45.474212 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.474187 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/042234ca-6b29-43e4-b3a6-8a595ed34992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p96zq\" (UID: \"042234ca-6b29-43e4-b3a6-8a595ed34992\") " pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:45.572401 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.572358 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrww9\" (UniqueName: \"kubernetes.io/projected/dd255aaa-8ad1-4728-941f-fa6a61e0cf46-kube-api-access-hrww9\") pod \"downloads-76f99584f4-j6ntv\" (UID: \"dd255aaa-8ad1-4728-941f-fa6a61e0cf46\") " pod="openshift-console/downloads-76f99584f4-j6ntv" Sep 16 19:41:45.584130 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.584102 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrww9\" (UniqueName: \"kubernetes.io/projected/dd255aaa-8ad1-4728-941f-fa6a61e0cf46-kube-api-access-hrww9\") pod \"downloads-76f99584f4-j6ntv\" (UID: \"dd255aaa-8ad1-4728-941f-fa6a61e0cf46\") " pod="openshift-console/downloads-76f99584f4-j6ntv" Sep 16 19:41:45.625350 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.625313 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p96zq" Sep 16 19:41:45.713210 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.713153 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-j6ntv" Sep 16 19:41:45.900592 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.900565 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p96zq"] Sep 16 19:41:45.902987 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:45.902955 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042234ca_6b29_43e4_b3a6_8a595ed34992.slice/crio-921a987c3fdc2e5235a5f110e8543570dbff5aacc9ea3d4b885f981953a0c1a0 WatchSource:0}: Error finding container 921a987c3fdc2e5235a5f110e8543570dbff5aacc9ea3d4b885f981953a0c1a0: Status 404 returned error can't find the container with id 921a987c3fdc2e5235a5f110e8543570dbff5aacc9ea3d4b885f981953a0c1a0 Sep 16 19:41:45.986764 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:45.986730 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-j6ntv"] Sep 16 19:41:45.990391 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:45.990361 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd255aaa_8ad1_4728_941f_fa6a61e0cf46.slice/crio-c75c100cf1b20d9eeb3949f9bebaa4935fda0a106a840b63635ecec164b1aed3 WatchSource:0}: Error finding container c75c100cf1b20d9eeb3949f9bebaa4935fda0a106a840b63635ecec164b1aed3: Status 404 returned error can't find the container with id c75c100cf1b20d9eeb3949f9bebaa4935fda0a106a840b63635ecec164b1aed3 Sep 16 19:41:46.305623 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:46.305582 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p96zq" event={"ID":"042234ca-6b29-43e4-b3a6-8a595ed34992","Type":"ContainerStarted","Data":"82f52d26e44d21f7f5e4b08d5b20aef2e8eeb77f07dcc61930810506670824cd"} Sep 16 19:41:46.305808 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:46.305662 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p96zq" event={"ID":"042234ca-6b29-43e4-b3a6-8a595ed34992","Type":"ContainerStarted","Data":"921a987c3fdc2e5235a5f110e8543570dbff5aacc9ea3d4b885f981953a0c1a0"} Sep 16 19:41:46.307202 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:46.307168 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" event={"ID":"a7692bd6-5db5-4841-b17a-8934b43ae2b3","Type":"ContainerStarted","Data":"6aaeef2e2b8714b81d3a028866777c099cf14588f93962d6ff1438f1cba0ed54"} Sep 16 19:41:46.307269 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:46.307221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" event={"ID":"a7692bd6-5db5-4841-b17a-8934b43ae2b3","Type":"ContainerStarted","Data":"eca087a969de990fcd90d922a3ac9013c35d42c9a52f095c7ac08fe507de84ec"} Sep 16 19:41:46.308888 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:46.308869 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpsrf" event={"ID":"8ca9d42a-96da-433e-a05c-92942a97dc59","Type":"ContainerStarted","Data":"5707239437a12ee82aa652c745af49796e54fb30e98df6d3e0043fcfea60aac7"} Sep 16 19:41:46.308948 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:46.308903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpsrf" event={"ID":"8ca9d42a-96da-433e-a05c-92942a97dc59","Type":"ContainerStarted","Data":"75cd0c68324665d73fc0da8735968babdcd70f841368f9c014959b78f99fa045"} Sep 16 19:41:46.308948 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:46.308934 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kpsrf" Sep 16 19:41:46.309913 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:46.309894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-j6ntv" event={"ID":"dd255aaa-8ad1-4728-941f-fa6a61e0cf46","Type":"ContainerStarted","Data":"c75c100cf1b20d9eeb3949f9bebaa4935fda0a106a840b63635ecec164b1aed3"} Sep 16 19:41:46.330770 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:46.330716 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-2766m" podStartSLOduration=33.98977421 podStartE2EDuration="36.330697816s" totalImagesPullingTime="2.340923606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:46.329926963 +0000 UTC m=+166.261885985" watchObservedRunningTime="2026-09-16 19:41:46.330697816 +0000 UTC m=+166.262656839" Sep 16 19:41:46.366151 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:46.366082 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kpsrf" podStartSLOduration=129.888226754 podStartE2EDuration="2m12.36606397s" totalImagesPullingTime="2.477837216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:46.363755514 +0000 UTC m=+166.295714536" watchObservedRunningTime="2026-09-16 19:41:46.36606397 +0000 UTC m=+166.298022991" Sep 16 19:41:47.315599 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:47.315511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p96zq" event={"ID":"042234ca-6b29-43e4-b3a6-8a595ed34992","Type":"ContainerStarted","Data":"c741ed825b10ed7b4190ec2a373ba76a6d301d7cd8874bef67f2f646c5aa0eaa"} Sep 16 19:41:48.189026 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.188992 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j"] Sep 16 19:41:48.193531 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.193505 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.198862 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.198642 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 16 19:41:48.198862 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.198649 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 16 19:41:48.200074 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.199899 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xqx7r\"" Sep 16 19:41:48.200201 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.200098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 16 19:41:48.207107 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.207027 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j"] Sep 16 19:41:48.296931 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.296894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/841bb181-1e84-4245-bcf8-d1be32400cd5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.296931 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.296939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kt7x\" (UniqueName: \"kubernetes.io/projected/841bb181-1e84-4245-bcf8-d1be32400cd5-kube-api-access-6kt7x\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.297155 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.297096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/841bb181-1e84-4245-bcf8-d1be32400cd5-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.297155 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.297138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/841bb181-1e84-4245-bcf8-d1be32400cd5-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.397681 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.397633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/841bb181-1e84-4245-bcf8-d1be32400cd5-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.398113 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.397695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/841bb181-1e84-4245-bcf8-d1be32400cd5-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.398113 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.397738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/841bb181-1e84-4245-bcf8-d1be32400cd5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.398113 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.397765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kt7x\" (UniqueName: \"kubernetes.io/projected/841bb181-1e84-4245-bcf8-d1be32400cd5-kube-api-access-6kt7x\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.398113 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:48.397777 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 16 19:41:48.398113 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:48.397854 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841bb181-1e84-4245-bcf8-d1be32400cd5-prometheus-operator-tls podName:841bb181-1e84-4245-bcf8-d1be32400cd5 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:48.897833222 +0000 UTC m=+168.829792226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/841bb181-1e84-4245-bcf8-d1be32400cd5-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-zmr7j" (UID: "841bb181-1e84-4245-bcf8-d1be32400cd5") : secret "prometheus-operator-tls" not found Sep 16 19:41:48.398512 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.398485 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/841bb181-1e84-4245-bcf8-d1be32400cd5-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.400495 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.400469 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/841bb181-1e84-4245-bcf8-d1be32400cd5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.408181 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.408148 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kt7x\" (UniqueName: \"kubernetes.io/projected/841bb181-1e84-4245-bcf8-d1be32400cd5-kube-api-access-6kt7x\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.901829 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.901792 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/841bb181-1e84-4245-bcf8-d1be32400cd5-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:48.904551 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:48.904520 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/841bb181-1e84-4245-bcf8-d1be32400cd5-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-zmr7j\" (UID: \"841bb181-1e84-4245-bcf8-d1be32400cd5\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:49.103952 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:49.103916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" Sep 16 19:41:49.325747 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:49.325702 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p96zq" event={"ID":"042234ca-6b29-43e4-b3a6-8a595ed34992","Type":"ContainerStarted","Data":"8ed8d5b0eabd8a2e635a5871cda2ea8daa78231799b38235a050679257b741fb"} Sep 16 19:41:49.349262 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:49.349204 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p96zq" podStartSLOduration=34.02477378 podStartE2EDuration="36.349187024s" totalImagesPullingTime="2.324413244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:41:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:49.348879831 +0000 UTC m=+169.280838855" watchObservedRunningTime="2026-09-16 19:41:49.349187024 +0000 UTC m=+169.281146046" Sep 16 19:41:49.393913 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:49.393880 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j"] Sep 16 19:41:49.397284 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:49.397250 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841bb181_1e84_4245_bcf8_d1be32400cd5.slice/crio-42f3a2b4c186a328750de32e972f7459f682e1a006fa78b586aa80545c1603f0 WatchSource:0}: Error finding container 42f3a2b4c186a328750de32e972f7459f682e1a006fa78b586aa80545c1603f0: Status 404 returned error can't find the container with id 42f3a2b4c186a328750de32e972f7459f682e1a006fa78b586aa80545c1603f0 Sep 16 19:41:50.332459 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:50.332373 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" event={"ID":"841bb181-1e84-4245-bcf8-d1be32400cd5","Type":"ContainerStarted","Data":"42f3a2b4c186a328750de32e972f7459f682e1a006fa78b586aa80545c1603f0"} Sep 16 19:41:51.338676 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:51.338627 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" event={"ID":"841bb181-1e84-4245-bcf8-d1be32400cd5","Type":"ContainerStarted","Data":"cdc4b90b02131ef9d4873f5bd4371230eea23846a0d89bba5ab1565b92199a47"} Sep 16 19:41:51.339150 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:51.338698 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" event={"ID":"841bb181-1e84-4245-bcf8-d1be32400cd5","Type":"ContainerStarted","Data":"67113cc11efe42339f86101b2af2d09b9f03cbf7e78d91d88c3e7a8b3c2ee4bb"} Sep 16 19:41:51.363200 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:51.363127 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-zmr7j" podStartSLOduration=2.000525201 podStartE2EDuration="3.363103317s" totalImagesPullingTime="1.362578116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:41:51.36093267 +0000 UTC m=+171.292891694" watchObservedRunningTime="2026-09-16 19:41:51.363103317 +0000 UTC m=+171.295062338" Sep 16 19:41:52.601975 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:52.601884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:41:53.737845 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.737533 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b"] Sep 16 19:41:53.741330 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.741302 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-njc96"] Sep 16 19:41:53.741477 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.741423 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.744977 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.744936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.744977 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.744967 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dlmld\"" Sep 16 19:41:53.745364 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.744945 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 16 19:41:53.745531 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.745507 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 16 19:41:53.745726 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.745703 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 16 19:41:53.749133 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.748878 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 16 19:41:53.749133 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.748925 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 16 19:41:53.749133 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.748935 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 16 19:41:53.749133 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.748935 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z5z84\"" Sep 16 19:41:53.757794 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.757595 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b"] Sep 16 19:41:53.853964 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.853914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-tls\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.853964 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.853971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.854220 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8126e1a6-d411-4f96-83a9-6f29d1b96672-metrics-client-ca\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.854220 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.854220 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkzf6\" (UniqueName: \"kubernetes.io/projected/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-api-access-fkzf6\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.854220 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-accelerators-collector-config\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.854393 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854227 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-textfile\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.854393 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8126e1a6-d411-4f96-83a9-6f29d1b96672-sys\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.854393 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsdsz\" (UniqueName: \"kubernetes.io/projected/8126e1a6-d411-4f96-83a9-6f29d1b96672-kube-api-access-fsdsz\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.854393 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2eef8531-b2a8-4a97-990c-676f8e647d0c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.854522 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8126e1a6-d411-4f96-83a9-6f29d1b96672-root\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.854522 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.854522 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-wtmp\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.854637 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854536 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2eef8531-b2a8-4a97-990c-676f8e647d0c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.854637 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.854559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.955730 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.955691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8126e1a6-d411-4f96-83a9-6f29d1b96672-sys\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.955730 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.955733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdsz\" (UniqueName: \"kubernetes.io/projected/8126e1a6-d411-4f96-83a9-6f29d1b96672-kube-api-access-fsdsz\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.955981 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.955757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2eef8531-b2a8-4a97-990c-676f8e647d0c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.955981 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.955821 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8126e1a6-d411-4f96-83a9-6f29d1b96672-sys\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.955981 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.955875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8126e1a6-d411-4f96-83a9-6f29d1b96672-root\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.955981 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.955936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.955981 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.955959 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8126e1a6-d411-4f96-83a9-6f29d1b96672-root\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.956236 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-wtmp\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.956236 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2eef8531-b2a8-4a97-990c-676f8e647d0c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.956236 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.956236 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-tls\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.956236 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.956236 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8126e1a6-d411-4f96-83a9-6f29d1b96672-metrics-client-ca\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.956236 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.956236 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956210 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-wtmp\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.956236 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkzf6\" (UniqueName: \"kubernetes.io/projected/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-api-access-fkzf6\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.956672 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-accelerators-collector-config\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.956672 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956334 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-textfile\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.956672 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956428 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2eef8531-b2a8-4a97-990c-676f8e647d0c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.956672 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956542 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2eef8531-b2a8-4a97-990c-676f8e647d0c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.956672 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:53.956562 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 16 19:41:53.956672 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:41:53.956652 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-tls podName:8126e1a6-d411-4f96-83a9-6f29d1b96672 nodeName:}" failed. No retries permitted until 2026-09-16 19:41:54.456632312 +0000 UTC m=+174.388591327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-tls") pod "node-exporter-njc96" (UID: "8126e1a6-d411-4f96-83a9-6f29d1b96672") : secret "node-exporter-tls" not found Sep 16 19:41:53.956672 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956657 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.956990 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956699 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-textfile\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.957031 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.956988 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-accelerators-collector-config\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.957408 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.957305 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8126e1a6-d411-4f96-83a9-6f29d1b96672-metrics-client-ca\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.959129 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.959107 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.959395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.959363 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:53.959779 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.959753 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.965654 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.965601 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsdsz\" (UniqueName: \"kubernetes.io/projected/8126e1a6-d411-4f96-83a9-6f29d1b96672-kube-api-access-fsdsz\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:53.965784 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:53.965703 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkzf6\" (UniqueName: \"kubernetes.io/projected/2eef8531-b2a8-4a97-990c-676f8e647d0c-kube-api-access-fkzf6\") pod \"kube-state-metrics-59fbdd77d-59g5b\" (UID: \"2eef8531-b2a8-4a97-990c-676f8e647d0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:54.054156 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.054115 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" Sep 16 19:41:54.339303 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.339217 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b"] Sep 16 19:41:54.344117 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:54.344082 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eef8531_b2a8_4a97_990c_676f8e647d0c.slice/crio-d783f34d6b0f905607524edb86adf63ba8288c43b3ac8b808669618a606b2294 WatchSource:0}: Error finding container d783f34d6b0f905607524edb86adf63ba8288c43b3ac8b808669618a606b2294: Status 404 returned error can't find the container with id d783f34d6b0f905607524edb86adf63ba8288c43b3ac8b808669618a606b2294 Sep 16 19:41:54.352415 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.352379 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" event={"ID":"2eef8531-b2a8-4a97-990c-676f8e647d0c","Type":"ContainerStarted","Data":"d783f34d6b0f905607524edb86adf63ba8288c43b3ac8b808669618a606b2294"} Sep 16 19:41:54.462053 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.462013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-tls\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:54.464823 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.464796 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8126e1a6-d411-4f96-83a9-6f29d1b96672-node-exporter-tls\") pod \"node-exporter-njc96\" (UID: \"8126e1a6-d411-4f96-83a9-6f29d1b96672\") " pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:54.664716 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.664641 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-njc96" Sep 16 19:41:54.677527 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:54.677490 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8126e1a6_d411_4f96_83a9_6f29d1b96672.slice/crio-5464c0f4021bc4d235c6bf6026940a9097b0ce0860af5a51581cf825a514f3db WatchSource:0}: Error finding container 5464c0f4021bc4d235c6bf6026940a9097b0ce0860af5a51581cf825a514f3db: Status 404 returned error can't find the container with id 5464c0f4021bc4d235c6bf6026940a9097b0ce0860af5a51581cf825a514f3db Sep 16 19:41:54.684590 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.684563 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 19:41:54.689577 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.689554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.700150 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.700123 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 16 19:41:54.700398 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.700380 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 16 19:41:54.700526 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.700502 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 16 19:41:54.700526 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.700526 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p8qzs\"" Sep 16 19:41:54.700992 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.700808 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 16 19:41:54.700992 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.700892 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 16 19:41:54.701176 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.701161 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 16 19:41:54.701350 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.701332 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 16 19:41:54.701417 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.701389 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 16 19:41:54.701719 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.701701 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 16 19:41:54.715275 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.715243 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 19:41:54.866233 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm4m6\" (UniqueName: \"kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-kube-api-access-sm4m6\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866335 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-out\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-web-config\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-volume\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866647 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.866810 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.866703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.967914 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.967822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.967914 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.967897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-web-config\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968127 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.967926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968127 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.967951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968127 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.967980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968127 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.968010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-volume\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968127 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.968035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968127 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.968065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968127 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.968088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968127 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.968116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm4m6\" (UniqueName: \"kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-kube-api-access-sm4m6\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968487 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.968146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968487 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.968209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968487 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.968241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-out\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.968982 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.968860 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.970221 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.970161 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.971386 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.971004 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.971386 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.971329 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.972009 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.971959 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.972404 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.972382 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.972634 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.972565 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-out\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.973968 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.973211 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-volume\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.973968 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.973927 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.974333 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.974306 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.974672 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.974649 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-web-config\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.974912 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.974888 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:54.986767 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:54.986728 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm4m6\" (UniqueName: \"kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-kube-api-access-sm4m6\") pod \"alertmanager-main-0\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:55.001590 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:55.001554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:41:55.326355 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:55.326112 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 19:41:55.330139 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:41:55.330101 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18fdab3_5b27_41ce_8693_e8392ae8f487.slice/crio-ded0aafcd035d8f4e1a54bf52eeeb1dfb732d3abcd3c41099f4d312991924db8 WatchSource:0}: Error finding container ded0aafcd035d8f4e1a54bf52eeeb1dfb732d3abcd3c41099f4d312991924db8: Status 404 returned error can't find the container with id ded0aafcd035d8f4e1a54bf52eeeb1dfb732d3abcd3c41099f4d312991924db8 Sep 16 19:41:55.359399 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:55.359359 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerStarted","Data":"ded0aafcd035d8f4e1a54bf52eeeb1dfb732d3abcd3c41099f4d312991924db8"} Sep 16 19:41:55.361088 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:55.361055 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-njc96" event={"ID":"8126e1a6-d411-4f96-83a9-6f29d1b96672","Type":"ContainerStarted","Data":"5464c0f4021bc4d235c6bf6026940a9097b0ce0860af5a51581cf825a514f3db"} Sep 16 19:41:56.318738 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.318671 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kpsrf" Sep 16 19:41:56.829117 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.829073 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6885569d5f-sp6nv"] Sep 16 19:41:56.833456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.833425 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:56.836908 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.836877 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 16 19:41:56.836908 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.836904 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 16 19:41:56.837077 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.836933 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-slztk\"" Sep 16 19:41:56.837077 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.836954 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 16 19:41:56.837077 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.836883 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 16 19:41:56.837077 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.836904 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dg2dqgavf5flq\"" Sep 16 19:41:56.837077 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.837073 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 16 19:41:56.846629 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.846579 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6885569d5f-sp6nv"] Sep 16 19:41:56.985528 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.985494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-tls\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:56.985528 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.985545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-grpc-tls\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:56.985803 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.985577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:56.985803 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.985618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:56.985803 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.985655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76c1825a-9987-46c5-98fb-63e6dbed7028-metrics-client-ca\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:56.985803 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.985680 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmzhg\" (UniqueName: \"kubernetes.io/projected/76c1825a-9987-46c5-98fb-63e6dbed7028-kube-api-access-dmzhg\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:56.985803 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.985714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:56.985973 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:56.985798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.086429 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.086309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.086429 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.086394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-tls\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.086668 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.086434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-grpc-tls\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.086668 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.086466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.086668 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.086532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.086668 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.086597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76c1825a-9987-46c5-98fb-63e6dbed7028-metrics-client-ca\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.086668 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.086655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmzhg\" (UniqueName: \"kubernetes.io/projected/76c1825a-9987-46c5-98fb-63e6dbed7028-kube-api-access-dmzhg\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.086916 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.086703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.087343 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.087318 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76c1825a-9987-46c5-98fb-63e6dbed7028-metrics-client-ca\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.089499 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.089468 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.089638 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.089544 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.089638 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.089576 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-tls\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.089803 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.089774 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.089874 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.089842 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-grpc-tls\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.090799 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.090773 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76c1825a-9987-46c5-98fb-63e6dbed7028-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.097636 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.097578 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmzhg\" (UniqueName: \"kubernetes.io/projected/76c1825a-9987-46c5-98fb-63e6dbed7028-kube-api-access-dmzhg\") pod \"thanos-querier-6885569d5f-sp6nv\" (UID: \"76c1825a-9987-46c5-98fb-63e6dbed7028\") " pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:57.144525 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:57.144484 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:41:58.382419 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.382386 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt"] Sep 16 19:41:58.386171 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.386144 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" Sep 16 19:41:58.390057 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.390033 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2p89h\"" Sep 16 19:41:58.390198 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.390033 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 16 19:41:58.399822 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.399796 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt"] Sep 16 19:41:58.499746 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.499702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4gtj\" (UniqueName: \"kubernetes.io/projected/12dfd771-8aab-4cfc-894f-2b8c4211fae6-kube-api-access-n4gtj\") pod \"monitoring-plugin-5d85778b9d-nvhgt\" (UID: \"12dfd771-8aab-4cfc-894f-2b8c4211fae6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" Sep 16 19:41:58.499941 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.499813 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dfd771-8aab-4cfc-894f-2b8c4211fae6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-nvhgt\" (UID: \"12dfd771-8aab-4cfc-894f-2b8c4211fae6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" Sep 16 19:41:58.601308 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.601267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4gtj\" (UniqueName: \"kubernetes.io/projected/12dfd771-8aab-4cfc-894f-2b8c4211fae6-kube-api-access-n4gtj\") pod \"monitoring-plugin-5d85778b9d-nvhgt\" (UID: \"12dfd771-8aab-4cfc-894f-2b8c4211fae6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" Sep 16 19:41:58.601509 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.601441 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dfd771-8aab-4cfc-894f-2b8c4211fae6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-nvhgt\" (UID: \"12dfd771-8aab-4cfc-894f-2b8c4211fae6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" Sep 16 19:41:58.604489 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.604460 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dfd771-8aab-4cfc-894f-2b8c4211fae6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-nvhgt\" (UID: \"12dfd771-8aab-4cfc-894f-2b8c4211fae6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" Sep 16 19:41:58.616231 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.616193 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4gtj\" (UniqueName: \"kubernetes.io/projected/12dfd771-8aab-4cfc-894f-2b8c4211fae6-kube-api-access-n4gtj\") pod \"monitoring-plugin-5d85778b9d-nvhgt\" (UID: \"12dfd771-8aab-4cfc-894f-2b8c4211fae6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" Sep 16 19:41:58.700113 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:41:58.700007 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" Sep 16 19:42:00.084702 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.084636 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7788465b88-t6g4s"] Sep 16 19:42:00.089759 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.089719 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.093058 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.093024 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 16 19:42:00.093058 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.093050 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 16 19:42:00.093287 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.093036 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 16 19:42:00.094147 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.094127 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gbcn9\"" Sep 16 19:42:00.094147 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.094120 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 16 19:42:00.095372 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.095350 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 16 19:42:00.101838 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.101811 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 16 19:42:00.102966 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.102935 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7788465b88-t6g4s"] Sep 16 19:42:00.118141 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.118104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-serving-cert\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.118321 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.118146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-trusted-ca-bundle\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.118321 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.118183 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-oauth-serving-cert\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.118321 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.118259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsp75\" (UniqueName: \"kubernetes.io/projected/49a95c18-86f7-48ec-9332-fd659ec956c2-kube-api-access-qsp75\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.118321 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.118293 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-console-config\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.118525 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.118325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-oauth-config\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.118525 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.118354 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-service-ca\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.146261 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.144564 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:42:00.149326 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.149296 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.153108 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.153078 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 16 19:42:00.153866 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.153555 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 16 19:42:00.153866 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.153685 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 16 19:42:00.153866 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.153808 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 16 19:42:00.154096 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.153910 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 16 19:42:00.154096 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.153936 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pznnd\"" Sep 16 19:42:00.154096 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.153963 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8g815iqubek7e\"" Sep 16 19:42:00.154518 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.154442 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 16 19:42:00.154518 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.154516 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 16 19:42:00.155083 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.154934 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 16 19:42:00.155083 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.154982 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 16 19:42:00.155218 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.155190 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 16 19:42:00.155291 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.155218 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 16 19:42:00.155291 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.155268 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 16 19:42:00.155465 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.155420 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 16 19:42:00.158140 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.158120 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 16 19:42:00.161813 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.161052 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 16 19:42:00.171387 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.171335 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:42:00.220266 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220454 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-serving-cert\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.220454 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220327 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-trusted-ca-bundle\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.220454 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-web-config\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220454 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220384 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-oauth-serving-cert\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.220454 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220454 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-config\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220456 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220487 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8tcr\" (UniqueName: \"kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-kube-api-access-w8tcr\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220687 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-config-out\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.220821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.221312 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220884 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.221312 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.221312 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsp75\" (UniqueName: \"kubernetes.io/projected/49a95c18-86f7-48ec-9332-fd659ec956c2-kube-api-access-qsp75\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.221312 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.220979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.221312 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.221008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-console-config\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.221312 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.221040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.221312 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.221080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-oauth-config\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.221312 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.221113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-service-ca\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.221312 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.221137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.221312 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.221166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.221833 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.221786 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-trusted-ca-bundle\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.222350 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.222322 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-oauth-serving-cert\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.223209 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.223185 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-service-ca\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.224621 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.224570 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-console-config\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.225967 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.225941 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-serving-cert\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.226473 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.226429 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-oauth-config\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.230559 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.230505 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsp75\" (UniqueName: \"kubernetes.io/projected/49a95c18-86f7-48ec-9332-fd659ec956c2-kube-api-access-qsp75\") pod \"console-7788465b88-t6g4s\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.321979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.321935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.321979 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.321983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322251 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322251 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322251 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322251 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322251 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322251 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-web-config\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322251 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322250 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-config\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322300 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8tcr\" (UniqueName: \"kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-kube-api-access-w8tcr\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322423 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322472 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-config-out\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.322591 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.323204 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.322992 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.323204 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.323014 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.323204 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.323127 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.323699 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.323572 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.324992 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.323852 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.324992 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.324506 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.327058 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.327005 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-config\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.327802 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.327741 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.327802 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.327743 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.327959 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.327883 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.328185 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.328158 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.328279 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.328229 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.329060 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.328490 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.329060 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.328914 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.329195 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.329173 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.330180 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.330137 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.331049 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.331019 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-config-out\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.331528 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.331481 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8tcr\" (UniqueName: \"kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-kube-api-access-w8tcr\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.331753 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.331701 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-web-config\") pod \"prometheus-k8s-0\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:00.404409 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.404327 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:00.465258 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.465228 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pznnd\"" Sep 16 19:42:00.472593 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:00.472557 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:03.607427 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:03.607394 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6885569d5f-sp6nv"] Sep 16 19:42:03.884138 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:03.883857 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7788465b88-t6g4s"] Sep 16 19:42:03.887977 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:42:03.887948 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a95c18_86f7_48ec_9332_fd659ec956c2.slice/crio-1cc77e22ed3806867330c26ca9d3ccc0ca765d840c00d7734d5e53cbd7164550 WatchSource:0}: Error finding container 1cc77e22ed3806867330c26ca9d3ccc0ca765d840c00d7734d5e53cbd7164550: Status 404 returned error can't find the container with id 1cc77e22ed3806867330c26ca9d3ccc0ca765d840c00d7734d5e53cbd7164550 Sep 16 19:42:03.891991 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:03.891896 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt"] Sep 16 19:42:03.904229 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:03.904198 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:42:03.923183 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:42:03.923133 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12dfd771_8aab_4cfc_894f_2b8c4211fae6.slice/crio-f7e8fcca1a945466c454453c83453b4e3290ccc043bee020841ef0de6a7a1578 WatchSource:0}: Error finding container f7e8fcca1a945466c454453c83453b4e3290ccc043bee020841ef0de6a7a1578: Status 404 returned error can't find the container with id f7e8fcca1a945466c454453c83453b4e3290ccc043bee020841ef0de6a7a1578 Sep 16 19:42:03.932876 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:42:03.932838 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf376fb47_e049_457b_bd20_8f0721c21bd6.slice/crio-2723ec2268a5e472ef09b5fee4babd1a98eb5990a4c91cc8e80a49bbb6cce01d WatchSource:0}: Error finding container 2723ec2268a5e472ef09b5fee4babd1a98eb5990a4c91cc8e80a49bbb6cce01d: Status 404 returned error can't find the container with id 2723ec2268a5e472ef09b5fee4babd1a98eb5990a4c91cc8e80a49bbb6cce01d Sep 16 19:42:04.407359 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.407316 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" event={"ID":"12dfd771-8aab-4cfc-894f-2b8c4211fae6","Type":"ContainerStarted","Data":"f7e8fcca1a945466c454453c83453b4e3290ccc043bee020841ef0de6a7a1578"} Sep 16 19:42:04.411325 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.411091 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" event={"ID":"2eef8531-b2a8-4a97-990c-676f8e647d0c","Type":"ContainerStarted","Data":"ce3795e44d315df4c3adadf628c08cd81104dfcec9e40a577b827b462dd34d86"} Sep 16 19:42:04.411325 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.411177 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" event={"ID":"2eef8531-b2a8-4a97-990c-676f8e647d0c","Type":"ContainerStarted","Data":"1a5a1105153d68143e879a6b12cdff330a66636c2e72aaf97d08c1412115b88d"} Sep 16 19:42:04.411325 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.411215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" event={"ID":"2eef8531-b2a8-4a97-990c-676f8e647d0c","Type":"ContainerStarted","Data":"7ce78b9b297f2b91fbd3f604f6e60d626fe1b184a40c9881053db486d7782b23"} Sep 16 19:42:04.415069 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.414984 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7788465b88-t6g4s" event={"ID":"49a95c18-86f7-48ec-9332-fd659ec956c2","Type":"ContainerStarted","Data":"1cc77e22ed3806867330c26ca9d3ccc0ca765d840c00d7734d5e53cbd7164550"} Sep 16 19:42:04.417660 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.417558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-j6ntv" event={"ID":"dd255aaa-8ad1-4728-941f-fa6a61e0cf46","Type":"ContainerStarted","Data":"4e82abea295b2a0b30189b97e3ce3150b595609870ca225ff24047c12c648f43"} Sep 16 19:42:04.418115 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.418082 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-j6ntv" Sep 16 19:42:04.420258 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.419784 2577 generic.go:356] "Generic (PLEG): container finished" podID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerID="42645ceb823531cef522d9b3f503b80bf116165f578729607cc43de851f7751e" exitCode=0 Sep 16 19:42:04.420258 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.419867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerDied","Data":"42645ceb823531cef522d9b3f503b80bf116165f578729607cc43de851f7751e"} Sep 16 19:42:04.423119 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.423073 2577 generic.go:356] "Generic (PLEG): container finished" podID="8126e1a6-d411-4f96-83a9-6f29d1b96672" containerID="408b09b774e185b02d42562299b0a65b2ebf1336580d501ca29b2368f8458e63" exitCode=0 Sep 16 19:42:04.423236 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.423151 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-njc96" event={"ID":"8126e1a6-d411-4f96-83a9-6f29d1b96672","Type":"ContainerDied","Data":"408b09b774e185b02d42562299b0a65b2ebf1336580d501ca29b2368f8458e63"} Sep 16 19:42:04.425566 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.425442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" event={"ID":"76c1825a-9987-46c5-98fb-63e6dbed7028","Type":"ContainerStarted","Data":"9810f621343b5340c873a735d6488f13fa9678bc66d2af9b7016bbbd289c21c7"} Sep 16 19:42:04.428924 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.428888 2577 generic.go:356] "Generic (PLEG): container finished" podID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerID="1a621811a6b2f05fd02fb14f7794625bdc50703ab9338cfbb39f770957b14b06" exitCode=0 Sep 16 19:42:04.429088 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.428937 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerDied","Data":"1a621811a6b2f05fd02fb14f7794625bdc50703ab9338cfbb39f770957b14b06"} Sep 16 19:42:04.429088 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.429008 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerStarted","Data":"2723ec2268a5e472ef09b5fee4babd1a98eb5990a4c91cc8e80a49bbb6cce01d"} Sep 16 19:42:04.434290 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.434264 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-j6ntv" Sep 16 19:42:04.461354 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.461274 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-59g5b" podStartSLOduration=2.205308082 podStartE2EDuration="11.461244392s" totalImagesPullingTime="9.25593631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:42:04.433494738 +0000 UTC m=+184.365453771" watchObservedRunningTime="2026-09-16 19:42:04.461244392 +0000 UTC m=+184.393203415" Sep 16 19:42:04.461523 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:04.461458 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-j6ntv" podStartSLOduration=1.851195872 podStartE2EDuration="19.461447136s" totalImagesPullingTime="17.610251264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:42:04.453360157 +0000 UTC m=+184.385319179" watchObservedRunningTime="2026-09-16 19:42:04.461447136 +0000 UTC m=+184.393406159" Sep 16 19:42:05.446230 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:05.445589 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-njc96" event={"ID":"8126e1a6-d411-4f96-83a9-6f29d1b96672","Type":"ContainerStarted","Data":"b8f4c40471f7b9355bef799693a28ba2ec63f3be0ec183fb76678ebc084696d5"} Sep 16 19:42:05.446230 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:05.445713 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-njc96" event={"ID":"8126e1a6-d411-4f96-83a9-6f29d1b96672","Type":"ContainerStarted","Data":"7fdd6dbfc780b6cc424ace19163d92b21d446cfa71f36e27ee26e8fd97612549"} Sep 16 19:42:05.473243 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:05.471746 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-njc96" podStartSLOduration=3.442238289 podStartE2EDuration="12.471721022s" totalImagesPullingTime="8.923470936s" totalInitContainerRuntime="106.011797ms" isStatefulPod=true podCreationTimestamp="2026-09-16 19:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:42:05.46951264 +0000 UTC m=+185.401471663" watchObservedRunningTime="2026-09-16 19:42:05.471721022 +0000 UTC m=+185.403680044" Sep 16 19:42:12.493048 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:12.487130 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" event={"ID":"12dfd771-8aab-4cfc-894f-2b8c4211fae6","Type":"ContainerStarted","Data":"ed66e2b46023122c835faa4fbac253bfe91f11a9c8dc72ec6a4f0362e5660434"} Sep 16 19:42:12.495947 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:12.495787 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" Sep 16 19:42:12.497487 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:12.497455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7788465b88-t6g4s" event={"ID":"49a95c18-86f7-48ec-9332-fd659ec956c2","Type":"ContainerStarted","Data":"1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311"} Sep 16 19:42:12.503327 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:12.503204 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerStarted","Data":"96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2"} Sep 16 19:42:12.503327 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:12.503278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerStarted","Data":"5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87"} Sep 16 19:42:12.504460 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:12.504409 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" Sep 16 19:42:12.507985 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:12.507852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" event={"ID":"76c1825a-9987-46c5-98fb-63e6dbed7028","Type":"ContainerStarted","Data":"6dc73f298acba31e2cacf1569180e87a710e14280754873b40c0607bafd3631b"} Sep 16 19:42:12.507985 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:12.507919 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" event={"ID":"76c1825a-9987-46c5-98fb-63e6dbed7028","Type":"ContainerStarted","Data":"5e6c9b5ef267653af80309f3e62899e09558be91d67b9816b3ffa3a546ad5f7d"} Sep 16 19:42:12.511501 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:12.511465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerStarted","Data":"bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4"} Sep 16 19:42:12.518248 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:12.518152 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nvhgt" podStartSLOduration=6.499427504 podStartE2EDuration="14.518064163s" totalImagesPullingTime="8.018636659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:42:12.516014389 +0000 UTC m=+192.447973405" watchObservedRunningTime="2026-09-16 19:42:12.518064163 +0000 UTC m=+192.450023187" Sep 16 19:42:12.563298 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:12.562647 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7788465b88-t6g4s" podStartSLOduration=4.500811213 podStartE2EDuration="12.56262199s" totalImagesPullingTime="8.061810777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:42:12.540112771 +0000 UTC m=+192.472071794" watchObservedRunningTime="2026-09-16 19:42:12.56262199 +0000 UTC m=+192.494581004" Sep 16 19:42:13.522186 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:13.522142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerStarted","Data":"27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12"} Sep 16 19:42:13.522770 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:13.522248 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerStarted","Data":"ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623"} Sep 16 19:42:13.522770 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:13.522297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerStarted","Data":"01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66"} Sep 16 19:42:13.525134 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:13.525099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" event={"ID":"76c1825a-9987-46c5-98fb-63e6dbed7028","Type":"ContainerStarted","Data":"7870d30b495399ea8d46344ade0e34795c14f8fa0ee5c48e4cd222babb955974"} Sep 16 19:42:13.529285 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:13.529255 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerStarted","Data":"5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9"} Sep 16 19:42:13.529437 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:13.529326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerStarted","Data":"a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb"} Sep 16 19:42:13.529437 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:13.529368 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerStarted","Data":"1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5"} Sep 16 19:42:13.529437 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:13.529405 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerStarted","Data":"3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0"} Sep 16 19:42:13.529595 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:13.529443 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerStarted","Data":"b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d"} Sep 16 19:42:13.563431 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:13.563372 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.668817327 podStartE2EDuration="13.56335314s" totalImagesPullingTime="7.87055516s" totalInitContainerRuntime="23.980653ms" isStatefulPod=false podCreationTimestamp="2026-09-16 19:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:42:13.561884507 +0000 UTC m=+193.493843567" watchObservedRunningTime="2026-09-16 19:42:13.56335314 +0000 UTC m=+193.495312163" Sep 16 19:42:14.537578 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:14.537469 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerStarted","Data":"16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4"} Sep 16 19:42:14.540240 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:14.540208 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" event={"ID":"76c1825a-9987-46c5-98fb-63e6dbed7028","Type":"ContainerStarted","Data":"0d8c555e555d3f5e6adaa859319520314ebbd0cdfa8521b04a1f3407642ff177"} Sep 16 19:42:14.579373 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:14.579317 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.15825301 podStartE2EDuration="20.57929897s" totalImagesPullingTime="17.391661525s" totalInitContainerRuntime="29.384435ms" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:42:14.578678347 +0000 UTC m=+194.510637371" watchObservedRunningTime="2026-09-16 19:42:14.57929897 +0000 UTC m=+194.511257991" Sep 16 19:42:15.473439 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:15.473400 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:42:15.549863 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:15.549820 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" event={"ID":"76c1825a-9987-46c5-98fb-63e6dbed7028","Type":"ContainerStarted","Data":"ec24705cac7c7de692d87ce89f5922da3efed7309506046ac2366980c4913b53"} Sep 16 19:42:15.550292 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:15.549910 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" event={"ID":"76c1825a-9987-46c5-98fb-63e6dbed7028","Type":"ContainerStarted","Data":"877c6d71d44a30c7796776a4dc20a32ea2de137747e74970a3f5022a3f60f2a2"} Sep 16 19:42:15.550539 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:15.550521 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:42:15.579492 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:15.578593 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" podStartSLOduration=9.504453655 podStartE2EDuration="19.578569757s" totalImagesPullingTime="10.074116102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:41:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:42:15.57692257 +0000 UTC m=+195.508881592" watchObservedRunningTime="2026-09-16 19:42:15.578569757 +0000 UTC m=+195.510528780" Sep 16 19:42:17.566083 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:17.566057 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6885569d5f-sp6nv" Sep 16 19:42:20.405292 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:20.405243 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:20.405752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:20.405326 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:20.410452 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:20.410427 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:42:20.576370 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:42:20.576332 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:43:00.473215 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:00.473174 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:00.489325 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:00.489298 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:00.762983 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:00.762952 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:11.533699 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:11.533654 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:43:11.536094 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:11.536063 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d59f8428-b82a-4081-aca2-8a277b37066c-metrics-certs\") pod \"network-metrics-daemon-z9szj\" (UID: \"d59f8428-b82a-4081-aca2-8a277b37066c\") " pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:43:11.805839 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:11.805742 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pq7mv\"" Sep 16 19:43:11.813204 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:11.813171 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9szj" Sep 16 19:43:12.085873 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:12.085846 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z9szj"] Sep 16 19:43:12.088581 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:43:12.088553 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd59f8428_b82a_4081_aca2_8a277b37066c.slice/crio-0b26b474f92b271f9e6a5c53990e8a17b0c91644cbbee194aec8d8d3507fd858 WatchSource:0}: Error finding container 0b26b474f92b271f9e6a5c53990e8a17b0c91644cbbee194aec8d8d3507fd858: Status 404 returned error can't find the container with id 0b26b474f92b271f9e6a5c53990e8a17b0c91644cbbee194aec8d8d3507fd858 Sep 16 19:43:12.801114 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:12.801067 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z9szj" event={"ID":"d59f8428-b82a-4081-aca2-8a277b37066c","Type":"ContainerStarted","Data":"0b26b474f92b271f9e6a5c53990e8a17b0c91644cbbee194aec8d8d3507fd858"} Sep 16 19:43:13.807285 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:13.807245 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z9szj" event={"ID":"d59f8428-b82a-4081-aca2-8a277b37066c","Type":"ContainerStarted","Data":"d74e46759066687ec2c5b70d2b3e1dcb1b8b8ec015dd40915da89447850cc20d"} Sep 16 19:43:13.807701 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:13.807304 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z9szj" event={"ID":"d59f8428-b82a-4081-aca2-8a277b37066c","Type":"ContainerStarted","Data":"5b5de71ab5b0426e3f3516b4697595385221d1deb1c7a40a078c81ca7e756333"} Sep 16 19:43:13.832432 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:13.832377 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z9szj" podStartSLOduration=251.980570996 podStartE2EDuration="4m12.832359445s" totalImagesPullingTime="851.788449ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 19:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:43:13.831016027 +0000 UTC m=+253.762975052" watchObservedRunningTime="2026-09-16 19:43:13.832359445 +0000 UTC m=+253.764318467" Sep 16 19:43:14.168390 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.168300 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 19:43:14.168660 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.168629 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="alertmanager" containerID="cri-o://5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87" gracePeriod=120 Sep 16 19:43:14.168721 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.168665 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy-metric" containerID="cri-o://27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12" gracePeriod=120 Sep 16 19:43:14.168781 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.168724 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy-web" containerID="cri-o://01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66" gracePeriod=120 Sep 16 19:43:14.168781 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.168724 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="prom-label-proxy" containerID="cri-o://16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4" gracePeriod=120 Sep 16 19:43:14.168879 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.168766 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy" containerID="cri-o://ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623" gracePeriod=120 Sep 16 19:43:14.168879 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.168774 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="config-reloader" containerID="cri-o://96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2" gracePeriod=120 Sep 16 19:43:14.820984 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.820946 2577 generic.go:356] "Generic (PLEG): container finished" podID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerID="16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4" exitCode=0 Sep 16 19:43:14.820984 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.820978 2577 generic.go:356] "Generic (PLEG): container finished" podID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerID="27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12" exitCode=0 Sep 16 19:43:14.820984 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.820986 2577 generic.go:356] "Generic (PLEG): container finished" podID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerID="ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623" exitCode=0 Sep 16 19:43:14.820984 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.820992 2577 generic.go:356] "Generic (PLEG): container finished" podID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerID="96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2" exitCode=0 Sep 16 19:43:14.820984 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.820998 2577 generic.go:356] "Generic (PLEG): container finished" podID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerID="5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87" exitCode=0 Sep 16 19:43:14.821503 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.821020 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerDied","Data":"16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4"} Sep 16 19:43:14.821503 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.821113 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerDied","Data":"27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12"} Sep 16 19:43:14.821503 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.821141 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerDied","Data":"ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623"} Sep 16 19:43:14.821503 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.821166 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerDied","Data":"96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2"} Sep 16 19:43:14.821503 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:14.821191 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerDied","Data":"5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87"} Sep 16 19:43:15.426728 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.426701 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:43:15.471897 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.471865 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.471897 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.471904 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-main-db\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472161 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.471942 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-volume\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472161 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.471969 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-web\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472161 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.471997 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-out\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472161 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.472022 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-trusted-ca-bundle\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472161 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.472050 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-metrics-client-ca\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472161 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.472089 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472161 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.472120 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-tls-assets\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472161 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.472158 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-web-config\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472652 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.472203 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm4m6\" (UniqueName: \"kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-kube-api-access-sm4m6\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472652 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.472252 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-cluster-tls-config\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472652 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.472302 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-main-tls\") pod \"e18fdab3-5b27-41ce-8693-e8392ae8f487\" (UID: \"e18fdab3-5b27-41ce-8693-e8392ae8f487\") " Sep 16 19:43:15.472652 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.472300 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 19:43:15.472652 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.472557 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-main-db\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.472911 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.472708 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:15.474322 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.473013 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:15.474936 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.474896 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:15.475334 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.475289 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:43:15.476054 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.476016 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-kube-api-access-sm4m6" (OuterVolumeSpecName: "kube-api-access-sm4m6") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "kube-api-access-sm4m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:43:15.478965 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.478926 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:15.479092 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.479014 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:15.479092 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.479066 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-volume" (OuterVolumeSpecName: "config-volume") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:15.479233 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.479198 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:15.479701 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.479659 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-out" (OuterVolumeSpecName: "config-out") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 19:43:15.483937 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.483854 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:15.493358 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.493317 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-web-config" (OuterVolumeSpecName: "web-config") pod "e18fdab3-5b27-41ce-8693-e8392ae8f487" (UID: "e18fdab3-5b27-41ce-8693-e8392ae8f487"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:15.573828 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573789 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.573828 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573825 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-volume\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.573828 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573835 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.574072 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573845 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e18fdab3-5b27-41ce-8693-e8392ae8f487-config-out\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.574072 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573854 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.574072 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573865 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e18fdab3-5b27-41ce-8693-e8392ae8f487-metrics-client-ca\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.574072 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573877 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.574072 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573889 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-tls-assets\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.574072 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573901 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-web-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.574072 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573909 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm4m6\" (UniqueName: \"kubernetes.io/projected/e18fdab3-5b27-41ce-8693-e8392ae8f487-kube-api-access-sm4m6\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.574072 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573917 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-cluster-tls-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.574072 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.573926 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e18fdab3-5b27-41ce-8693-e8392ae8f487-secret-alertmanager-main-tls\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:15.828479 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.828438 2577 generic.go:356] "Generic (PLEG): container finished" podID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerID="01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66" exitCode=0 Sep 16 19:43:15.828963 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.828520 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerDied","Data":"01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66"} Sep 16 19:43:15.828963 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.828534 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 19:43:15.828963 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.828590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e18fdab3-5b27-41ce-8693-e8392ae8f487","Type":"ContainerDied","Data":"ded0aafcd035d8f4e1a54bf52eeeb1dfb732d3abcd3c41099f4d312991924db8"} Sep 16 19:43:15.828963 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.828633 2577 scope.go:117] "RemoveContainer" containerID="16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4" Sep 16 19:43:15.837941 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.837920 2577 scope.go:117] "RemoveContainer" containerID="27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12" Sep 16 19:43:15.846168 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.846148 2577 scope.go:117] "RemoveContainer" containerID="ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623" Sep 16 19:43:15.851596 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.851565 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 19:43:15.854703 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.854676 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 19:43:15.855652 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.855631 2577 scope.go:117] "RemoveContainer" containerID="01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66" Sep 16 19:43:15.863682 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.863662 2577 scope.go:117] "RemoveContainer" containerID="96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2" Sep 16 19:43:15.871669 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.871598 2577 scope.go:117] "RemoveContainer" containerID="5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87" Sep 16 19:43:15.880389 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.880365 2577 scope.go:117] "RemoveContainer" containerID="42645ceb823531cef522d9b3f503b80bf116165f578729607cc43de851f7751e" Sep 16 19:43:15.889015 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.888993 2577 scope.go:117] "RemoveContainer" containerID="16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4" Sep 16 19:43:15.889406 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:15.889382 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4\": container with ID starting with 16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4 not found: ID does not exist" containerID="16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4" Sep 16 19:43:15.889500 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.889416 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4"} err="failed to get container status \"16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4\": rpc error: code = NotFound desc = could not find container \"16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4\": container with ID starting with 16fd029ea8bb4296652857b808b5fca07368913ff9a06014fd62185ef49911a4 not found: ID does not exist" Sep 16 19:43:15.889500 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.889459 2577 scope.go:117] "RemoveContainer" containerID="27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12" Sep 16 19:43:15.889820 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:15.889793 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12\": container with ID starting with 27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12 not found: ID does not exist" containerID="27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12" Sep 16 19:43:15.889950 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.889825 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12"} err="failed to get container status \"27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12\": rpc error: code = NotFound desc = could not find container \"27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12\": container with ID starting with 27f21f7117a5304f671f392cda926b80cab9aa7a6c568227eee11545b299fa12 not found: ID does not exist" Sep 16 19:43:15.889950 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.889854 2577 scope.go:117] "RemoveContainer" containerID="ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623" Sep 16 19:43:15.890187 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:15.890156 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623\": container with ID starting with ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623 not found: ID does not exist" containerID="ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623" Sep 16 19:43:15.890270 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.890189 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623"} err="failed to get container status \"ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623\": rpc error: code = NotFound desc = could not find container \"ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623\": container with ID starting with ea288a0db0daf5287f6e13cdf9fee67950aa29733e011aef8b40eae4659d4623 not found: ID does not exist" Sep 16 19:43:15.890270 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.890202 2577 scope.go:117] "RemoveContainer" containerID="01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66" Sep 16 19:43:15.890537 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:15.890518 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66\": container with ID starting with 01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66 not found: ID does not exist" containerID="01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66" Sep 16 19:43:15.890582 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.890543 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66"} err="failed to get container status \"01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66\": rpc error: code = NotFound desc = could not find container \"01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66\": container with ID starting with 01bffc01e6aeb3e9e79538e732d5edb55ff8c4102323bd725153f30bc00dcf66 not found: ID does not exist" Sep 16 19:43:15.890582 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.890557 2577 scope.go:117] "RemoveContainer" containerID="96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2" Sep 16 19:43:15.890932 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:15.890906 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2\": container with ID starting with 96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2 not found: ID does not exist" containerID="96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2" Sep 16 19:43:15.891024 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.890936 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2"} err="failed to get container status \"96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2\": rpc error: code = NotFound desc = could not find container \"96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2\": container with ID starting with 96069638e32491332cda05574711865c379af2855cba4476922beebe7ca1bac2 not found: ID does not exist" Sep 16 19:43:15.891024 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.890965 2577 scope.go:117] "RemoveContainer" containerID="5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87" Sep 16 19:43:15.891232 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:15.891211 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87\": container with ID starting with 5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87 not found: ID does not exist" containerID="5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87" Sep 16 19:43:15.891277 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.891238 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87"} err="failed to get container status \"5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87\": rpc error: code = NotFound desc = could not find container \"5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87\": container with ID starting with 5828c26c1a92516f652a61c2b7b230e2f51539989be96849020c92d4fbae1f87 not found: ID does not exist" Sep 16 19:43:15.891277 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.891258 2577 scope.go:117] "RemoveContainer" containerID="42645ceb823531cef522d9b3f503b80bf116165f578729607cc43de851f7751e" Sep 16 19:43:15.891532 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:15.891515 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42645ceb823531cef522d9b3f503b80bf116165f578729607cc43de851f7751e\": container with ID starting with 42645ceb823531cef522d9b3f503b80bf116165f578729607cc43de851f7751e not found: ID does not exist" containerID="42645ceb823531cef522d9b3f503b80bf116165f578729607cc43de851f7751e" Sep 16 19:43:15.891630 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:15.891538 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42645ceb823531cef522d9b3f503b80bf116165f578729607cc43de851f7751e"} err="failed to get container status \"42645ceb823531cef522d9b3f503b80bf116165f578729607cc43de851f7751e\": rpc error: code = NotFound desc = could not find container \"42645ceb823531cef522d9b3f503b80bf116165f578729607cc43de851f7751e\": container with ID starting with 42645ceb823531cef522d9b3f503b80bf116165f578729607cc43de851f7751e not found: ID does not exist" Sep 16 19:43:16.607630 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:16.607584 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" path="/var/lib/kubelet/pods/e18fdab3-5b27-41ce-8693-e8392ae8f487/volumes" Sep 16 19:43:18.509821 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.509774 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:43:18.510878 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.510840 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="prometheus" containerID="cri-o://bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4" gracePeriod=600 Sep 16 19:43:18.511827 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.511538 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="thanos-sidecar" containerID="cri-o://3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0" gracePeriod=600 Sep 16 19:43:18.511827 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.511656 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy" containerID="cri-o://a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb" gracePeriod=600 Sep 16 19:43:18.511827 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.511792 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="config-reloader" containerID="cri-o://b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d" gracePeriod=600 Sep 16 19:43:18.512002 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.511797 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy-web" containerID="cri-o://1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5" gracePeriod=600 Sep 16 19:43:18.512150 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.511461 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9" gracePeriod=600 Sep 16 19:43:18.846736 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.846650 2577 generic.go:356] "Generic (PLEG): container finished" podID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerID="5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9" exitCode=0 Sep 16 19:43:18.846736 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.846676 2577 generic.go:356] "Generic (PLEG): container finished" podID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerID="a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb" exitCode=0 Sep 16 19:43:18.846736 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.846683 2577 generic.go:356] "Generic (PLEG): container finished" podID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerID="3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0" exitCode=0 Sep 16 19:43:18.846736 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.846688 2577 generic.go:356] "Generic (PLEG): container finished" podID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerID="b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d" exitCode=0 Sep 16 19:43:18.846736 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.846693 2577 generic.go:356] "Generic (PLEG): container finished" podID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerID="bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4" exitCode=0 Sep 16 19:43:18.846736 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.846714 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerDied","Data":"5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9"} Sep 16 19:43:18.847055 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.846788 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerDied","Data":"a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb"} Sep 16 19:43:18.847055 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.846815 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerDied","Data":"3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0"} Sep 16 19:43:18.847055 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.846839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerDied","Data":"b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d"} Sep 16 19:43:18.847055 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:18.846862 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerDied","Data":"bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4"} Sep 16 19:43:19.769199 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.769163 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:19.811389 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811358 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8tcr\" (UniqueName: \"kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-kube-api-access-w8tcr\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.811590 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811401 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-0\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.811590 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811434 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-tls\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.811590 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811461 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-grpc-tls\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.811784 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811653 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-tls-assets\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.811784 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811707 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-config\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.811784 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811736 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-thanos-prometheus-http-client-file\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.811930 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811798 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-kube-rbac-proxy\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.811930 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811821 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-2\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.811930 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811846 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-db\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.811930 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811878 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-1\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.811930 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811913 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-trusted-ca-bundle\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.812157 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811965 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-web-config\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.812157 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.811995 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-metrics-client-certs\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.812157 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.812034 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-serving-certs-ca-bundle\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.812544 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.812390 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:19.813022 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.812821 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:19.813740 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.813191 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:19.813740 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.813491 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:19.813740 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.813541 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-kubelet-serving-ca-bundle\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.813740 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.813585 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.813740 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.813632 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-metrics-client-ca\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.813740 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.813664 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.813740 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.813694 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-config-out\") pod \"f376fb47-e049-457b-bd20-8f0721c21bd6\" (UID: \"f376fb47-e049-457b-bd20-8f0721c21bd6\") " Sep 16 19:43:19.814171 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.813995 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.814171 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.814018 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.814171 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.814035 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.814171 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.814052 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.815095 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.815066 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 19:43:19.816230 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.816200 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:19.816230 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.816180 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:19.816428 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.816404 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:19.818976 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.818936 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:19.819323 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.819283 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:19.819732 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.819691 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:19.820224 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.819264 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:19.820367 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.820352 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-config-out" (OuterVolumeSpecName: "config-out") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 19:43:19.820521 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.820480 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-kube-api-access-w8tcr" (OuterVolumeSpecName: "kube-api-access-w8tcr") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "kube-api-access-w8tcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:43:19.820521 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.820469 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:19.820704 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.820541 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:43:19.821053 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.820935 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:19.821053 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.821009 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-config" (OuterVolumeSpecName: "config") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:19.822545 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.822510 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:19.832859 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.832814 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-web-config" (OuterVolumeSpecName: "web-config") pod "f376fb47-e049-457b-bd20-8f0721c21bd6" (UID: "f376fb47-e049-457b-bd20-8f0721c21bd6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:19.854068 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.853986 2577 generic.go:356] "Generic (PLEG): container finished" podID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerID="1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5" exitCode=0 Sep 16 19:43:19.854068 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.854062 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerDied","Data":"1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5"} Sep 16 19:43:19.854244 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.854086 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:19.854244 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.854127 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f376fb47-e049-457b-bd20-8f0721c21bd6","Type":"ContainerDied","Data":"2723ec2268a5e472ef09b5fee4babd1a98eb5990a4c91cc8e80a49bbb6cce01d"} Sep 16 19:43:19.854244 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.854161 2577 scope.go:117] "RemoveContainer" containerID="5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9" Sep 16 19:43:19.863784 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.863762 2577 scope.go:117] "RemoveContainer" containerID="a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb" Sep 16 19:43:19.872695 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.872675 2577 scope.go:117] "RemoveContainer" containerID="1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5" Sep 16 19:43:19.878372 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.878347 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:43:19.881851 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.881831 2577 scope.go:117] "RemoveContainer" containerID="3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0" Sep 16 19:43:19.882795 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.882774 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:43:19.889414 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.889394 2577 scope.go:117] "RemoveContainer" containerID="b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d" Sep 16 19:43:19.897046 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.897024 2577 scope.go:117] "RemoveContainer" containerID="bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4" Sep 16 19:43:19.905530 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.905386 2577 scope.go:117] "RemoveContainer" containerID="1a621811a6b2f05fd02fb14f7794625bdc50703ab9338cfbb39f770957b14b06" Sep 16 19:43:19.906931 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.906911 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:43:19.907267 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907251 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy-web" Sep 16 19:43:19.907337 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907270 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy-web" Sep 16 19:43:19.907337 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907282 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy" Sep 16 19:43:19.907337 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907291 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy" Sep 16 19:43:19.907337 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907300 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="prom-label-proxy" Sep 16 19:43:19.907337 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907308 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="prom-label-proxy" Sep 16 19:43:19.907337 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907320 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="alertmanager" Sep 16 19:43:19.907337 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907329 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="alertmanager" Sep 16 19:43:19.907337 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907338 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy-web" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907346 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy-web" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907358 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy-thanos" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907367 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy-thanos" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907385 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="config-reloader" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907393 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="config-reloader" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907403 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="thanos-sidecar" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907411 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="thanos-sidecar" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907424 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="prometheus" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907433 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="prometheus" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907447 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="config-reloader" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907456 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="config-reloader" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907464 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy-metric" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907472 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy-metric" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907484 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="init-config-reloader" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907493 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="init-config-reloader" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907510 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="init-config-reloader" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907519 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="init-config-reloader" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907529 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907538 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907634 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy-web" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907649 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy-web" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907658 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy-thanos" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907670 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="thanos-sidecar" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907681 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907690 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="kube-rbac-proxy-metric" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907698 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="config-reloader" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907707 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="kube-rbac-proxy" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907715 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="alertmanager" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907725 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" containerName="prometheus" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907733 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="prom-label-proxy" Sep 16 19:43:19.907752 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.907741 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18fdab3-5b27-41ce-8693-e8392ae8f487" containerName="config-reloader" Sep 16 19:43:19.913404 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.913376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:19.913728 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.913706 2577 scope.go:117] "RemoveContainer" containerID="5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9" Sep 16 19:43:19.914154 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:19.914106 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9\": container with ID starting with 5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9 not found: ID does not exist" containerID="5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9" Sep 16 19:43:19.914250 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914163 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9"} err="failed to get container status \"5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9\": rpc error: code = NotFound desc = could not find container \"5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9\": container with ID starting with 5e48c4ab8f27dade5f59d4ee44667723bd9bae3f65a99536fd7590ec21a684f9 not found: ID does not exist" Sep 16 19:43:19.914250 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914197 2577 scope.go:117] "RemoveContainer" containerID="a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb" Sep 16 19:43:19.914452 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914432 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-web-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914509 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914456 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-metrics-client-certs\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914509 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914466 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914509 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914477 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914509 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914490 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-configmap-metrics-client-ca\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914509 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914502 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:19.914505 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb\": container with ID starting with a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb not found: ID does not exist" containerID="a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914516 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-config-out\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914530 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8tcr\" (UniqueName: \"kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-kube-api-access-w8tcr\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914530 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb"} err="failed to get container status \"a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb\": rpc error: code = NotFound desc = could not find container \"a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb\": container with ID starting with a898c30163610840c5c4f4fa407fae6e9910560dd9927364078a4fe49d8ad9cb not found: ID does not exist" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914540 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914547 2577 scope.go:117] "RemoveContainer" containerID="1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914553 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-grpc-tls\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914561 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f376fb47-e049-457b-bd20-8f0721c21bd6-tls-assets\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914568 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914575 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914583 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f376fb47-e049-457b-bd20-8f0721c21bd6-secret-kube-rbac-proxy\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914592 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.914713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914599 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f376fb47-e049-457b-bd20-8f0721c21bd6-prometheus-k8s-db\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:19.915222 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:19.914817 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5\": container with ID starting with 1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5 not found: ID does not exist" containerID="1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5" Sep 16 19:43:19.915222 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914842 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5"} err="failed to get container status \"1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5\": rpc error: code = NotFound desc = could not find container \"1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5\": container with ID starting with 1d2b79677efaf5e193e887d027fcd762558affb28cd15cba37696495f67310e5 not found: ID does not exist" Sep 16 19:43:19.915222 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.914860 2577 scope.go:117] "RemoveContainer" containerID="3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0" Sep 16 19:43:19.915222 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:19.915117 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0\": container with ID starting with 3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0 not found: ID does not exist" containerID="3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0" Sep 16 19:43:19.915222 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.915131 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0"} err="failed to get container status \"3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0\": rpc error: code = NotFound desc = could not find container \"3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0\": container with ID starting with 3816d22bf43416cf3f93a41bf476724c578bb03d3dc8283d17ceb87d30758cc0 not found: ID does not exist" Sep 16 19:43:19.915222 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.915142 2577 scope.go:117] "RemoveContainer" containerID="b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d" Sep 16 19:43:19.915493 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:19.915348 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d\": container with ID starting with b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d not found: ID does not exist" containerID="b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d" Sep 16 19:43:19.915493 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.915368 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d"} err="failed to get container status \"b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d\": rpc error: code = NotFound desc = could not find container \"b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d\": container with ID starting with b2262c9b0a25bb4ba91464c4f9f9fd0c15dde226e18b158377dae85db673ce1d not found: ID does not exist" Sep 16 19:43:19.915493 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.915401 2577 scope.go:117] "RemoveContainer" containerID="bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4" Sep 16 19:43:19.915663 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:19.915622 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4\": container with ID starting with bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4 not found: ID does not exist" containerID="bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4" Sep 16 19:43:19.915663 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.915643 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4"} err="failed to get container status \"bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4\": rpc error: code = NotFound desc = could not find container \"bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4\": container with ID starting with bde6874b0c08db8461fcd38a6724f611006869361f07a06ffc36ba20dc2a83e4 not found: ID does not exist" Sep 16 19:43:19.915663 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.915656 2577 scope.go:117] "RemoveContainer" containerID="1a621811a6b2f05fd02fb14f7794625bdc50703ab9338cfbb39f770957b14b06" Sep 16 19:43:19.915878 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:19.915853 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a621811a6b2f05fd02fb14f7794625bdc50703ab9338cfbb39f770957b14b06\": container with ID starting with 1a621811a6b2f05fd02fb14f7794625bdc50703ab9338cfbb39f770957b14b06 not found: ID does not exist" containerID="1a621811a6b2f05fd02fb14f7794625bdc50703ab9338cfbb39f770957b14b06" Sep 16 19:43:19.915977 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.915883 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a621811a6b2f05fd02fb14f7794625bdc50703ab9338cfbb39f770957b14b06"} err="failed to get container status \"1a621811a6b2f05fd02fb14f7794625bdc50703ab9338cfbb39f770957b14b06\": rpc error: code = NotFound desc = could not find container \"1a621811a6b2f05fd02fb14f7794625bdc50703ab9338cfbb39f770957b14b06\": container with ID starting with 1a621811a6b2f05fd02fb14f7794625bdc50703ab9338cfbb39f770957b14b06 not found: ID does not exist" Sep 16 19:43:19.916115 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.916100 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 16 19:43:19.916239 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.916225 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 16 19:43:19.916272 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.916225 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 16 19:43:19.916665 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.916590 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 16 19:43:19.916811 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.916793 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 16 19:43:19.917548 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.917337 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 16 19:43:19.917548 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.917408 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 16 19:43:19.917548 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.917408 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 16 19:43:19.917548 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.917453 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 16 19:43:19.917548 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.917413 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pznnd\"" Sep 16 19:43:19.917548 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.917491 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 16 19:43:19.917548 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.917556 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 16 19:43:19.918041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.917599 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8g815iqubek7e\"" Sep 16 19:43:19.918041 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.918045 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 16 19:43:19.918214 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.918045 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 16 19:43:19.919936 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.919917 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 16 19:43:19.924180 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.924160 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 16 19:43:19.929231 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:19.929197 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:43:20.015946 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.015907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.015946 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.015947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016211 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.015968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016211 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016028 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016211 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016094 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016211 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016123 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016211 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016190 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2234a757-ecee-4e05-9f6b-df8fdf979e51-config-out\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-web-config\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016264 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv8gg\" (UniqueName: \"kubernetes.io/projected/2234a757-ecee-4e05-9f6b-df8fdf979e51-kube-api-access-fv8gg\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-config\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016354 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2234a757-ecee-4e05-9f6b-df8fdf979e51-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016444 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016729 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016729 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016729 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016729 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.016729 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.016566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.117437 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.117437 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.117437 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.117699 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.117699 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.117699 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.117699 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117680 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.117950 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.117950 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117863 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.117950 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2234a757-ecee-4e05-9f6b-df8fdf979e51-config-out\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.117950 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118148 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-web-config\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118148 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.117992 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118148 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.118032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv8gg\" (UniqueName: \"kubernetes.io/projected/2234a757-ecee-4e05-9f6b-df8fdf979e51-kube-api-access-fv8gg\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118148 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.118057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-config\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118148 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.118081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118148 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.118107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2234a757-ecee-4e05-9f6b-df8fdf979e51-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118148 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.118132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118467 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.118164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118467 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.118189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118467 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.118213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118467 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.118257 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.118467 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.118289 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.119018 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.118985 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.120400 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.120370 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2234a757-ecee-4e05-9f6b-df8fdf979e51-config-out\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.120695 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.120584 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.120695 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.120626 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.120695 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.120674 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.120909 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.120777 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2234a757-ecee-4e05-9f6b-df8fdf979e51-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.121721 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.121387 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.121721 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.121486 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.121893 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.121764 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.121951 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.121917 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2234a757-ecee-4e05-9f6b-df8fdf979e51-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.122105 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.122083 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-config\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.123075 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.123046 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-web-config\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.123171 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.123123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.123494 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.123473 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.123562 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.123506 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.123562 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.123552 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2234a757-ecee-4e05-9f6b-df8fdf979e51-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.129261 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.129238 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv8gg\" (UniqueName: \"kubernetes.io/projected/2234a757-ecee-4e05-9f6b-df8fdf979e51-kube-api-access-fv8gg\") pod \"prometheus-k8s-0\" (UID: \"2234a757-ecee-4e05-9f6b-df8fdf979e51\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.224198 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.224152 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:20.508808 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.508765 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 19:43:20.511626 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:43:20.511580 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2234a757_ecee_4e05_9f6b_df8fdf979e51.slice/crio-0f2be3375c7a7b696fe1c998e439552fa4a28bb8cfede0c040f562c473a60583 WatchSource:0}: Error finding container 0f2be3375c7a7b696fe1c998e439552fa4a28bb8cfede0c040f562c473a60583: Status 404 returned error can't find the container with id 0f2be3375c7a7b696fe1c998e439552fa4a28bb8cfede0c040f562c473a60583 Sep 16 19:43:20.612844 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.612811 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f376fb47-e049-457b-bd20-8f0721c21bd6" path="/var/lib/kubelet/pods/f376fb47-e049-457b-bd20-8f0721c21bd6/volumes" Sep 16 19:43:20.860244 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.860151 2577 generic.go:356] "Generic (PLEG): container finished" podID="2234a757-ecee-4e05-9f6b-df8fdf979e51" containerID="d43f308dd5bb9c6075aeab2b3feb2e9ab1a9d631513c8ad4008d29e816e86193" exitCode=0 Sep 16 19:43:20.860663 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.860242 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2234a757-ecee-4e05-9f6b-df8fdf979e51","Type":"ContainerDied","Data":"d43f308dd5bb9c6075aeab2b3feb2e9ab1a9d631513c8ad4008d29e816e86193"} Sep 16 19:43:20.860663 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:20.860321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2234a757-ecee-4e05-9f6b-df8fdf979e51","Type":"ContainerStarted","Data":"0f2be3375c7a7b696fe1c998e439552fa4a28bb8cfede0c040f562c473a60583"} Sep 16 19:43:21.868841 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:21.868804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2234a757-ecee-4e05-9f6b-df8fdf979e51","Type":"ContainerStarted","Data":"1b0cfb933a610375d3c38d3f66d9e0231fd5bc06e3de300333af23fe5ab4bd51"} Sep 16 19:43:21.869241 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:21.868873 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2234a757-ecee-4e05-9f6b-df8fdf979e51","Type":"ContainerStarted","Data":"7070efd056e1662118cb3a51d749719ad35467863935ef8dd6995f36e825e36e"} Sep 16 19:43:21.869241 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:21.868913 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2234a757-ecee-4e05-9f6b-df8fdf979e51","Type":"ContainerStarted","Data":"b69769f5488646a84a1e1d2c636bde021e9507b66213c0358fc03bf0174739fd"} Sep 16 19:43:21.869241 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:21.868942 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2234a757-ecee-4e05-9f6b-df8fdf979e51","Type":"ContainerStarted","Data":"a70831d5bc704384288767e53094eab66b0f992a67530d2e5c5bbc594dc08472"} Sep 16 19:43:21.869241 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:21.868970 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2234a757-ecee-4e05-9f6b-df8fdf979e51","Type":"ContainerStarted","Data":"699b372c8812f8e6229984aafce7f46715297d6c2b11582d7bfaa28a7cc80b8d"} Sep 16 19:43:21.869241 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:21.869007 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2234a757-ecee-4e05-9f6b-df8fdf979e51","Type":"ContainerStarted","Data":"b7ce8fa95b9d33f5310703586d4845648cc62fbbac2aa7c039c7a8c2fd44223c"} Sep 16 19:43:21.906713 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:21.906645 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.883045705 podStartE2EDuration="2.906621608s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.575903ms" isStatefulPod=false podCreationTimestamp="2026-09-16 19:43:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:43:21.904420101 +0000 UTC m=+261.836379123" watchObservedRunningTime="2026-09-16 19:43:21.906621608 +0000 UTC m=+261.838580625" Sep 16 19:43:25.224838 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:25.224783 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:43:33.018123 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:33.018086 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7788465b88-t6g4s"] Sep 16 19:43:58.042171 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.042127 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7788465b88-t6g4s" podUID="49a95c18-86f7-48ec-9332-fd659ec956c2" containerName="console" containerID="cri-o://1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311" gracePeriod=15 Sep 16 19:43:58.287541 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.287512 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:43:58.360740 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.360597 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-oauth-serving-cert\") pod \"49a95c18-86f7-48ec-9332-fd659ec956c2\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " Sep 16 19:43:58.360740 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.360658 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-trusted-ca-bundle\") pod \"49a95c18-86f7-48ec-9332-fd659ec956c2\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " Sep 16 19:43:58.360740 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.360684 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-serving-cert\") pod \"49a95c18-86f7-48ec-9332-fd659ec956c2\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " Sep 16 19:43:58.361004 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.360772 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-oauth-config\") pod \"49a95c18-86f7-48ec-9332-fd659ec956c2\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " Sep 16 19:43:58.361004 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.360811 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-service-ca\") pod \"49a95c18-86f7-48ec-9332-fd659ec956c2\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " Sep 16 19:43:58.361004 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.360858 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-console-config\") pod \"49a95c18-86f7-48ec-9332-fd659ec956c2\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " Sep 16 19:43:58.361004 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.360889 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsp75\" (UniqueName: \"kubernetes.io/projected/49a95c18-86f7-48ec-9332-fd659ec956c2-kube-api-access-qsp75\") pod \"49a95c18-86f7-48ec-9332-fd659ec956c2\" (UID: \"49a95c18-86f7-48ec-9332-fd659ec956c2\") " Sep 16 19:43:58.361209 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.361041 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "49a95c18-86f7-48ec-9332-fd659ec956c2" (UID: "49a95c18-86f7-48ec-9332-fd659ec956c2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:58.361269 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.361205 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "49a95c18-86f7-48ec-9332-fd659ec956c2" (UID: "49a95c18-86f7-48ec-9332-fd659ec956c2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:58.361382 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.361261 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-oauth-serving-cert\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:58.361382 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.361335 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-console-config" (OuterVolumeSpecName: "console-config") pod "49a95c18-86f7-48ec-9332-fd659ec956c2" (UID: "49a95c18-86f7-48ec-9332-fd659ec956c2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:58.361382 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.361341 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-service-ca" (OuterVolumeSpecName: "service-ca") pod "49a95c18-86f7-48ec-9332-fd659ec956c2" (UID: "49a95c18-86f7-48ec-9332-fd659ec956c2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 19:43:58.363191 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.363160 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "49a95c18-86f7-48ec-9332-fd659ec956c2" (UID: "49a95c18-86f7-48ec-9332-fd659ec956c2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:58.363287 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.363182 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "49a95c18-86f7-48ec-9332-fd659ec956c2" (UID: "49a95c18-86f7-48ec-9332-fd659ec956c2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 19:43:58.363287 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.363198 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49a95c18-86f7-48ec-9332-fd659ec956c2-kube-api-access-qsp75" (OuterVolumeSpecName: "kube-api-access-qsp75") pod "49a95c18-86f7-48ec-9332-fd659ec956c2" (UID: "49a95c18-86f7-48ec-9332-fd659ec956c2"). InnerVolumeSpecName "kube-api-access-qsp75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:43:58.461687 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.461649 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-trusted-ca-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:58.461687 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.461680 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-serving-cert\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:58.461687 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.461696 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49a95c18-86f7-48ec-9332-fd659ec956c2-console-oauth-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:58.461932 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.461709 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-service-ca\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:58.461932 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.461721 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49a95c18-86f7-48ec-9332-fd659ec956c2-console-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:58.461932 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:58.461732 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsp75\" (UniqueName: \"kubernetes.io/projected/49a95c18-86f7-48ec-9332-fd659ec956c2-kube-api-access-qsp75\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:43:59.021791 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:59.021747 2577 generic.go:356] "Generic (PLEG): container finished" podID="49a95c18-86f7-48ec-9332-fd659ec956c2" containerID="1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311" exitCode=0 Sep 16 19:43:59.021939 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:59.021799 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7788465b88-t6g4s" Sep 16 19:43:59.021939 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:59.021809 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7788465b88-t6g4s" event={"ID":"49a95c18-86f7-48ec-9332-fd659ec956c2","Type":"ContainerDied","Data":"1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311"} Sep 16 19:43:59.021939 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:59.021861 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7788465b88-t6g4s" event={"ID":"49a95c18-86f7-48ec-9332-fd659ec956c2","Type":"ContainerDied","Data":"1cc77e22ed3806867330c26ca9d3ccc0ca765d840c00d7734d5e53cbd7164550"} Sep 16 19:43:59.021939 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:59.021888 2577 scope.go:117] "RemoveContainer" containerID="1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311" Sep 16 19:43:59.030114 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:59.030095 2577 scope.go:117] "RemoveContainer" containerID="1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311" Sep 16 19:43:59.030431 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:43:59.030411 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311\": container with ID starting with 1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311 not found: ID does not exist" containerID="1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311" Sep 16 19:43:59.030493 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:59.030442 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311"} err="failed to get container status \"1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311\": rpc error: code = NotFound desc = could not find container \"1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311\": container with ID starting with 1ba8fac8672726a0a2682aa82ffdfbd7c5b15edae842d6180558ccf378501311 not found: ID does not exist" Sep 16 19:43:59.044771 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:59.044732 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7788465b88-t6g4s"] Sep 16 19:43:59.049913 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:43:59.049883 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7788465b88-t6g4s"] Sep 16 19:44:00.496866 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:44:00.496834 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ll9g2_d58305b4-569b-4c7c-a6ce-9f714256b632/console-operator/1.log" Sep 16 19:44:00.502759 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:44:00.502731 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ll9g2_d58305b4-569b-4c7c-a6ce-9f714256b632/console-operator/1.log" Sep 16 19:44:00.514260 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:44:00.508339 2577 kubelet.go:1648] "Image garbage collection succeeded" Sep 16 19:44:00.607690 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:44:00.607526 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49a95c18-86f7-48ec-9332-fd659ec956c2" path="/var/lib/kubelet/pods/49a95c18-86f7-48ec-9332-fd659ec956c2/volumes" Sep 16 19:44:20.225378 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:44:20.225338 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:44:20.241059 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:44:20.241034 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:44:21.123710 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:44:21.123679 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 19:48:09.531890 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.531803 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fvm9g/must-gather-ckncc"] Sep 16 19:48:09.532350 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.532132 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49a95c18-86f7-48ec-9332-fd659ec956c2" containerName="console" Sep 16 19:48:09.532350 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.532144 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49a95c18-86f7-48ec-9332-fd659ec956c2" containerName="console" Sep 16 19:48:09.532350 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.532214 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49a95c18-86f7-48ec-9332-fd659ec956c2" containerName="console" Sep 16 19:48:09.535218 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.535196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:09.538170 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.538147 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fvm9g\"/\"kube-root-ca.crt\"" Sep 16 19:48:09.538283 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.538152 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fvm9g\"/\"openshift-service-ca.crt\"" Sep 16 19:48:09.548126 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.548089 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvm9g/must-gather-ckncc"] Sep 16 19:48:09.677307 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.677269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5f65\" (UniqueName: \"kubernetes.io/projected/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-kube-api-access-b5f65\") pod \"must-gather-ckncc\" (UID: \"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc\") " pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:09.677489 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.677327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-must-gather-output\") pod \"must-gather-ckncc\" (UID: \"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc\") " pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:09.778656 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.778599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5f65\" (UniqueName: \"kubernetes.io/projected/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-kube-api-access-b5f65\") pod \"must-gather-ckncc\" (UID: \"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc\") " pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:09.778805 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.778685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-must-gather-output\") pod \"must-gather-ckncc\" (UID: \"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc\") " pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:09.779009 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.778988 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-must-gather-output\") pod \"must-gather-ckncc\" (UID: \"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc\") " pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:09.787943 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.787869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5f65\" (UniqueName: \"kubernetes.io/projected/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-kube-api-access-b5f65\") pod \"must-gather-ckncc\" (UID: \"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc\") " pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:09.853736 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:09.853698 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:10.129211 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:10.129183 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvm9g/must-gather-ckncc"] Sep 16 19:48:10.131799 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:48:10.131766 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod629d66b0_ed0d_4a66_ac24_c4ba467aa6fc.slice/crio-15b291d7886a63b1abce69acc9abd72439d408d2ef181d8c3fb810ed81b59023 WatchSource:0}: Error finding container 15b291d7886a63b1abce69acc9abd72439d408d2ef181d8c3fb810ed81b59023: Status 404 returned error can't find the container with id 15b291d7886a63b1abce69acc9abd72439d408d2ef181d8c3fb810ed81b59023 Sep 16 19:48:10.134242 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:10.134226 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 19:48:11.045882 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:11.045810 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvm9g/must-gather-ckncc" event={"ID":"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc","Type":"ContainerStarted","Data":"15b291d7886a63b1abce69acc9abd72439d408d2ef181d8c3fb810ed81b59023"} Sep 16 19:48:17.077372 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:17.077323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvm9g/must-gather-ckncc" event={"ID":"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc","Type":"ContainerStarted","Data":"64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa"} Sep 16 19:48:17.077860 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:17.077390 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvm9g/must-gather-ckncc" event={"ID":"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc","Type":"ContainerStarted","Data":"e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5"} Sep 16 19:48:30.138129 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:30.138092 2577 generic.go:356] "Generic (PLEG): container finished" podID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" containerID="e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5" exitCode=0 Sep 16 19:48:30.138721 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:30.138174 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvm9g/must-gather-ckncc" event={"ID":"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc","Type":"ContainerDied","Data":"e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5"} Sep 16 19:48:30.138721 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:30.138570 2577 scope.go:117] "RemoveContainer" containerID="e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5" Sep 16 19:48:30.411823 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:30.411732 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fvm9g_must-gather-ckncc_629d66b0-ed0d-4a66-ac24-c4ba467aa6fc/gather/0.log" Sep 16 19:48:33.633780 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:33.633748 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dm94l_43fe466d-e2b0-42b2-a5de-749975ccde74/global-pull-secret-syncer/0.log" Sep 16 19:48:33.767430 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:33.767392 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qtbtk_f513231e-a653-417f-a71c-667eb54deddd/konnectivity-agent/0.log" Sep 16 19:48:33.837915 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:33.837879 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-132.ec2.internal_05f2cfd76c2cf0815635289ed034853f/haproxy/0.log" Sep 16 19:48:35.724675 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:35.724640 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-fvm9g/must-gather-ckncc"] Sep 16 19:48:35.725129 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:35.724840 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-fvm9g/must-gather-ckncc" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" containerName="copy" containerID="cri-o://64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa" gracePeriod=2 Sep 16 19:48:35.726910 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:35.726873 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-fvm9g/must-gather-ckncc"] Sep 16 19:48:35.727328 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:48:35.727293 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ckncc\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fvm9g\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:35.964031 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:35.964002 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fvm9g_must-gather-ckncc_629d66b0-ed0d-4a66-ac24-c4ba467aa6fc/copy/0.log" Sep 16 19:48:35.966465 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:35.966439 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:35.968965 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:48:35.968936 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ckncc\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fvm9g\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:36.009844 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.009814 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5f65\" (UniqueName: \"kubernetes.io/projected/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-kube-api-access-b5f65\") pod \"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc\" (UID: \"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc\") " Sep 16 19:48:36.010021 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.009856 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-must-gather-output\") pod \"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc\" (UID: \"629d66b0-ed0d-4a66-ac24-c4ba467aa6fc\") " Sep 16 19:48:36.010242 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.010215 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" (UID: "629d66b0-ed0d-4a66-ac24-c4ba467aa6fc"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 19:48:36.012087 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.012063 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-kube-api-access-b5f65" (OuterVolumeSpecName: "kube-api-access-b5f65") pod "629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" (UID: "629d66b0-ed0d-4a66-ac24-c4ba467aa6fc"). InnerVolumeSpecName "kube-api-access-b5f65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 19:48:36.111035 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.110999 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5f65\" (UniqueName: \"kubernetes.io/projected/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-kube-api-access-b5f65\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:48:36.111035 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.111024 2577 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc-must-gather-output\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" Sep 16 19:48:36.163258 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.163229 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fvm9g_must-gather-ckncc_629d66b0-ed0d-4a66-ac24-c4ba467aa6fc/copy/0.log" Sep 16 19:48:36.163600 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.163577 2577 generic.go:356] "Generic (PLEG): container finished" podID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" containerID="64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa" exitCode=143 Sep 16 19:48:36.163705 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.163640 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:36.163705 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.163652 2577 scope.go:117] "RemoveContainer" containerID="64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa" Sep 16 19:48:36.166116 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:48:36.166084 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ckncc\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fvm9g\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:36.172708 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.172688 2577 scope.go:117] "RemoveContainer" containerID="e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5" Sep 16 19:48:36.174757 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:48:36.174730 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ckncc\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fvm9g\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" pod="openshift-must-gather-fvm9g/must-gather-ckncc" Sep 16 19:48:36.184227 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.184206 2577 scope.go:117] "RemoveContainer" containerID="64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa" Sep 16 19:48:36.184593 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:48:36.184573 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa\": container with ID starting with 64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa not found: ID does not exist" containerID="64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa" Sep 16 19:48:36.184677 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.184613 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa"} err="failed to get container status \"64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa\": rpc error: code = NotFound desc = could not find container \"64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa\": container with ID starting with 64b432829cf9ff590d752c3f706631858d6a0299083bc5131f39c0010ae81bfa not found: ID does not exist" Sep 16 19:48:36.184677 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.184636 2577 scope.go:117] "RemoveContainer" containerID="e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5" Sep 16 19:48:36.184882 ip-10-0-141-132 kubenswrapper[2577]: E0916 19:48:36.184864 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5\": container with ID starting with e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5 not found: ID does not exist" containerID="e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5" Sep 16 19:48:36.184937 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.184892 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5"} err="failed to get container status \"e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5\": rpc error: code = NotFound desc = could not find container \"e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5\": container with ID starting with e90c11e93ee9d84e56521108e1014b3fdc2c2307f57a35959f4f61b92295a2f5 not found: ID does not exist" Sep 16 19:48:36.607896 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:36.607853 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" path="/var/lib/kubelet/pods/629d66b0-ed0d-4a66-ac24-c4ba467aa6fc/volumes" Sep 16 19:48:37.646832 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:37.646800 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-6g5t8_54b51f48-ffca-4337-be57-06003f3e7dcc/cluster-monitoring-operator/0.log" Sep 16 19:48:37.674957 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:37.674921 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-59g5b_2eef8531-b2a8-4a97-990c-676f8e647d0c/kube-state-metrics/0.log" Sep 16 19:48:37.696467 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:37.696436 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-59g5b_2eef8531-b2a8-4a97-990c-676f8e647d0c/kube-rbac-proxy-main/0.log" Sep 16 19:48:37.723992 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:37.723962 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-59g5b_2eef8531-b2a8-4a97-990c-676f8e647d0c/kube-rbac-proxy-self/0.log" Sep 16 19:48:37.788427 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:37.788385 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-nvhgt_12dfd771-8aab-4cfc-894f-2b8c4211fae6/monitoring-plugin/0.log" Sep 16 19:48:37.904138 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:37.904051 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-njc96_8126e1a6-d411-4f96-83a9-6f29d1b96672/node-exporter/0.log" Sep 16 19:48:37.932785 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:37.932761 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-njc96_8126e1a6-d411-4f96-83a9-6f29d1b96672/kube-rbac-proxy/0.log" Sep 16 19:48:37.962017 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:37.961990 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-njc96_8126e1a6-d411-4f96-83a9-6f29d1b96672/init-textfile/0.log" Sep 16 19:48:38.203838 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.203755 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2234a757-ecee-4e05-9f6b-df8fdf979e51/prometheus/0.log" Sep 16 19:48:38.231496 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.231467 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2234a757-ecee-4e05-9f6b-df8fdf979e51/config-reloader/0.log" Sep 16 19:48:38.258177 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.258145 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2234a757-ecee-4e05-9f6b-df8fdf979e51/thanos-sidecar/0.log" Sep 16 19:48:38.281006 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.280958 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2234a757-ecee-4e05-9f6b-df8fdf979e51/kube-rbac-proxy-web/0.log" Sep 16 19:48:38.306970 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.306928 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2234a757-ecee-4e05-9f6b-df8fdf979e51/kube-rbac-proxy/0.log" Sep 16 19:48:38.331876 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.331837 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2234a757-ecee-4e05-9f6b-df8fdf979e51/kube-rbac-proxy-thanos/0.log" Sep 16 19:48:38.355153 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.355095 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2234a757-ecee-4e05-9f6b-df8fdf979e51/init-config-reloader/0.log" Sep 16 19:48:38.386670 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.386639 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-zmr7j_841bb181-1e84-4245-bcf8-d1be32400cd5/prometheus-operator/0.log" Sep 16 19:48:38.415192 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.415159 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-zmr7j_841bb181-1e84-4245-bcf8-d1be32400cd5/kube-rbac-proxy/0.log" Sep 16 19:48:38.598376 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.598341 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6885569d5f-sp6nv_76c1825a-9987-46c5-98fb-63e6dbed7028/thanos-query/0.log" Sep 16 19:48:38.648064 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.648031 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6885569d5f-sp6nv_76c1825a-9987-46c5-98fb-63e6dbed7028/kube-rbac-proxy-web/0.log" Sep 16 19:48:38.721874 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.721840 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6885569d5f-sp6nv_76c1825a-9987-46c5-98fb-63e6dbed7028/kube-rbac-proxy/0.log" Sep 16 19:48:38.763144 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.763115 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6885569d5f-sp6nv_76c1825a-9987-46c5-98fb-63e6dbed7028/prom-label-proxy/0.log" Sep 16 19:48:38.789046 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.789017 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6885569d5f-sp6nv_76c1825a-9987-46c5-98fb-63e6dbed7028/kube-rbac-proxy-rules/0.log" Sep 16 19:48:38.812824 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:38.812795 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6885569d5f-sp6nv_76c1825a-9987-46c5-98fb-63e6dbed7028/kube-rbac-proxy-metrics/0.log" Sep 16 19:48:40.584476 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:40.584442 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ll9g2_d58305b4-569b-4c7c-a6ce-9f714256b632/console-operator/1.log" Sep 16 19:48:40.593342 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:40.593314 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ll9g2_d58305b4-569b-4c7c-a6ce-9f714256b632/console-operator/2.log" Sep 16 19:48:41.024342 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.024310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-j6ntv_dd255aaa-8ad1-4728-941f-fa6a61e0cf46/download-server/0.log" Sep 16 19:48:41.370111 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.370034 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw"] Sep 16 19:48:41.370393 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.370378 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" containerName="copy" Sep 16 19:48:41.370456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.370397 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" containerName="copy" Sep 16 19:48:41.370456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.370415 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" containerName="gather" Sep 16 19:48:41.370456 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.370422 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" containerName="gather" Sep 16 19:48:41.370555 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.370473 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" containerName="copy" Sep 16 19:48:41.370555 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.370484 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="629d66b0-ed0d-4a66-ac24-c4ba467aa6fc" containerName="gather" Sep 16 19:48:41.375318 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.375294 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.379006 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.378969 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gfl5f\"/\"kube-root-ca.crt\"" Sep 16 19:48:41.379168 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.379148 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gfl5f\"/\"default-dockercfg-n6zqh\"" Sep 16 19:48:41.380409 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.380391 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gfl5f\"/\"openshift-service-ca.crt\"" Sep 16 19:48:41.392399 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.392368 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw"] Sep 16 19:48:41.446382 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.446343 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-sys\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.446382 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.446385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-proc\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.446647 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.446414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6bzb\" (UniqueName: \"kubernetes.io/projected/b32c68eb-2a25-440c-85b0-2871c8db31e8-kube-api-access-x6bzb\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.446647 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.446480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-podres\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.446647 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.446517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-lib-modules\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.547216 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.547179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-podres\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.547395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.547229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-lib-modules\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.547395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.547259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-sys\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.547395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.547278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-proc\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.547395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.547297 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6bzb\" (UniqueName: \"kubernetes.io/projected/b32c68eb-2a25-440c-85b0-2871c8db31e8-kube-api-access-x6bzb\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.547395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.547345 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-sys\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.547395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.547360 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-proc\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.547395 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.547363 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-podres\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.547726 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.547373 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b32c68eb-2a25-440c-85b0-2871c8db31e8-lib-modules\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.559949 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.559909 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6bzb\" (UniqueName: \"kubernetes.io/projected/b32c68eb-2a25-440c-85b0-2871c8db31e8-kube-api-access-x6bzb\") pod \"perf-node-gather-daemonset-z7cfw\" (UID: \"b32c68eb-2a25-440c-85b0-2871c8db31e8\") " pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.684827 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.684727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:41.958876 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:41.958851 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw"] Sep 16 19:48:41.961341 ip-10-0-141-132 kubenswrapper[2577]: W0916 19:48:41.961313 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb32c68eb_2a25_440c_85b0_2871c8db31e8.slice/crio-ca913de6d43382714132cdaf605dfe9cb3482d41bc50064e293a0d4c778c94a6 WatchSource:0}: Error finding container ca913de6d43382714132cdaf605dfe9cb3482d41bc50064e293a0d4c778c94a6: Status 404 returned error can't find the container with id ca913de6d43382714132cdaf605dfe9cb3482d41bc50064e293a0d4c778c94a6 Sep 16 19:48:42.192935 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:42.192898 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" event={"ID":"b32c68eb-2a25-440c-85b0-2871c8db31e8","Type":"ContainerStarted","Data":"67e29c3b15166ad6c3bf7942566e1746282c4b3d6adeaa472c5d3d4ef13e16b9"} Sep 16 19:48:42.193110 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:42.192987 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" event={"ID":"b32c68eb-2a25-440c-85b0-2871c8db31e8","Type":"ContainerStarted","Data":"ca913de6d43382714132cdaf605dfe9cb3482d41bc50064e293a0d4c778c94a6"} Sep 16 19:48:42.193110 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:42.193051 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:42.211795 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:42.211662 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" podStartSLOduration=1.211639679 podStartE2EDuration="1.211639679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 19:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 19:48:42.210319498 +0000 UTC m=+582.142278520" watchObservedRunningTime="2026-09-16 19:48:42.211639679 +0000 UTC m=+582.143598700" Sep 16 19:48:42.563305 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:42.563255 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpsrf_8ca9d42a-96da-433e-a05c-92942a97dc59/dns/0.log" Sep 16 19:48:42.589519 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:42.589486 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpsrf_8ca9d42a-96da-433e-a05c-92942a97dc59/kube-rbac-proxy/0.log" Sep 16 19:48:42.686137 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:42.686102 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dtb5f_9e9c76d7-02d8-4ab9-9cd4-7f983331f938/dns-node-resolver/0.log" Sep 16 19:48:43.255774 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:43.255745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rbd5j_109ee397-68be-473b-9ef2-c5452e5bce1c/node-ca/0.log" Sep 16 19:48:43.976828 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:43.976795 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-785cbd56cd-8m7w4_2054f1c2-87ed-4a30-a88e-c5a901a78f9d/router/0.log" Sep 16 19:48:44.309925 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:44.309887 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kf5ns_5aa726c3-75c4-434a-a04b-cffda55507fe/serve-healthcheck-canary/0.log" Sep 16 19:48:44.904044 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:44.904002 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p96zq_042234ca-6b29-43e4-b3a6-8a595ed34992/kube-rbac-proxy/0.log" Sep 16 19:48:44.925952 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:44.925920 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p96zq_042234ca-6b29-43e4-b3a6-8a595ed34992/exporter/0.log" Sep 16 19:48:44.949400 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:44.949368 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p96zq_042234ca-6b29-43e4-b3a6-8a595ed34992/extractor/0.log" Sep 16 19:48:48.207668 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:48.207631 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gfl5f/perf-node-gather-daemonset-z7cfw" Sep 16 19:48:51.360158 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:51.360125 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-brv8l_17e2b27f-8d97-4980-b072-83e452563c0a/migrator/0.log" Sep 16 19:48:51.382126 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:51.382087 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-brv8l_17e2b27f-8d97-4980-b072-83e452563c0a/graceful-termination/0.log" Sep 16 19:48:52.830567 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:52.830535 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-27rx4_d52a3e1b-d963-4f1d-8edf-1a37b947ef18/kube-multus-additional-cni-plugins/0.log" Sep 16 19:48:52.862275 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:52.862246 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-27rx4_d52a3e1b-d963-4f1d-8edf-1a37b947ef18/egress-router-binary-copy/0.log" Sep 16 19:48:52.885923 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:52.885893 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-27rx4_d52a3e1b-d963-4f1d-8edf-1a37b947ef18/cni-plugins/0.log" Sep 16 19:48:52.909134 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:52.909101 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-27rx4_d52a3e1b-d963-4f1d-8edf-1a37b947ef18/bond-cni-plugin/0.log" Sep 16 19:48:52.938678 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:52.938644 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-27rx4_d52a3e1b-d963-4f1d-8edf-1a37b947ef18/routeoverride-cni/0.log" Sep 16 19:48:52.962144 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:52.962112 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-27rx4_d52a3e1b-d963-4f1d-8edf-1a37b947ef18/whereabouts-cni-bincopy/0.log" Sep 16 19:48:52.989241 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:52.989206 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-27rx4_d52a3e1b-d963-4f1d-8edf-1a37b947ef18/whereabouts-cni/0.log" Sep 16 19:48:53.501674 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:53.501641 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wwj2p_7719810a-94e9-426e-a62c-59612c727a86/kube-multus/0.log" Sep 16 19:48:53.728056 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:53.728026 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z9szj_d59f8428-b82a-4081-aca2-8a277b37066c/network-metrics-daemon/0.log" Sep 16 19:48:53.749014 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:53.748982 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z9szj_d59f8428-b82a-4081-aca2-8a277b37066c/kube-rbac-proxy/0.log" Sep 16 19:48:54.502861 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:54.502828 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dk5x_012becf2-a2fe-4cc9-a3cc-9f5978cf917d/ovn-controller/0.log" Sep 16 19:48:54.524994 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:54.524969 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dk5x_012becf2-a2fe-4cc9-a3cc-9f5978cf917d/ovn-acl-logging/0.log" Sep 16 19:48:54.553968 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:54.553939 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dk5x_012becf2-a2fe-4cc9-a3cc-9f5978cf917d/kube-rbac-proxy-node/0.log" Sep 16 19:48:54.578228 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:54.578192 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dk5x_012becf2-a2fe-4cc9-a3cc-9f5978cf917d/kube-rbac-proxy-ovn-metrics/0.log" Sep 16 19:48:54.596746 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:54.596718 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dk5x_012becf2-a2fe-4cc9-a3cc-9f5978cf917d/northd/0.log" Sep 16 19:48:54.620855 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:54.620829 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dk5x_012becf2-a2fe-4cc9-a3cc-9f5978cf917d/nbdb/0.log" Sep 16 19:48:54.641483 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:54.641453 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dk5x_012becf2-a2fe-4cc9-a3cc-9f5978cf917d/sbdb/0.log" Sep 16 19:48:54.690215 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:54.690180 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dk5x_012becf2-a2fe-4cc9-a3cc-9f5978cf917d/ovnkube-controller/0.log" Sep 16 19:48:56.107216 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:56.107183 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f8b768455-5nwwc_c90678cc-1181-482a-8cc9-f8e11b3d63b2/check-endpoints/0.log" Sep 16 19:48:56.131884 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:56.131858 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8dwkj_86e7d337-42ba-46be-92ab-a8ddf79b3df5/network-check-target-container/0.log" Sep 16 19:48:57.063621 ip-10-0-141-132 kubenswrapper[2577]: I0916 19:48:57.063586 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-97lj4_9e165e27-f35c-44ab-a2a6-5c342b4d2436/iptables-alerter/0.log"