Sep 17 14:02:14.508914 ip-10-0-141-162 systemd[1]: Starting Kubernetes Kubelet... Sep 17 14:02:14.906388 ip-10-0-141-162 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 14:02:14.906388 ip-10-0-141-162 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 14:02:14.906388 ip-10-0-141-162 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 14:02:14.906388 ip-10-0-141-162 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 14:02:14.906388 ip-10-0-141-162 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 14:02:14.907265 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.907138 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 14:02:14.912036 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912019 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:02:14.912036 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912035 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:02:14.912036 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912039 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912042 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912047 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912052 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912062 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912066 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912069 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912072 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912074 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912077 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912080 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912083 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912086 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912089 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912092 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912094 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912097 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912100 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912102 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:02:14.912142 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912105 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912107 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912111 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912113 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912116 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912118 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912122 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912126 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912128 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912131 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912134 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912136 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912141 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912144 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912147 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912150 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912154 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912157 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912160 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:02:14.912620 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912163 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912166 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912168 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912171 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912174 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912177 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912179 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912182 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912185 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912187 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912190 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912192 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912195 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912197 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912201 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912204 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912208 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912210 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912213 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912215 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:02:14.913080 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912218 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912221 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912224 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912227 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912229 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912232 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912234 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912237 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912240 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912243 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912245 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912254 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912257 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912259 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912262 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912265 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912267 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912270 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912273 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912276 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:02:14.913580 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912280 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912283 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912285 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912288 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912290 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912293 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912296 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912299 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912301 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912304 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912307 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912310 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912312 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912315 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912318 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912320 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912323 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912325 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.912328 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913016 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:02:14.914088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913023 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913027 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913029 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913032 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913035 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913039 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913042 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913044 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913047 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913050 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913054 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913057 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913060 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913062 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913065 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913067 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913070 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913073 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913075 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:02:14.914591 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913079 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913082 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913085 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913087 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913090 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913093 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913096 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913099 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913103 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913107 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913110 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913113 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913116 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913119 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913121 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913124 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913127 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913129 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913135 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:02:14.915105 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913137 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913140 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913143 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913145 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913147 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913150 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913153 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913155 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913158 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913161 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913163 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913165 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913168 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913171 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913175 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913179 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913182 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913185 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913188 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913191 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:02:14.915594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913194 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913196 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913199 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913201 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913204 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913207 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913209 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913212 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913214 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913217 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913220 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913222 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913225 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913228 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913230 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913233 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913235 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913238 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913240 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913243 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:02:14.916095 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913245 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913248 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913251 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913254 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913256 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913259 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913262 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913264 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913266 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913270 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913273 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913276 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913278 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913281 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913284 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913287 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913290 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913292 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913295 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913297 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:02:14.916611 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913657 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913663 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913667 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913670 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913673 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913676 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913679 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913682 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913684 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913686 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913689 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913692 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913694 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913699 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913702 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913704 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913707 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913710 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913713 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:02:14.917110 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913716 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913718 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913721 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913724 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913726 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913729 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913731 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913734 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913736 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913739 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913742 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913745 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913748 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913752 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913755 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913758 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913761 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913763 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913766 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:02:14.917581 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913769 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913772 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913774 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913776 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913779 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913782 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913785 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913790 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913793 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913795 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913798 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913800 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913803 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913806 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913808 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913811 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913813 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913816 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913818 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:02:14.918064 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913822 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913826 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913829 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913831 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913834 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913839 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913841 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913844 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913846 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913849 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913852 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913854 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913857 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913863 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913866 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913869 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913871 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913874 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913876 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913879 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913883 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:02:14.918529 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913885 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913888 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913890 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913893 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913895 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913898 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913900 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913903 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913906 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913908 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913911 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913913 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913916 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913918 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913921 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913924 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913928 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913930 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913933 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913935 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:02:14.919088 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.913938 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914009 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914046 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914055 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914060 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914065 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914068 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914072 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914076 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914079 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914082 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914087 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914091 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914094 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914097 2579 flags.go:64] FLAG: --cgroup-root="" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914100 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914104 2579 flags.go:64] FLAG: --client-ca-file="" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914107 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914110 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914114 2579 flags.go:64] FLAG: --cluster-domain="" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914117 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914120 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914124 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914127 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 14:02:14.919598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914138 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914141 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914144 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914148 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914152 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914155 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914158 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914162 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914164 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914168 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914171 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914174 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914177 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914180 2579 flags.go:64] FLAG: --enable-server="true" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914183 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914188 2579 flags.go:64] FLAG: --event-burst="100" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914191 2579 flags.go:64] FLAG: --event-qps="50" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914194 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914197 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914201 2579 flags.go:64] FLAG: --eviction-hard="" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914205 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914208 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914211 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914214 2579 flags.go:64] FLAG: --eviction-soft="" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914217 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 14:02:14.920220 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914220 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914223 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914227 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914229 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914233 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914235 2579 flags.go:64] FLAG: --feature-gates="" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914239 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914242 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914245 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914248 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914251 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914255 2579 flags.go:64] FLAG: --help="false" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914258 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-141-162.ec2.internal" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914262 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914264 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914267 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914270 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914274 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914277 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914280 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914282 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914285 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914288 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914292 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 14:02:14.920885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914294 2579 flags.go:64] FLAG: --kube-reserved="" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914298 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914301 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914305 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914308 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914310 2579 flags.go:64] FLAG: --lock-file="" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914313 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914316 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914319 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914324 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914327 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914330 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914332 2579 flags.go:64] FLAG: --logging-format="text" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914335 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914339 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914342 2579 flags.go:64] FLAG: --manifest-url="" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914345 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914349 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914352 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914357 2579 flags.go:64] FLAG: --max-pods="110" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914360 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914364 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914367 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914369 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914373 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 14:02:14.921499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914376 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914378 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914386 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914389 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914392 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914395 2579 flags.go:64] FLAG: --pod-cidr="" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914398 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914403 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914406 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914409 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914413 2579 flags.go:64] FLAG: --port="10250" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914416 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914419 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-099c5ea9df80c3b26" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914422 2579 flags.go:64] FLAG: --qos-reserved="" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914425 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914428 2579 flags.go:64] FLAG: --register-node="true" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914431 2579 flags.go:64] FLAG: --register-with-taints="" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914434 2579 flags.go:64] FLAG: --registry-burst="10" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914437 2579 flags.go:64] FLAG: --registry-qps="5" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914441 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914444 2579 flags.go:64] FLAG: --reserved-memory="" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914447 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914451 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914454 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914457 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 14:02:14.922141 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914460 2579 flags.go:64] FLAG: --runonce="false" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914464 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914467 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914470 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914473 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914476 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914479 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914482 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914485 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914488 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914491 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914493 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914496 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914499 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914503 2579 flags.go:64] FLAG: --system-cgroups="" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914506 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914512 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914516 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914519 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914523 2579 flags.go:64] FLAG: --tls-min-version="" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914526 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914529 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914543 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914546 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914549 2579 flags.go:64] FLAG: --v="2" Sep 17 14:02:14.922777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914553 2579 flags.go:64] FLAG: --version="false" Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914557 2579 flags.go:64] FLAG: --vmodule="" Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914561 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.914564 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914676 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914679 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914682 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914685 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914689 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914692 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914694 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914697 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914700 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914702 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914705 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914708 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914710 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914713 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914716 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914718 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914721 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:02:14.923422 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914725 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914728 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914730 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914734 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914737 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914739 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914742 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914745 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914747 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914750 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914753 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914755 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914758 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914761 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914763 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914766 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914768 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914771 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914773 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914776 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:02:14.923960 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914779 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914782 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914785 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914789 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914792 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914795 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914798 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914801 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914804 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914807 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914810 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914813 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914815 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914818 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914821 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914825 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914828 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914831 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914833 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:02:14.924473 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914836 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914838 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914841 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914861 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914864 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914868 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914871 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914874 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914878 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914881 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914883 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914886 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914889 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914892 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914895 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914898 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914902 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914906 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914909 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:02:14.924997 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914912 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914914 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914917 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914919 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914922 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914925 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914927 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914930 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914933 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914937 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914940 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914943 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914945 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914949 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914953 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914956 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914959 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914962 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914964 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:02:14.925446 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914967 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914970 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914973 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914975 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.914978 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.915612 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.922773 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.922910 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.923890 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.923899 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.923981 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.923987 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.923990 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.923994 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.923997 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:02:14.925934 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924000 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924003 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924005 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924008 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924011 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924013 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924016 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924019 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924021 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924024 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924027 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924030 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924032 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924035 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924038 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924041 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924044 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924046 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924049 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924051 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:02:14.926314 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924061 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924064 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924067 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924070 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924079 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924082 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924085 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924087 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924091 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924093 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924096 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924099 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924101 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924104 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924107 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924109 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924112 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924115 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924117 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924120 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:02:14.926838 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924122 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924125 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924127 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924130 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924133 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924135 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924139 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924143 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924146 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924149 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924153 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924157 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924159 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924162 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924165 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924168 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924171 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924179 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924182 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:02:14.927363 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924185 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924187 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924190 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924193 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924195 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924198 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924201 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924203 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924205 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924208 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924211 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924213 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924216 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924219 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924222 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924224 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924227 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924230 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924232 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924235 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:02:14.927899 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924237 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924242 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924245 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924248 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924251 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924254 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924256 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924259 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924262 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924265 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924268 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924276 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924279 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924281 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924284 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:02:14.928614 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.924289 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924440 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924445 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924448 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924452 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924454 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924457 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924460 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924463 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924465 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924468 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924470 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924473 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924476 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924479 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924482 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924485 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924488 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924490 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924493 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 14:02:14.929027 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924495 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924498 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924501 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924503 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924506 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924509 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924512 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924515 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924518 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924526 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924529 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924547 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924550 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924553 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924555 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924558 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924560 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924563 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924566 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924568 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 14:02:14.929528 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924571 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924573 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924576 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924579 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924581 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924584 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924586 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924589 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924592 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924594 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924597 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924600 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924602 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924605 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924609 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924613 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924617 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924619 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924623 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 14:02:14.930053 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924626 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924629 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924631 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924640 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924644 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924646 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924649 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924652 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924655 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924658 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924660 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924663 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924665 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924668 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924670 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924673 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924675 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924678 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924680 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924683 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 14:02:14.930518 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924685 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924688 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924690 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924693 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924696 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924698 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924701 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924705 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924709 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924714 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924717 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924720 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924723 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924726 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924728 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924731 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924741 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924744 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924746 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 14:02:14.931026 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924749 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 14:02:14.931494 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:14.924751 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 14:02:14.931494 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.924756 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 14:02:14.931494 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.924889 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 14:02:14.931494 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.926923 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 14:02:14.931494 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.930331 2579 server.go:1019] "Starting client certificate rotation" Sep 17 14:02:14.931494 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.930436 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 14:02:14.931494 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.930479 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 14:02:14.932943 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.932927 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 14:02:14.934153 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.934135 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 14:02:14.944571 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.944553 2579 log.go:25] "Validated CRI v1 runtime API" Sep 17 14:02:14.948266 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.948247 2579 log.go:25] "Validated CRI v1 image API" Sep 17 14:02:14.949131 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.949113 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 14:02:14.951648 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.951629 2579 fs.go:135] Filesystem UUIDs: map[2cb7a805-2212-49fe-b506-4b43ca381d88:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 de2ba8a9-84b0-45e8-86ca-52c0aee93f4d:/dev/nvme0n1p4] Sep 17 14:02:14.951717 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.951648 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 14:02:14.957782 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.957654 2579 manager.go:216] Machine: {Timestamp:2026-09-17 14:02:14.955442558 +0000 UTC m=+0.333253557 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101557 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23027bd561db0c62a67bb88b3772bc SystemUUID:ec23027b-d561-db0c-62a6-7bb88b3772bc BootID:1af388c7-7beb-4d4c-aa98-e9dd4c54f78f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f5:ed:7f:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f5:ed:7f:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:c1:3a:63:84:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 14:02:14.957782 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.957775 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 14:02:14.957955 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.957922 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 14:02:14.957997 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.957965 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 14:02:14.960962 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.960933 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 14:02:14.961101 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.960964 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 14:02:14.962765 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.962755 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 14:02:14.962798 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.962767 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 14:02:14.962798 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.962775 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 14:02:14.963339 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.963329 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 14:02:14.964150 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.964139 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 14:02:14.967381 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.967370 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 17 14:02:14.967496 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.967487 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 14:02:14.967545 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.967516 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 17 14:02:14.967545 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.967530 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 14:02:14.967620 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.967563 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 14:02:14.967620 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.967605 2579 kubelet.go:398] "Adding apiserver pod source" Sep 17 14:02:14.967620 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.967617 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 14:02:14.968119 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.968096 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 14:02:14.968119 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.968122 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 14:02:14.971275 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.971254 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 14:02:14.974645 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.974627 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 14:02:14.974732 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.974658 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 14:02:14.976528 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976516 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 14:02:14.976586 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976548 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 14:02:14.976586 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976557 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 14:02:14.976586 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976562 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 14:02:14.976586 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976571 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 14:02:14.976586 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976576 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 14:02:14.976746 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976589 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 14:02:14.976746 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976594 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 14:02:14.976746 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976603 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 14:02:14.976746 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976612 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 14:02:14.976746 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976621 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 14:02:14.976746 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.976626 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 14:02:14.977284 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.977272 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 14:02:14.977322 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.977286 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 14:02:14.979017 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.979000 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 14:02:14.979105 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:14.979085 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 14:02:14.979148 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:14.979085 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 14:02:14.981106 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.981093 2579 server.go:1268] "Started kubelet" Sep 17 14:02:14.981194 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.981165 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 14:02:14.981231 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.981172 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 14:02:14.981259 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.981247 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 14:02:14.981920 ip-10-0-141-162 systemd[1]: Started Kubernetes Kubelet. Sep 17 14:02:14.982960 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.982935 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 14:02:14.983440 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.983425 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 17 14:02:14.988929 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:14.988910 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 14:02:14.990830 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.990808 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 14:02:14.991286 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.991267 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 14:02:14.991615 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:14.991508 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:14.991935 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.991913 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 14:02:14.991935 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.991916 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 14:02:14.992080 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.991940 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 14:02:14.992165 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.992105 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 17 14:02:14.992165 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.992112 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 17 14:02:14.992257 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.992190 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 14:02:14.992257 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.992204 2579 factory.go:55] Registering systemd factory Sep 17 14:02:14.992257 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.992213 2579 factory.go:223] Registration of the systemd container factory successfully Sep 17 14:02:14.992442 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.992430 2579 factory.go:153] Registering CRI-O factory Sep 17 14:02:14.992498 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.992445 2579 factory.go:223] Registration of the crio container factory successfully Sep 17 14:02:14.992498 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.992460 2579 factory.go:103] Registering Raw factory Sep 17 14:02:14.992498 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.992490 2579 manager.go:1196] Started watching for new ooms in manager Sep 17 14:02:14.992819 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:14.992808 2579 manager.go:349] Starting recovery of all containers Sep 17 14:02:14.994848 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:14.994827 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 14:02:14.994958 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:14.994928 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 14:02:14.995826 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:14.994850 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-162.ec2.internal.18d62097087f51a4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-162.ec2.internal,UID:ip-10-0-141-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-162.ec2.internal,},FirstTimestamp:2026-09-17 14:02:14.981063076 +0000 UTC m=+0.358874076,LastTimestamp:2026-09-17 14:02:14.981063076 +0000 UTC m=+0.358874076,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-162.ec2.internal,}" Sep 17 14:02:15.003517 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.003465 2579 manager.go:354] Recovery completed Sep 17 14:02:15.004772 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.004749 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-84rvr" Sep 17 14:02:15.010512 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.010496 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:02:15.012646 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.012628 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:02:15.012722 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.012657 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:02:15.012722 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.012668 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:02:15.012722 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.012701 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-84rvr" Sep 17 14:02:15.013251 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.013233 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 14:02:15.013251 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.013249 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 14:02:15.013368 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.013265 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 17 14:02:15.013368 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.013265 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:02:15.014062 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.014041 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:02:15.014132 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.014075 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:02:15.014132 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.014089 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:02:15.014684 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.014604 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-162.ec2.internal.18d620970a613362 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-162.ec2.internal,UID:ip-10-0-141-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-162.ec2.internal,},FirstTimestamp:2026-09-17 14:02:15.012643682 +0000 UTC m=+0.390454680,LastTimestamp:2026-09-17 14:02:15.012643682 +0000 UTC m=+0.390454680,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-162.ec2.internal,}" Sep 17 14:02:15.014808 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.014791 2579 policy_none.go:49] "None policy: Start" Sep 17 14:02:15.014808 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.014812 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 14:02:15.014912 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.014826 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 14:02:15.016073 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.016054 2579 policy_none.go:47] "Start" Sep 17 14:02:15.039149 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.039133 2579 manager.go:337] "Starting Device Plugin manager" Sep 17 14:02:15.039276 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.039176 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 14:02:15.039276 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.039189 2579 server.go:87] "Starting device plugin registration server" Sep 17 14:02:15.039971 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.039451 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 14:02:15.039971 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.039466 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 14:02:15.039971 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.039683 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 14:02:15.039971 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.039761 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 14:02:15.039971 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.039769 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 14:02:15.040317 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.040283 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 14:02:15.040366 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.040338 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:15.115043 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.115011 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 14:02:15.116294 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.116273 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 14:02:15.116398 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.116332 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 14:02:15.116398 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.116358 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 14:02:15.116499 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.116414 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 14:02:15.118815 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.118788 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 14:02:15.140570 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.140553 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:02:15.141968 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.141952 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:02:15.142037 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.141980 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:02:15.142037 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.141997 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:02:15.142037 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.142019 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.150584 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.150568 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.150641 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.150595 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-162.ec2.internal\": node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:15.168040 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.167966 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:15.216880 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.216862 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"] Sep 17 14:02:15.216954 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.216919 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:02:15.217739 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.217726 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:02:15.217804 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.217751 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:02:15.217804 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.217761 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:02:15.219475 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.219464 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:02:15.219612 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.219597 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.219656 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.219634 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:02:15.220165 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.220149 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:02:15.220236 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.220171 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:02:15.220236 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.220180 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:02:15.220236 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.220153 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:02:15.220330 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.220254 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:02:15.220330 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.220267 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:02:15.221230 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.221217 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.221276 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.221241 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 14:02:15.221976 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.221960 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory" Sep 17 14:02:15.222057 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.221984 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 14:02:15.222057 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.221993 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID" Sep 17 14:02:15.250177 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.250157 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-162.ec2.internal\" not found" node="ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.253464 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.253450 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-162.ec2.internal\" not found" node="ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.268313 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.268295 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:15.294328 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.294307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/383749b6af26f4e890dc51b6c5faa10a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"383749b6af26f4e890dc51b6c5faa10a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.294379 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.294330 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/383749b6af26f4e890dc51b6c5faa10a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"383749b6af26f4e890dc51b6c5faa10a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.294379 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.294352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49ae931469b3a9145df59c7a406661a1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-162.ec2.internal\" (UID: \"49ae931469b3a9145df59c7a406661a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.368560 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.368516 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:15.394927 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.394903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49ae931469b3a9145df59c7a406661a1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-162.ec2.internal\" (UID: \"49ae931469b3a9145df59c7a406661a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.394985 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.394932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/383749b6af26f4e890dc51b6c5faa10a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"383749b6af26f4e890dc51b6c5faa10a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.394985 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.394953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/383749b6af26f4e890dc51b6c5faa10a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"383749b6af26f4e890dc51b6c5faa10a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.395057 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.395014 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/383749b6af26f4e890dc51b6c5faa10a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"383749b6af26f4e890dc51b6c5faa10a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.395057 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.395017 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49ae931469b3a9145df59c7a406661a1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-162.ec2.internal\" (UID: \"49ae931469b3a9145df59c7a406661a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.395057 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.395039 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/383749b6af26f4e890dc51b6c5faa10a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"383749b6af26f4e890dc51b6c5faa10a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.469219 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.469140 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:15.552711 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.552665 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.556839 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.556518 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" Sep 17 14:02:15.569481 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.569461 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:15.669967 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.669937 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:15.770487 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.770414 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:15.870954 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.870920 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:15.930416 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.930388 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 14:02:15.930897 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:15.930573 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 14:02:15.971841 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:15.971816 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:16.017685 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.017649 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 13:57:16 +0000 UTC" deadline="2028-04-23 06:24:48.244504703 +0000 UTC" Sep 17 14:02:16.017685 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.017679 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14008h22m32.226828886s" Sep 17 14:02:16.072143 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:16.071922 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found" Sep 17 14:02:16.099904 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.099874 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 14:02:16.123395 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:16.123361 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ae931469b3a9145df59c7a406661a1.slice/crio-4e2ee007439c845802b438c5e27d3432fd9c897296057b23ec4f2b1350fe2d9a WatchSource:0}: Error finding container 4e2ee007439c845802b438c5e27d3432fd9c897296057b23ec4f2b1350fe2d9a: Status 404 returned error can't find the container with id 4e2ee007439c845802b438c5e27d3432fd9c897296057b23ec4f2b1350fe2d9a Sep 17 14:02:16.127464 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.127446 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 14:02:16.151444 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:16.151415 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383749b6af26f4e890dc51b6c5faa10a.slice/crio-8be6555c109861019fee192a1c7f0b33585281ec684a1a70d8cd8cd996da8aa4 WatchSource:0}: Error finding container 8be6555c109861019fee192a1c7f0b33585281ec684a1a70d8cd8cd996da8aa4: Status 404 returned error can't find the container with id 8be6555c109861019fee192a1c7f0b33585281ec684a1a70d8cd8cd996da8aa4 Sep 17 14:02:16.192163 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.192136 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" Sep 17 14:02:16.205134 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.205114 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 14:02:16.206653 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.206637 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" Sep 17 14:02:16.213206 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.213188 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 14:02:16.427191 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.427131 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 14:02:16.560409 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.560383 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 14:02:16.871543 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.871447 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 14:02:16.969450 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.969419 2579 apiserver.go:52] "Watching apiserver" Sep 17 14:02:16.975864 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.975711 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 14:02:16.976186 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.976159 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal","openshift-multus/multus-additional-cni-plugins-mrmcc","openshift-multus/network-metrics-daemon-xs7g2","openshift-network-diagnostics/network-check-target-ztd5n","openshift-network-operator/iptables-alerter-n466b","openshift-ovn-kubernetes/ovnkube-node-lclzj","kube-system/global-pull-secret-syncer-t2b6c","kube-system/konnectivity-agent-zsgrc","kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68","openshift-cluster-node-tuning-operator/tuned-l2fst","openshift-dns/node-resolver-hvzjz","openshift-image-registry/node-ca-t8gbj","openshift-multus/multus-2x9fn"] Sep 17 14:02:16.977889 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.977862 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:16.978018 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:16.977992 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:16.978977 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.978957 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:16.980434 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.980412 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:16.980523 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:16.980480 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:16.982212 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.981472 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 14:02:16.982212 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.981690 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 14:02:16.982212 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.981895 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2h928\"" Sep 17 14:02:16.982212 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.982125 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:16.982212 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:16.982178 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:16.983710 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.983331 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2x9fn" Sep 17 14:02:16.984807 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.984791 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:16.985277 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.985255 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 14:02:16.985467 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.985452 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 14:02:16.986121 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.986079 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 14:02:16.986121 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.986106 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4fjnj\"" Sep 17 14:02:16.986256 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.986144 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 14:02:16.986753 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.986736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:16.987358 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.987306 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 14:02:16.987358 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.987319 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 14:02:16.987685 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.987671 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 14:02:16.988494 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.988475 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8gbj" Sep 17 14:02:16.989910 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.989887 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 14:02:16.990027 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.990001 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 14:02:16.990077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.990035 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 14:02:16.990148 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.990135 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ccxmz\"" Sep 17 14:02:16.990791 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.990773 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 14:02:16.991042 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.991022 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ddwrf\"" Sep 17 14:02:16.991231 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.991207 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 14:02:16.991304 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.991231 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:16.991375 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.991359 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 14:02:16.992069 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.992041 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bgqxh\"" Sep 17 14:02:16.992281 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.992262 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 14:02:16.992420 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.992403 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 14:02:16.992481 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.992463 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 14:02:16.992810 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.992791 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:16.993332 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.993314 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 14:02:16.993784 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.993765 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 14:02:16.993902 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.993880 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mx6v7\"" Sep 17 14:02:16.994335 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.994037 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hvzjz" Sep 17 14:02:16.995266 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.995227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n466b" Sep 17 14:02:16.996826 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.996804 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 14:02:16.997163 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.997147 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 14:02:16.999876 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:16.999854 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gmxbw\"" Sep 17 14:02:17.000281 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.000261 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 14:02:17.001330 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-sysctl-conf\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.001410 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001365 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-tuned\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.001468 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ae198e7-1043-433e-96b8-1e5218562f8c-cnibin\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.001468 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb-konnectivity-ca\") pod \"konnectivity-agent-zsgrc\" (UID: \"80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb\") " pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:17.001582 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-daemon-config\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.001582 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-kubelet\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.001582 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-node-log\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.001711 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001633 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xstn\" (UniqueName: \"kubernetes.io/projected/ccee8267-a695-4631-a023-f61378ce1aa8-kube-api-access-9xstn\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.001711 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001673 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-dbus\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:17.001711 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b1a09ac-ddc5-4347-ae5d-c72914a28f8c-serviceca\") pod \"node-ca-t8gbj\" (UID: \"0b1a09ac-ddc5-4347-ae5d-c72914a28f8c\") " pod="openshift-image-registry/node-ca-t8gbj" Sep 17 14:02:17.001843 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001740 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-sysconfig\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.001843 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001776 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-lib-modules\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.001843 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-cnibin\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.001971 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcdnr\" (UniqueName: \"kubernetes.io/projected/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-kube-api-access-vcdnr\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.001971 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-etc-openvswitch\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.001971 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6ae198e7-1043-433e-96b8-1e5218562f8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.001971 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001948 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-device-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.002173 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.001980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-systemd\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.002173 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-var-lib-kubelet\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.002173 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-run-openvswitch\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.002173 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-cni-bin\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.002173 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ae198e7-1043-433e-96b8-1e5218562f8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.002173 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002120 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 14:02:17.002425 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002190 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 14:02:17.002425 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:17.002425 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b1a09ac-ddc5-4347-ae5d-c72914a28f8c-host\") pod \"node-ca-t8gbj\" (UID: \"0b1a09ac-ddc5-4347-ae5d-c72914a28f8c\") " pod="openshift-image-registry/node-ca-t8gbj" Sep 17 14:02:17.002425 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r968g\" (UniqueName: \"kubernetes.io/projected/0b1a09ac-ddc5-4347-ae5d-c72914a28f8c-kube-api-access-r968g\") pod \"node-ca-t8gbj\" (UID: \"0b1a09ac-ddc5-4347-ae5d-c72914a28f8c\") " pod="openshift-image-registry/node-ca-t8gbj" Sep 17 14:02:17.002619 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-socket-dir-parent\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.002619 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002480 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-run-netns\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.002619 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-run-netns\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.002755 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.002755 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-registration-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.002755 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002698 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ngrzl\"" Sep 17 14:02:17.002879 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-systemd-units\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.002929 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-sys-fs\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.002978 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-modprobe-d\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.003026 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-var-lib-cni-bin\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.003073 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.003183 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-log-socket\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.003226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.003411 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpzvd\" (UniqueName: \"kubernetes.io/projected/b1ed4845-4158-433b-98a6-a26e39e937f2-kube-api-access-bpzvd\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.003444 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-system-cni-dir\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.003472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-hostroot\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.003493 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.003517 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d62cf\"" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.002035 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.003499 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb-agent-certs\") pod \"konnectivity-agent-zsgrc\" (UID: \"80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb\") " pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.003806 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-sys\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccee8267-a695-4631-a023-f61378ce1aa8-ovn-node-metrics-cert\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-run-k8s-cni-cncf-io\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004364 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-conf-dir\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-run-multus-certs\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.004513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004565 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-kubelet-config\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/630dbd91-2a35-4ff7-9d36-6444a6463349-tmp\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-cni-netd\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccee8267-a695-4631-a023-f61378ce1aa8-env-overrides\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ae198e7-1043-433e-96b8-1e5218562f8c-system-cni-dir\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004743 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-var-lib-kubelet\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004768 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-var-lib-cni-multus\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-run-systemd\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004892 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6ae198e7-1043-433e-96b8-1e5218562f8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004936 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-kubernetes\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.004992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-cni-dir\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-cni-binary-copy\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-etc-kubernetes\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005085 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-var-lib-openvswitch\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005112 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-run-ovn\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.005295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpbgd\" (UniqueName: \"kubernetes.io/projected/6ae198e7-1043-433e-96b8-1e5218562f8c-kube-api-access-xpbgd\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005234 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-run\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdl4m\" (UniqueName: \"kubernetes.io/projected/630dbd91-2a35-4ff7-9d36-6444a6463349-kube-api-access-vdl4m\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-slash\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccee8267-a695-4631-a023-f61378ce1aa8-ovnkube-config\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-socket-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkjkw\" (UniqueName: \"kubernetes.io/projected/11c9baa0-1192-4bca-a430-9b2fd7484dd7-kube-api-access-wkjkw\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-sysctl-d\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-host\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5vzt\" (UniqueName: \"kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt\") pod \"network-check-target-ztd5n\" (UID: \"5ce55ebb-3f80-4447-942c-ffe73e59a5e0\") " pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccee8267-a695-4631-a023-f61378ce1aa8-ovnkube-script-lib\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.006077 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.005704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ae198e7-1043-433e-96b8-1e5218562f8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.034175 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.034154 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 14:02:17.081678 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.081634 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7z8zf" Sep 17 14:02:17.088868 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.088846 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7z8zf" Sep 17 14:02:17.093054 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.092990 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 14:02:17.106127 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-sysctl-d\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.106233 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-host\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.106233 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5vzt\" (UniqueName: \"kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt\") pod \"network-check-target-ztd5n\" (UID: \"5ce55ebb-3f80-4447-942c-ffe73e59a5e0\") " pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:17.106233 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccee8267-a695-4631-a023-f61378ce1aa8-ovnkube-script-lib\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.106233 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ae198e7-1043-433e-96b8-1e5218562f8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.106440 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3200be8a-6fdd-4af6-9129-f4e1075f110f-iptables-alerter-script\") pod \"iptables-alerter-n466b\" (UID: \"3200be8a-6fdd-4af6-9129-f4e1075f110f\") " pod="openshift-network-operator/iptables-alerter-n466b" Sep 17 14:02:17.106440 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106272 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-sysctl-conf\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.106440 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106296 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-sysctl-d\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.106440 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-tuned\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.106440 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ae198e7-1043-433e-96b8-1e5218562f8c-cnibin\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.106440 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb-konnectivity-ca\") pod \"konnectivity-agent-zsgrc\" (UID: \"80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb\") " pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:17.106440 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcd68\" (UniqueName: \"kubernetes.io/projected/afc19d28-6130-48cf-9c98-fb7322afb2a4-kube-api-access-gcd68\") pod \"node-resolver-hvzjz\" (UID: \"afc19d28-6130-48cf-9c98-fb7322afb2a4\") " pod="openshift-dns/node-resolver-hvzjz" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-daemon-config\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-kubelet\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-node-log\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xstn\" (UniqueName: \"kubernetes.io/projected/ccee8267-a695-4631-a023-f61378ce1aa8-kube-api-access-9xstn\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106575 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-dbus\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b1a09ac-ddc5-4347-ae5d-c72914a28f8c-serviceca\") pod \"node-ca-t8gbj\" (UID: \"0b1a09ac-ddc5-4347-ae5d-c72914a28f8c\") " pod="openshift-image-registry/node-ca-t8gbj" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afc19d28-6130-48cf-9c98-fb7322afb2a4-hosts-file\") pod \"node-resolver-hvzjz\" (UID: \"afc19d28-6130-48cf-9c98-fb7322afb2a4\") " pod="openshift-dns/node-resolver-hvzjz" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106647 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-sysconfig\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-lib-modules\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-cnibin\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdnr\" (UniqueName: \"kubernetes.io/projected/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-kube-api-access-vcdnr\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-etc-openvswitch\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.106790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6ae198e7-1043-433e-96b8-1e5218562f8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-device-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106834 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jt48\" (UniqueName: \"kubernetes.io/projected/3200be8a-6fdd-4af6-9129-f4e1075f110f-kube-api-access-5jt48\") pod \"iptables-alerter-n466b\" (UID: \"3200be8a-6fdd-4af6-9129-f4e1075f110f\") " pod="openshift-network-operator/iptables-alerter-n466b" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-systemd\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-var-lib-kubelet\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-run-openvswitch\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-cni-bin\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ae198e7-1043-433e-96b8-1e5218562f8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.106997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b1a09ac-ddc5-4347-ae5d-c72914a28f8c-host\") pod \"node-ca-t8gbj\" (UID: \"0b1a09ac-ddc5-4347-ae5d-c72914a28f8c\") " pod="openshift-image-registry/node-ca-t8gbj" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r968g\" (UniqueName: \"kubernetes.io/projected/0b1a09ac-ddc5-4347-ae5d-c72914a28f8c-kube-api-access-r968g\") pod \"node-ca-t8gbj\" (UID: \"0b1a09ac-ddc5-4347-ae5d-c72914a28f8c\") " pod="openshift-image-registry/node-ca-t8gbj" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-socket-dir-parent\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-run-netns\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-run-netns\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107155 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107179 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-registration-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.107378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-systemd-units\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-sys-fs\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-modprobe-d\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107282 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccee8267-a695-4631-a023-f61378ce1aa8-ovnkube-script-lib\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107322 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-device-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-host\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107383 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-run-openvswitch\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-var-lib-kubelet\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107412 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ae198e7-1043-433e-96b8-1e5218562f8c-cnibin\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-var-lib-cni-bin\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107659 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ae198e7-1043-433e-96b8-1e5218562f8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-log-socket\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpzvd\" (UniqueName: \"kubernetes.io/projected/b1ed4845-4158-433b-98a6-a26e39e937f2-kube-api-access-bpzvd\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-system-cni-dir\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-hostroot\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb-agent-certs\") pod \"konnectivity-agent-zsgrc\" (UID: \"80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb\") " pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:17.108205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-sys\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccee8267-a695-4631-a023-f61378ce1aa8-ovn-node-metrics-cert\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-run-k8s-cni-cncf-io\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-conf-dir\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-run-multus-certs\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107950 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-kubelet-config\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/630dbd91-2a35-4ff7-9d36-6444a6463349-tmp\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107983 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3200be8a-6fdd-4af6-9129-f4e1075f110f-host-slash\") pod \"iptables-alerter-n466b\" (UID: \"3200be8a-6fdd-4af6-9129-f4e1075f110f\") " pod="openshift-network-operator/iptables-alerter-n466b" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107984 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ae198e7-1043-433e-96b8-1e5218562f8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-cni-netd\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108017 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccee8267-a695-4631-a023-f61378ce1aa8-env-overrides\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108033 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ae198e7-1043-433e-96b8-1e5218562f8c-system-cni-dir\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108037 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-etc-openvswitch\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-var-lib-kubelet\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:17.108100 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108126 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-log-socket\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.108993 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108104 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-systemd\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-var-lib-cni-multus\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-run-systemd\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108158 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-var-lib-cni-multus\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6ae198e7-1043-433e-96b8-1e5218562f8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108158 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-daemon-config\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-kubernetes\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-cni-dir\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108200 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-kubelet\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-cni-binary-copy\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-etc-kubernetes\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108246 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-node-log\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108338 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-var-lib-openvswitch\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b1a09ac-ddc5-4347-ae5d-c72914a28f8c-host\") pod \"node-ca-t8gbj\" (UID: \"0b1a09ac-ddc5-4347-ae5d-c72914a28f8c\") " pod="openshift-image-registry/node-ca-t8gbj" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108471 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-system-cni-dir\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108482 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-socket-dir-parent\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108496 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-hostroot\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.109887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108502 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-dbus\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108551 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-run-k8s-cni-cncf-io\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108558 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-run-netns\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108584 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-run-multus-certs\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108573 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-cni-bin\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108600 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-conf-dir\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108610 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108615 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6ae198e7-1043-433e-96b8-1e5218562f8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108639 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108645 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108658 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-var-lib-cni-bin\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108665 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-kubelet-config\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108696 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-cni-netd\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-registration-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108709 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-sysconfig\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.107996 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb-konnectivity-ca\") pod \"konnectivity-agent-zsgrc\" (UID: \"80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb\") " pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108762 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-sys-fs\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.110762 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108835 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-lib-modules\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108837 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-modprobe-d\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108104 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-var-lib-kubelet\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108901 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0b1a09ac-ddc5-4347-ae5d-c72914a28f8c-serviceca\") pod \"node-ca-t8gbj\" (UID: \"0b1a09ac-ddc5-4347-ae5d-c72914a28f8c\") " pod="openshift-image-registry/node-ca-t8gbj" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108910 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-cnibin\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108945 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-host-run-netns\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-var-lib-openvswitch\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108984 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-run-ovn\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.108987 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccee8267-a695-4631-a023-f61378ce1aa8-env-overrides\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109008 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpbgd\" (UniqueName: \"kubernetes.io/projected/6ae198e7-1043-433e-96b8-1e5218562f8c-kube-api-access-xpbgd\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109033 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-systemd-units\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109033 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-run\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:17.109096 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdl4m\" (UniqueName: \"kubernetes.io/projected/630dbd91-2a35-4ff7-9d36-6444a6463349-kube-api-access-vdl4m\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-slash\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:17.109159 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs podName:11c9baa0-1192-4bca-a430-9b2fd7484dd7 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:17.609137734 +0000 UTC m=+2.986948734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs") pod "network-metrics-daemon-xs7g2" (UID: "11c9baa0-1192-4bca-a430-9b2fd7484dd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:17.111668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109168 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-host-slash\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccee8267-a695-4631-a023-f61378ce1aa8-ovnkube-config\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109214 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ae198e7-1043-433e-96b8-1e5218562f8c-system-cni-dir\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-socket-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkjkw\" (UniqueName: \"kubernetes.io/projected/11c9baa0-1192-4bca-a430-9b2fd7484dd7-kube-api-access-wkjkw\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109260 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-run-systemd\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc19d28-6130-48cf-9c98-fb7322afb2a4-tmp-dir\") pod \"node-resolver-hvzjz\" (UID: \"afc19d28-6130-48cf-9c98-fb7322afb2a4\") " pod="openshift-dns/node-resolver-hvzjz" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:17.109307 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret podName:f57bcf14-b8f2-4f1b-a64a-c32bf6d87743 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:17.609288352 +0000 UTC m=+2.987099345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret") pod "global-pull-secret-syncer-t2b6c" (UID: "f57bcf14-b8f2-4f1b-a64a-c32bf6d87743") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109366 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-kubernetes\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109368 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-sysctl-conf\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109424 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-etc-kubernetes\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccee8267-a695-4631-a023-f61378ce1aa8-run-ovn\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109673 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-cni-binary-copy\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109685 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-multus-cni-dir\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109735 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-sys\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109850 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b1ed4845-4158-433b-98a6-a26e39e937f2-socket-dir\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109889 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6ae198e7-1043-433e-96b8-1e5218562f8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.112462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.109968 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/630dbd91-2a35-4ff7-9d36-6444a6463349-run\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.113132 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.110199 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccee8267-a695-4631-a023-f61378ce1aa8-ovnkube-config\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.113132 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.111467 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb-agent-certs\") pod \"konnectivity-agent-zsgrc\" (UID: \"80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb\") " pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:17.113132 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.112072 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/630dbd91-2a35-4ff7-9d36-6444a6463349-tmp\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.113132 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.112650 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccee8267-a695-4631-a023-f61378ce1aa8-ovn-node-metrics-cert\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.113132 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.113108 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/630dbd91-2a35-4ff7-9d36-6444a6463349-etc-tuned\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.118041 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:17.118011 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:02:17.118041 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:17.118038 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:02:17.118203 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:17.118051 2579 projected.go:196] Error preparing data for projected volume kube-api-access-s5vzt for pod openshift-network-diagnostics/network-check-target-ztd5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:17.118203 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:17.118116 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt podName:5ce55ebb-3f80-4447-942c-ffe73e59a5e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:17.61809773 +0000 UTC m=+2.995908732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s5vzt" (UniqueName: "kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt") pod "network-check-target-ztd5n" (UID: "5ce55ebb-3f80-4447-942c-ffe73e59a5e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:17.119711 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.119646 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpzvd\" (UniqueName: \"kubernetes.io/projected/b1ed4845-4158-433b-98a6-a26e39e937f2-kube-api-access-bpzvd\") pod \"aws-ebs-csi-driver-node-wph68\" (UID: \"b1ed4845-4158-433b-98a6-a26e39e937f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.119711 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.119682 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcdnr\" (UniqueName: \"kubernetes.io/projected/6d19c6d2-15a4-4b4b-a801-82a2be0ea93a-kube-api-access-vcdnr\") pod \"multus-2x9fn\" (UID: \"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a\") " pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.121875 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.121770 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpbgd\" (UniqueName: \"kubernetes.io/projected/6ae198e7-1043-433e-96b8-1e5218562f8c-kube-api-access-xpbgd\") pod \"multus-additional-cni-plugins-mrmcc\" (UID: \"6ae198e7-1043-433e-96b8-1e5218562f8c\") " pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.121875 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.121810 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkjkw\" (UniqueName: \"kubernetes.io/projected/11c9baa0-1192-4bca-a430-9b2fd7484dd7-kube-api-access-wkjkw\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:17.122170 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.122148 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xstn\" (UniqueName: \"kubernetes.io/projected/ccee8267-a695-4631-a023-f61378ce1aa8-kube-api-access-9xstn\") pod \"ovnkube-node-lclzj\" (UID: \"ccee8267-a695-4631-a023-f61378ce1aa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.122303 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.122184 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdl4m\" (UniqueName: \"kubernetes.io/projected/630dbd91-2a35-4ff7-9d36-6444a6463349-kube-api-access-vdl4m\") pod \"tuned-l2fst\" (UID: \"630dbd91-2a35-4ff7-9d36-6444a6463349\") " pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.123486 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.123467 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r968g\" (UniqueName: \"kubernetes.io/projected/0b1a09ac-ddc5-4347-ae5d-c72914a28f8c-kube-api-access-r968g\") pod \"node-ca-t8gbj\" (UID: \"0b1a09ac-ddc5-4347-ae5d-c72914a28f8c\") " pod="openshift-image-registry/node-ca-t8gbj" Sep 17 14:02:17.123879 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.123831 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" event={"ID":"383749b6af26f4e890dc51b6c5faa10a","Type":"ContainerStarted","Data":"8be6555c109861019fee192a1c7f0b33585281ec684a1a70d8cd8cd996da8aa4"} Sep 17 14:02:17.125265 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.125165 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" event={"ID":"49ae931469b3a9145df59c7a406661a1","Type":"ContainerStarted","Data":"4e2ee007439c845802b438c5e27d3432fd9c897296057b23ec4f2b1350fe2d9a"} Sep 17 14:02:17.210612 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.210566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jt48\" (UniqueName: \"kubernetes.io/projected/3200be8a-6fdd-4af6-9129-f4e1075f110f-kube-api-access-5jt48\") pod \"iptables-alerter-n466b\" (UID: \"3200be8a-6fdd-4af6-9129-f4e1075f110f\") " pod="openshift-network-operator/iptables-alerter-n466b" Sep 17 14:02:17.210777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.210663 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3200be8a-6fdd-4af6-9129-f4e1075f110f-host-slash\") pod \"iptables-alerter-n466b\" (UID: \"3200be8a-6fdd-4af6-9129-f4e1075f110f\") " pod="openshift-network-operator/iptables-alerter-n466b" Sep 17 14:02:17.210777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.210712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc19d28-6130-48cf-9c98-fb7322afb2a4-tmp-dir\") pod \"node-resolver-hvzjz\" (UID: \"afc19d28-6130-48cf-9c98-fb7322afb2a4\") " pod="openshift-dns/node-resolver-hvzjz" Sep 17 14:02:17.210777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.210748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3200be8a-6fdd-4af6-9129-f4e1075f110f-iptables-alerter-script\") pod \"iptables-alerter-n466b\" (UID: \"3200be8a-6fdd-4af6-9129-f4e1075f110f\") " pod="openshift-network-operator/iptables-alerter-n466b" Sep 17 14:02:17.210777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.210775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcd68\" (UniqueName: \"kubernetes.io/projected/afc19d28-6130-48cf-9c98-fb7322afb2a4-kube-api-access-gcd68\") pod \"node-resolver-hvzjz\" (UID: \"afc19d28-6130-48cf-9c98-fb7322afb2a4\") " pod="openshift-dns/node-resolver-hvzjz" Sep 17 14:02:17.210969 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.210793 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3200be8a-6fdd-4af6-9129-f4e1075f110f-host-slash\") pod \"iptables-alerter-n466b\" (UID: \"3200be8a-6fdd-4af6-9129-f4e1075f110f\") " pod="openshift-network-operator/iptables-alerter-n466b" Sep 17 14:02:17.210969 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.210802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afc19d28-6130-48cf-9c98-fb7322afb2a4-hosts-file\") pod \"node-resolver-hvzjz\" (UID: \"afc19d28-6130-48cf-9c98-fb7322afb2a4\") " pod="openshift-dns/node-resolver-hvzjz" Sep 17 14:02:17.210969 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.210934 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afc19d28-6130-48cf-9c98-fb7322afb2a4-hosts-file\") pod \"node-resolver-hvzjz\" (UID: \"afc19d28-6130-48cf-9c98-fb7322afb2a4\") " pod="openshift-dns/node-resolver-hvzjz" Sep 17 14:02:17.211224 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.211191 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afc19d28-6130-48cf-9c98-fb7322afb2a4-tmp-dir\") pod \"node-resolver-hvzjz\" (UID: \"afc19d28-6130-48cf-9c98-fb7322afb2a4\") " pod="openshift-dns/node-resolver-hvzjz" Sep 17 14:02:17.211375 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.211356 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3200be8a-6fdd-4af6-9129-f4e1075f110f-iptables-alerter-script\") pod \"iptables-alerter-n466b\" (UID: \"3200be8a-6fdd-4af6-9129-f4e1075f110f\") " pod="openshift-network-operator/iptables-alerter-n466b" Sep 17 14:02:17.224620 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.224596 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jt48\" (UniqueName: \"kubernetes.io/projected/3200be8a-6fdd-4af6-9129-f4e1075f110f-kube-api-access-5jt48\") pod \"iptables-alerter-n466b\" (UID: \"3200be8a-6fdd-4af6-9129-f4e1075f110f\") " pod="openshift-network-operator/iptables-alerter-n466b" Sep 17 14:02:17.226404 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.226383 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcd68\" (UniqueName: \"kubernetes.io/projected/afc19d28-6130-48cf-9c98-fb7322afb2a4-kube-api-access-gcd68\") pod \"node-resolver-hvzjz\" (UID: \"afc19d28-6130-48cf-9c98-fb7322afb2a4\") " pod="openshift-dns/node-resolver-hvzjz" Sep 17 14:02:17.295819 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.295794 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l2fst" Sep 17 14:02:17.306716 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.306693 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2x9fn" Sep 17 14:02:17.315719 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.315696 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" Sep 17 14:02:17.321336 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.321316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:17.328916 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.328897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:17.336490 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.336472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8gbj" Sep 17 14:02:17.346039 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.346016 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mrmcc" Sep 17 14:02:17.352671 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.352650 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hvzjz" Sep 17 14:02:17.355286 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:17.355267 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n466b" Sep 17 14:02:19.063421 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.063331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:19.063421 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.063413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:19.063634 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:19.063500 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:19.063634 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:19.063518 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:19.063634 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:19.063573 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret podName:f57bcf14-b8f2-4f1b-a64a-c32bf6d87743 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:20.063555359 +0000 UTC m=+3.991532804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret") pod "global-pull-secret-syncer-t2b6c" (UID: "f57bcf14-b8f2-4f1b-a64a-c32bf6d87743") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:19.063634 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:19.063588 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs podName:11c9baa0-1192-4bca-a430-9b2fd7484dd7 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:20.063581957 +0000 UTC m=+3.991559401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs") pod "network-metrics-daemon-xs7g2" (UID: "11c9baa0-1192-4bca-a430-9b2fd7484dd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:19.163832 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.163804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5vzt\" (UniqueName: \"kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt\") pod \"network-check-target-ztd5n\" (UID: \"5ce55ebb-3f80-4447-942c-ffe73e59a5e0\") " pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:19.163977 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:19.163961 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:02:19.164013 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:19.163983 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:02:19.164013 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:19.163992 2579 projected.go:196] Error preparing data for projected volume kube-api-access-s5vzt for pod openshift-network-diagnostics/network-check-target-ztd5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:19.164073 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:19.164042 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt podName:5ce55ebb-3f80-4447-942c-ffe73e59a5e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:20.164027035 +0000 UTC m=+4.092004483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5vzt" (UniqueName: "kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt") pod "network-check-target-ztd5n" (UID: "5ce55ebb-3f80-4447-942c-ffe73e59a5e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:19.498435 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:19.498399 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630dbd91_2a35_4ff7_9d36_6444a6463349.slice/crio-ba7e32d655ac8cd95efe0129ad9e22e17553ae6956dce7adc686590de69a10df WatchSource:0}: Error finding container ba7e32d655ac8cd95efe0129ad9e22e17553ae6956dce7adc686590de69a10df: Status 404 returned error can't find the container with id ba7e32d655ac8cd95efe0129ad9e22e17553ae6956dce7adc686590de69a10df Sep 17 14:02:19.513175 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:19.513142 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ed4845_4158_433b_98a6_a26e39e937f2.slice/crio-cf7bc03d27894fa89ae6188157bb98f29927e64ece6919df809b7c1bf953833d WatchSource:0}: Error finding container cf7bc03d27894fa89ae6188157bb98f29927e64ece6919df809b7c1bf953833d: Status 404 returned error can't find the container with id cf7bc03d27894fa89ae6188157bb98f29927e64ece6919df809b7c1bf953833d Sep 17 14:02:19.513855 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:19.513809 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c8b6bc_2e0e_4d2e_85da_b5a1aa6b34bb.slice/crio-1729a252a200379b10103adbce8c7db9cf59705cbef161cf81317bde393a4343 WatchSource:0}: Error finding container 1729a252a200379b10103adbce8c7db9cf59705cbef161cf81317bde393a4343: Status 404 returned error can't find the container with id 1729a252a200379b10103adbce8c7db9cf59705cbef161cf81317bde393a4343 Sep 17 14:02:19.515246 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:19.515229 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d19c6d2_15a4_4b4b_a801_82a2be0ea93a.slice/crio-c7769b41a8398f4a9641170f43f61b374d662e5429d17d17f0c6b269185fa646 WatchSource:0}: Error finding container c7769b41a8398f4a9641170f43f61b374d662e5429d17d17f0c6b269185fa646: Status 404 returned error can't find the container with id c7769b41a8398f4a9641170f43f61b374d662e5429d17d17f0c6b269185fa646 Sep 17 14:02:19.516178 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:19.516099 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3200be8a_6fdd_4af6_9129_f4e1075f110f.slice/crio-e393950cf93502aa616faf942b332c5fc2012ecbb224dd84c5775bf47d76e4a2 WatchSource:0}: Error finding container e393950cf93502aa616faf942b332c5fc2012ecbb224dd84c5775bf47d76e4a2: Status 404 returned error can't find the container with id e393950cf93502aa616faf942b332c5fc2012ecbb224dd84c5775bf47d76e4a2 Sep 17 14:02:19.517521 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:19.517471 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae198e7_1043_433e_96b8_1e5218562f8c.slice/crio-730ada148693d8e1a1e413d37866eb15149b22a56587a08a7e6ea90435dec20b WatchSource:0}: Error finding container 730ada148693d8e1a1e413d37866eb15149b22a56587a08a7e6ea90435dec20b: Status 404 returned error can't find the container with id 730ada148693d8e1a1e413d37866eb15149b22a56587a08a7e6ea90435dec20b Sep 17 14:02:19.519028 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:19.518954 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccee8267_a695_4631_a023_f61378ce1aa8.slice/crio-d6fa3f8b85f37a90097150826448d103cf49688e7dae8f43f57736baed2d84a7 WatchSource:0}: Error finding container d6fa3f8b85f37a90097150826448d103cf49688e7dae8f43f57736baed2d84a7: Status 404 returned error can't find the container with id d6fa3f8b85f37a90097150826448d103cf49688e7dae8f43f57736baed2d84a7 Sep 17 14:02:19.519818 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:19.519429 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1a09ac_ddc5_4347_ae5d_c72914a28f8c.slice/crio-b1d248e8d6f583d922397fa19a2a85c7c0889f0739f5a9b2b2851b2038eccd12 WatchSource:0}: Error finding container b1d248e8d6f583d922397fa19a2a85c7c0889f0739f5a9b2b2851b2038eccd12: Status 404 returned error can't find the container with id b1d248e8d6f583d922397fa19a2a85c7c0889f0739f5a9b2b2851b2038eccd12 Sep 17 14:02:19.521573 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:19.521544 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafc19d28_6130_48cf_9c98_fb7322afb2a4.slice/crio-13b375df91c76ab6a8eb7b13d996b24373336d2d631a131a8df61b083062de7d WatchSource:0}: Error finding container 13b375df91c76ab6a8eb7b13d996b24373336d2d631a131a8df61b083062de7d: Status 404 returned error can't find the container with id 13b375df91c76ab6a8eb7b13d996b24373336d2d631a131a8df61b083062de7d Sep 17 14:02:19.540804 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.540780 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 13:57:18 +0000 UTC" deadline="2028-04-24 01:50:10.021509781 +0000 UTC" Sep 17 14:02:19.540878 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.540804 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14027h47m50.48070948s" Sep 17 14:02:19.566998 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.566977 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:19.567104 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:19.567085 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:19.577378 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.577338 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8gbj" event={"ID":"0b1a09ac-ddc5-4347-ae5d-c72914a28f8c","Type":"ContainerStarted","Data":"b1d248e8d6f583d922397fa19a2a85c7c0889f0739f5a9b2b2851b2038eccd12"} Sep 17 14:02:19.578668 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.578646 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2x9fn" event={"ID":"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a","Type":"ContainerStarted","Data":"c7769b41a8398f4a9641170f43f61b374d662e5429d17d17f0c6b269185fa646"} Sep 17 14:02:19.579807 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.579786 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" event={"ID":"b1ed4845-4158-433b-98a6-a26e39e937f2","Type":"ContainerStarted","Data":"cf7bc03d27894fa89ae6188157bb98f29927e64ece6919df809b7c1bf953833d"} Sep 17 14:02:19.580852 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.580823 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hvzjz" event={"ID":"afc19d28-6130-48cf-9c98-fb7322afb2a4","Type":"ContainerStarted","Data":"13b375df91c76ab6a8eb7b13d996b24373336d2d631a131a8df61b083062de7d"} Sep 17 14:02:19.582067 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.582040 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" event={"ID":"ccee8267-a695-4631-a023-f61378ce1aa8","Type":"ContainerStarted","Data":"d6fa3f8b85f37a90097150826448d103cf49688e7dae8f43f57736baed2d84a7"} Sep 17 14:02:19.583225 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.583198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mrmcc" event={"ID":"6ae198e7-1043-433e-96b8-1e5218562f8c","Type":"ContainerStarted","Data":"730ada148693d8e1a1e413d37866eb15149b22a56587a08a7e6ea90435dec20b"} Sep 17 14:02:19.584671 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.584650 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n466b" event={"ID":"3200be8a-6fdd-4af6-9129-f4e1075f110f","Type":"ContainerStarted","Data":"e393950cf93502aa616faf942b332c5fc2012ecbb224dd84c5775bf47d76e4a2"} Sep 17 14:02:19.585764 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.585742 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zsgrc" event={"ID":"80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb","Type":"ContainerStarted","Data":"1729a252a200379b10103adbce8c7db9cf59705cbef161cf81317bde393a4343"} Sep 17 14:02:19.587017 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:19.586993 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l2fst" event={"ID":"630dbd91-2a35-4ff7-9d36-6444a6463349","Type":"ContainerStarted","Data":"ba7e32d655ac8cd95efe0129ad9e22e17553ae6956dce7adc686590de69a10df"} Sep 17 14:02:20.072640 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:20.072558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:20.072804 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:20.072642 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:20.072804 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:20.072755 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:20.072915 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:20.072811 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret podName:f57bcf14-b8f2-4f1b-a64a-c32bf6d87743 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:22.072793373 +0000 UTC m=+6.000770832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret") pod "global-pull-secret-syncer-t2b6c" (UID: "f57bcf14-b8f2-4f1b-a64a-c32bf6d87743") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:20.072915 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:20.072873 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:20.073021 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:20.072964 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs podName:11c9baa0-1192-4bca-a430-9b2fd7484dd7 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:22.072935072 +0000 UTC m=+6.000912521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs") pod "network-metrics-daemon-xs7g2" (UID: "11c9baa0-1192-4bca-a430-9b2fd7484dd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:20.174512 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:20.173853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5vzt\" (UniqueName: \"kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt\") pod \"network-check-target-ztd5n\" (UID: \"5ce55ebb-3f80-4447-942c-ffe73e59a5e0\") " pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:20.174512 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:20.174042 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:02:20.174512 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:20.174062 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:02:20.174512 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:20.174075 2579 projected.go:196] Error preparing data for projected volume kube-api-access-s5vzt for pod openshift-network-diagnostics/network-check-target-ztd5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:20.174512 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:20.174125 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt podName:5ce55ebb-3f80-4447-942c-ffe73e59a5e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:22.174108203 +0000 UTC m=+6.102085651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5vzt" (UniqueName: "kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt") pod "network-check-target-ztd5n" (UID: "5ce55ebb-3f80-4447-942c-ffe73e59a5e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:20.541619 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:20.541535 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 13:57:18 +0000 UTC" deadline="2028-02-18 13:02:24.306871317 +0000 UTC" Sep 17 14:02:20.541619 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:20.541578 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12455h0m3.76529823s" Sep 17 14:02:20.579104 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:20.579025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:20.579271 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:20.579143 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:20.579609 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:20.579547 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:20.579690 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:20.579648 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:20.597205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:20.597172 2579 generic.go:356] "Generic (PLEG): container finished" podID="383749b6af26f4e890dc51b6c5faa10a" containerID="42f8a9788145e95e5632c451e0dbd7876a2cb82108bdea2509b9fc40f60983d2" exitCode=0 Sep 17 14:02:20.597347 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:20.597214 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" event={"ID":"383749b6af26f4e890dc51b6c5faa10a","Type":"ContainerDied","Data":"42f8a9788145e95e5632c451e0dbd7876a2cb82108bdea2509b9fc40f60983d2"} Sep 17 14:02:20.610457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:20.610381 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" event={"ID":"49ae931469b3a9145df59c7a406661a1","Type":"ContainerStarted","Data":"d7f1d78570f2f29b6ee7305a356d025e5717499265e1ab08ed33668945f08e46"} Sep 17 14:02:20.625899 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:20.625750 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" podStartSLOduration=3.62573101 podStartE2EDuration="3.62573101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:20.62557153 +0000 UTC m=+4.553548999" watchObservedRunningTime="2026-09-17 14:02:20.62573101 +0000 UTC m=+4.553708477" Sep 17 14:02:21.567635 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:21.566859 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:21.567635 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:21.567210 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:21.654356 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:21.654159 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" event={"ID":"383749b6af26f4e890dc51b6c5faa10a","Type":"ContainerStarted","Data":"669e0528367f630a7dbd8514575fac3df9bd4d82a1d8d7f85e07effd01c347eb"} Sep 17 14:02:22.090015 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:22.089982 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:22.090168 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:22.090052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:22.090209 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:22.090174 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:22.090239 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:22.090230 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs podName:11c9baa0-1192-4bca-a430-9b2fd7484dd7 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:26.09021326 +0000 UTC m=+10.018190710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs") pod "network-metrics-daemon-xs7g2" (UID: "11c9baa0-1192-4bca-a430-9b2fd7484dd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:22.090652 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:22.090632 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:22.090743 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:22.090686 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret podName:f57bcf14-b8f2-4f1b-a64a-c32bf6d87743 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:26.090670771 +0000 UTC m=+10.018648230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret") pod "global-pull-secret-syncer-t2b6c" (UID: "f57bcf14-b8f2-4f1b-a64a-c32bf6d87743") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:22.191202 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:22.191167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5vzt\" (UniqueName: \"kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt\") pod \"network-check-target-ztd5n\" (UID: \"5ce55ebb-3f80-4447-942c-ffe73e59a5e0\") " pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:22.191360 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:22.191323 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:02:22.191360 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:22.191343 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:02:22.191360 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:22.191355 2579 projected.go:196] Error preparing data for projected volume kube-api-access-s5vzt for pod openshift-network-diagnostics/network-check-target-ztd5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:22.191560 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:22.191427 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt podName:5ce55ebb-3f80-4447-942c-ffe73e59a5e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:26.191406649 +0000 UTC m=+10.119384109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5vzt" (UniqueName: "kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt") pod "network-check-target-ztd5n" (UID: "5ce55ebb-3f80-4447-942c-ffe73e59a5e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:22.573476 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:22.572997 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:22.573476 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:22.573119 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:22.574435 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:22.574220 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:22.574435 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:22.574331 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:23.566423 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:23.566388 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:23.566588 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:23.566527 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:24.566635 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:24.566597 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:24.567055 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:24.566740 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:24.567257 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:24.567237 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:24.567427 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:24.567405 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:25.566495 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:25.566405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:25.566679 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:25.566540 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:26.126235 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:26.126198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:26.126406 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:26.126281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:26.126462 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:26.126427 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:26.126523 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:26.126491 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret podName:f57bcf14-b8f2-4f1b-a64a-c32bf6d87743 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:34.12647201 +0000 UTC m=+18.054449468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret") pod "global-pull-secret-syncer-t2b6c" (UID: "f57bcf14-b8f2-4f1b-a64a-c32bf6d87743") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:26.126523 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:26.126428 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:26.126633 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:26.126571 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs podName:11c9baa0-1192-4bca-a430-9b2fd7484dd7 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:34.126550557 +0000 UTC m=+18.054528006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs") pod "network-metrics-daemon-xs7g2" (UID: "11c9baa0-1192-4bca-a430-9b2fd7484dd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:26.226828 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:26.226791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5vzt\" (UniqueName: \"kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt\") pod \"network-check-target-ztd5n\" (UID: \"5ce55ebb-3f80-4447-942c-ffe73e59a5e0\") " pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:26.227001 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:26.226978 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:02:26.227001 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:26.226997 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:02:26.227102 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:26.227007 2579 projected.go:196] Error preparing data for projected volume kube-api-access-s5vzt for pod openshift-network-diagnostics/network-check-target-ztd5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:26.227102 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:26.227065 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt podName:5ce55ebb-3f80-4447-942c-ffe73e59a5e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:34.227049826 +0000 UTC m=+18.155027274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5vzt" (UniqueName: "kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt") pod "network-check-target-ztd5n" (UID: "5ce55ebb-3f80-4447-942c-ffe73e59a5e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:26.568202 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:26.568118 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:26.568598 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:26.568206 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:26.568598 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:26.568226 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:26.568598 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:26.568324 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:27.567303 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:27.567245 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:27.567475 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:27.567394 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:28.566540 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:28.566502 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:28.566540 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:28.566532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:28.567040 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:28.566663 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:28.567040 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:28.566661 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:29.566926 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:29.566888 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:29.567292 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:29.567030 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:30.567246 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:30.567178 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:30.567722 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:30.567311 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:30.567722 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:30.567353 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:30.567722 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:30.567453 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:31.566454 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:31.566347 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:31.566643 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:31.566500 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:32.567447 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:32.567402 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:32.567891 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:32.567548 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:32.567891 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:32.567605 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:32.567891 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:32.567712 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:33.567171 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:33.567137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:33.567455 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:33.567246 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:34.191269 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:34.191226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:34.191707 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:34.191391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:34.191707 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:34.191406 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:34.191707 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:34.191474 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret podName:f57bcf14-b8f2-4f1b-a64a-c32bf6d87743 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:50.191453338 +0000 UTC m=+34.119430792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret") pod "global-pull-secret-syncer-t2b6c" (UID: "f57bcf14-b8f2-4f1b-a64a-c32bf6d87743") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:34.191707 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:34.191509 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:34.191707 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:34.191564 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs podName:11c9baa0-1192-4bca-a430-9b2fd7484dd7 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:50.191549135 +0000 UTC m=+34.119526584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs") pod "network-metrics-daemon-xs7g2" (UID: "11c9baa0-1192-4bca-a430-9b2fd7484dd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:34.292445 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:34.292403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5vzt\" (UniqueName: \"kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt\") pod \"network-check-target-ztd5n\" (UID: \"5ce55ebb-3f80-4447-942c-ffe73e59a5e0\") " pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:34.292610 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:34.292552 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:02:34.292610 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:34.292570 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:02:34.292610 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:34.292583 2579 projected.go:196] Error preparing data for projected volume kube-api-access-s5vzt for pod openshift-network-diagnostics/network-check-target-ztd5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:34.292743 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:34.292641 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt podName:5ce55ebb-3f80-4447-942c-ffe73e59a5e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:50.292629313 +0000 UTC m=+34.220606757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5vzt" (UniqueName: "kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt") pod "network-check-target-ztd5n" (UID: "5ce55ebb-3f80-4447-942c-ffe73e59a5e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:34.566988 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:34.566863 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:34.566988 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:34.566918 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:34.567207 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:34.567002 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:34.567207 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:34.567163 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:35.566747 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:35.566712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:35.567157 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:35.566877 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:36.567445 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:36.567414 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:36.567893 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:36.567495 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:36.567893 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:36.567547 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:36.567893 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:36.567664 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:37.566692 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.566311 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:37.566692 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:37.566679 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:37.688291 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.688255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zsgrc" event={"ID":"80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb","Type":"ContainerStarted","Data":"b5ebe205000c9add3a2c4b2bf52b0008a2a0990a3c54c56e86fd572a6664b4be"} Sep 17 14:02:37.690360 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.690331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l2fst" event={"ID":"630dbd91-2a35-4ff7-9d36-6444a6463349","Type":"ContainerStarted","Data":"0733510282fc161055d8f7d36bbf643a679583ad5e5ecbb4317506e123fe898b"} Sep 17 14:02:37.692036 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.692004 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8gbj" event={"ID":"0b1a09ac-ddc5-4347-ae5d-c72914a28f8c","Type":"ContainerStarted","Data":"ee2b80fc307a167c88889842e42094327a57dd2b72b177ed0f50b728782902f8"} Sep 17 14:02:37.693969 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.693945 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2x9fn" event={"ID":"6d19c6d2-15a4-4b4b-a801-82a2be0ea93a","Type":"ContainerStarted","Data":"9d1de9ceb62eaef53780067d9c94431178050772c33edd9db755345859e9fb65"} Sep 17 14:02:37.695739 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.695703 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" event={"ID":"b1ed4845-4158-433b-98a6-a26e39e937f2","Type":"ContainerStarted","Data":"21bfaa76c84adeb78b6fed8122796ace7dc85a238afb7cd23e102f1560b2ee25"} Sep 17 14:02:37.697319 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.697291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hvzjz" event={"ID":"afc19d28-6130-48cf-9c98-fb7322afb2a4","Type":"ContainerStarted","Data":"1f9c916f24504175ecfa44ebb8a1752774d290ac07c87c81ec2d2579545063a0"} Sep 17 14:02:37.701080 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.700942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" event={"ID":"ccee8267-a695-4631-a023-f61378ce1aa8","Type":"ContainerStarted","Data":"439bc6b602faf7341ac589dcde99ba9485c2e5734134ab6630e5c75d88ce161d"} Sep 17 14:02:37.701080 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.701011 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" event={"ID":"ccee8267-a695-4631-a023-f61378ce1aa8","Type":"ContainerStarted","Data":"bad170bea8fd9d54c434f334c22c09a7db7e73aba4af2cfd371b524bb7afacd8"} Sep 17 14:02:37.701227 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.701087 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" event={"ID":"ccee8267-a695-4631-a023-f61378ce1aa8","Type":"ContainerStarted","Data":"3f6712c5e0ec8591bb408c2f25852e0311937def17bd790b7cd81e4a2a266ebd"} Sep 17 14:02:37.701227 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.701150 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" event={"ID":"ccee8267-a695-4631-a023-f61378ce1aa8","Type":"ContainerStarted","Data":"3d070f3362f0ba5e1a85a65abd36ccd08e113b085fa01c916ebf8dc40e7bcd12"} Sep 17 14:02:37.701227 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.701208 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" event={"ID":"ccee8267-a695-4631-a023-f61378ce1aa8","Type":"ContainerStarted","Data":"1549e5cc85f9b98db4f67ddde6f9d38c345c0da05af61c48f7f79031fc573194"} Sep 17 14:02:37.701393 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.701255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" event={"ID":"ccee8267-a695-4631-a023-f61378ce1aa8","Type":"ContainerStarted","Data":"2d6fab8a553f4475e7486fc6f2ae9d50e68b0119b910b0d4958b2b6a9683d924"} Sep 17 14:02:37.702938 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.702894 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" podStartSLOduration=20.702878629 podStartE2EDuration="20.702878629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:21.673181979 +0000 UTC m=+5.601159446" watchObservedRunningTime="2026-09-17 14:02:37.702878629 +0000 UTC m=+21.630856096" Sep 17 14:02:37.703040 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.702978 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ae198e7-1043-433e-96b8-1e5218562f8c" containerID="05c49b99620acf06486db1f084ecf31a47b6b88abfec8b3eab0ef8b5e7b8dd6f" exitCode=0 Sep 17 14:02:37.703040 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.703011 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mrmcc" event={"ID":"6ae198e7-1043-433e-96b8-1e5218562f8c","Type":"ContainerDied","Data":"05c49b99620acf06486db1f084ecf31a47b6b88abfec8b3eab0ef8b5e7b8dd6f"} Sep 17 14:02:37.703343 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.703314 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zsgrc" podStartSLOduration=4.504338443 podStartE2EDuration="21.703307347s" totalImagesPullingTime="17.198968904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:37.702507081 +0000 UTC m=+21.630484548" watchObservedRunningTime="2026-09-17 14:02:37.703307347 +0000 UTC m=+21.631284813" Sep 17 14:02:37.722211 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.722172 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l2fst" podStartSLOduration=4.246981669 podStartE2EDuration="21.722153474s" totalImagesPullingTime="17.475171805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:37.722150282 +0000 UTC m=+21.650127749" watchObservedRunningTime="2026-09-17 14:02:37.722153474 +0000 UTC m=+21.650130939" Sep 17 14:02:37.739272 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.739220 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2x9fn" podStartSLOduration=4.212704606 podStartE2EDuration="21.739200809s" totalImagesPullingTime="17.526496203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:37.738762259 +0000 UTC m=+21.666739726" watchObservedRunningTime="2026-09-17 14:02:37.739200809 +0000 UTC m=+21.667178279" Sep 17 14:02:37.755735 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.755689 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t8gbj" podStartSLOduration=4.310992702 podStartE2EDuration="21.75565222s" totalImagesPullingTime="17.444659518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:37.754932113 +0000 UTC m=+21.682909579" watchObservedRunningTime="2026-09-17 14:02:37.75565222 +0000 UTC m=+21.683629688" Sep 17 14:02:37.768817 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:37.768713 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hvzjz" podStartSLOduration=4.309153265 podStartE2EDuration="21.768695183s" totalImagesPullingTime="17.459541918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:37.7683207 +0000 UTC m=+21.696298168" watchObservedRunningTime="2026-09-17 14:02:37.768695183 +0000 UTC m=+21.696672650" Sep 17 14:02:38.463248 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:38.463226 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 14:02:38.500735 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:38.500560 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T14:02:38.463243072Z","UUID":"ed17f6c3-8c08-4fbe-a976-4183a5494d12","Handler":null,"Name":"","Endpoint":""} Sep 17 14:02:38.502144 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:38.502120 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 14:02:38.502266 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:38.502155 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 14:02:38.567482 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:38.567458 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:38.567648 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:38.567464 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:38.567648 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:38.567573 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:38.567769 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:38.567664 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:38.707278 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:38.707240 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" event={"ID":"b1ed4845-4158-433b-98a6-a26e39e937f2","Type":"ContainerStarted","Data":"d30cda210731b426cf1d0021e34c22d037925b1f1276017be281b7a049458085"} Sep 17 14:02:38.709038 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:38.709008 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n466b" event={"ID":"3200be8a-6fdd-4af6-9129-f4e1075f110f","Type":"ContainerStarted","Data":"a3253bd71dcf9145bdd91dbac6359bcc01b2c6c0d445012f6591acc1e72bbe53"} Sep 17 14:02:38.727191 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:38.727106 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n466b" podStartSLOduration=4.279249365 podStartE2EDuration="21.727090085s" totalImagesPullingTime="17.44784072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:38.726759458 +0000 UTC m=+22.654736937" watchObservedRunningTime="2026-09-17 14:02:38.727090085 +0000 UTC m=+22.655067552" Sep 17 14:02:39.566425 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:39.566401 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:39.566534 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:39.566514 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:39.718155 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:39.718066 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" event={"ID":"b1ed4845-4158-433b-98a6-a26e39e937f2","Type":"ContainerStarted","Data":"8c7a5032e7971e6bf358f9679f2b991205ba5dcf05cb4328a2ac19ec023025e8"} Sep 17 14:02:39.740231 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:39.740185 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wph68" podStartSLOduration=4.204210243 podStartE2EDuration="23.740170379s" totalImagesPullingTime="19.535960136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:02:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:39.739947945 +0000 UTC m=+23.667925411" watchObservedRunningTime="2026-09-17 14:02:39.740170379 +0000 UTC m=+23.668147839" Sep 17 14:02:40.567196 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:40.567162 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:40.567390 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:40.567202 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:40.567390 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:40.567307 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:40.567512 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:40.567410 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:40.724447 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:40.724411 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" event={"ID":"ccee8267-a695-4631-a023-f61378ce1aa8","Type":"ContainerStarted","Data":"1a1425d90066791c406dee826a2033ca38b183edc27e74fe9806a0478de9a5c5"} Sep 17 14:02:41.544814 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:41.544779 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:41.545495 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:41.545472 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:41.567098 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:41.567052 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:41.567256 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:41.567177 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:42.566967 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:42.566732 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:42.567702 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:42.566794 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:42.567702 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:42.567000 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:42.567702 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:42.567067 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:42.731919 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:42.731884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" event={"ID":"ccee8267-a695-4631-a023-f61378ce1aa8","Type":"ContainerStarted","Data":"28546191749a50d025eec0d02e763996f71bab2c1256e71f1edd5b993e4e1ff0"} Sep 17 14:02:42.732168 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:42.732140 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:42.733883 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:42.733852 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ae198e7-1043-433e-96b8-1e5218562f8c" containerID="3b97622335e135aecea0d48c228afe740dcc181344c18a326074c286a70ce6ee" exitCode=0 Sep 17 14:02:42.733979 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:42.733885 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mrmcc" event={"ID":"6ae198e7-1043-433e-96b8-1e5218562f8c","Type":"ContainerDied","Data":"3b97622335e135aecea0d48c228afe740dcc181344c18a326074c286a70ce6ee"} Sep 17 14:02:42.749055 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:42.749035 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:42.759333 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:42.759295 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" podStartSLOduration=9.279140455 podStartE2EDuration="26.759282149s" totalImagesPullingTime="17.480141694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:42.757530714 +0000 UTC m=+26.685508180" watchObservedRunningTime="2026-09-17 14:02:42.759282149 +0000 UTC m=+26.687259615" Sep 17 14:02:43.567000 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:43.566823 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:43.567430 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:43.567071 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:43.738799 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:43.738692 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ae198e7-1043-433e-96b8-1e5218562f8c" containerID="580236b231fb421c5dc85e1595733ac67cba3b79042f449012a7b33af2266521" exitCode=0 Sep 17 14:02:43.738799 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:43.738775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mrmcc" event={"ID":"6ae198e7-1043-433e-96b8-1e5218562f8c","Type":"ContainerDied","Data":"580236b231fb421c5dc85e1595733ac67cba3b79042f449012a7b33af2266521"} Sep 17 14:02:43.739380 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:43.739216 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:43.739380 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:43.739308 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:43.754785 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:43.754755 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:02:44.187197 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:44.186440 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xs7g2"] Sep 17 14:02:44.187197 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:44.186635 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:44.187197 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:44.186787 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:44.188791 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:44.187543 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztd5n"] Sep 17 14:02:44.188791 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:44.187661 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:44.188791 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:44.187775 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:44.197449 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:44.197421 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t2b6c"] Sep 17 14:02:44.197633 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:44.197538 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:44.197723 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:44.197647 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:44.743040 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:44.742956 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ae198e7-1043-433e-96b8-1e5218562f8c" containerID="352a12524be24551da745f69e8d0b398d99073d818c57cfc93254049876c6ceb" exitCode=0 Sep 17 14:02:44.743417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:44.743034 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mrmcc" event={"ID":"6ae198e7-1043-433e-96b8-1e5218562f8c","Type":"ContainerDied","Data":"352a12524be24551da745f69e8d0b398d99073d818c57cfc93254049876c6ceb"} Sep 17 14:02:45.566829 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:45.566754 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:45.566982 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:45.566761 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:45.566982 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:45.566894 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:45.567115 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:45.566979 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:46.318005 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:46.317917 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:46.318482 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:46.318060 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 14:02:46.318560 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:46.318541 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zsgrc" Sep 17 14:02:46.568814 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:46.568731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:46.568954 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:46.568847 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:47.567245 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:47.567008 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:47.567665 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:47.567044 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:47.567665 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:47.567355 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:47.567665 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:47.567426 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:48.566603 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:48.566570 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:48.566785 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:48.566699 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ztd5n" podUID="5ce55ebb-3f80-4447-942c-ffe73e59a5e0" Sep 17 14:02:49.566343 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.566311 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:49.566768 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:49.566442 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:02:49.566768 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.566493 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:49.566768 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:49.566576 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t2b6c" podUID="f57bcf14-b8f2-4f1b-a64a-c32bf6d87743" Sep 17 14:02:49.758484 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.758393 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ae198e7-1043-433e-96b8-1e5218562f8c" containerID="a6b39d7ff86efc84c35360a0aa50d05ae6c2c6515412fb640dede09e1b7de6e9" exitCode=0 Sep 17 14:02:49.758484 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.758438 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mrmcc" event={"ID":"6ae198e7-1043-433e-96b8-1e5218562f8c","Type":"ContainerDied","Data":"a6b39d7ff86efc84c35360a0aa50d05ae6c2c6515412fb640dede09e1b7de6e9"} Sep 17 14:02:49.871139 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.871106 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeReady" Sep 17 14:02:49.871326 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.871255 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 14:02:49.908969 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.908939 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57975479c6-fwh6q"] Sep 17 14:02:49.925206 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.925169 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q4z4b"] Sep 17 14:02:49.925360 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.925231 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:49.928203 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.928178 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 14:02:49.929617 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.929592 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pd9ps\"" Sep 17 14:02:49.929756 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.929632 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 14:02:49.929756 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.929739 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 14:02:49.935945 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.935824 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 14:02:49.936907 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.936885 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57975479c6-fwh6q"] Sep 17 14:02:49.937026 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.936932 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zcx7z"] Sep 17 14:02:49.937026 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.936998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:49.940938 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.940793 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f4m2t\"" Sep 17 14:02:49.940938 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.940822 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 14:02:49.940938 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.940852 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 14:02:49.948756 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.948730 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q4z4b"] Sep 17 14:02:49.948877 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.948773 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zcx7z"] Sep 17 14:02:49.948877 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.948837 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zcx7z" Sep 17 14:02:49.951636 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.951614 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 14:02:49.951636 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.951625 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 14:02:49.951793 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.951618 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 14:02:49.952584 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:49.952569 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mt9d5\"" Sep 17 14:02:50.006788 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.006743 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7thv9\" (UniqueName: \"kubernetes.io/projected/79997312-f6a0-415d-9dbb-d29c56ef8fa3-kube-api-access-7thv9\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.006788 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.006781 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61ec268d-ed0d-48c5-900a-379449c25e75-ca-trust-extracted\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.007033 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.006889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.007033 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.006940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-installation-pull-secrets\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.007033 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.006975 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msp7h\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-kube-api-access-msp7h\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.007033 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.007005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79997312-f6a0-415d-9dbb-d29c56ef8fa3-tmp-dir\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.007168 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.007086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-image-registry-private-configuration\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.007168 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.007114 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-bound-sa-token\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.007168 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.007138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-registry-certificates\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.007168 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.007154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79997312-f6a0-415d-9dbb-d29c56ef8fa3-config-volume\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.007168 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.007169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.007327 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.007182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-trusted-ca\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.107662 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.107635 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79997312-f6a0-415d-9dbb-d29c56ef8fa3-tmp-dir\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.107815 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.107688 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-image-registry-private-configuration\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.107815 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.107705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-bound-sa-token\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.107815 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.107726 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e6ad178-db64-4383-a982-d77b5062c251-cert\") pod \"ingress-canary-zcx7z\" (UID: \"3e6ad178-db64-4383-a982-d77b5062c251\") " pod="openshift-ingress-canary/ingress-canary-zcx7z" Sep 17 14:02:50.107815 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.107755 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-registry-certificates\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.107815 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.107782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79997312-f6a0-415d-9dbb-d29c56ef8fa3-config-volume\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.108084 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.107828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.108084 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.107860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-trusted-ca\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.108084 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.107891 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwtjb\" (UniqueName: \"kubernetes.io/projected/3e6ad178-db64-4383-a982-d77b5062c251-kube-api-access-jwtjb\") pod \"ingress-canary-zcx7z\" (UID: \"3e6ad178-db64-4383-a982-d77b5062c251\") " pod="openshift-ingress-canary/ingress-canary-zcx7z" Sep 17 14:02:50.108084 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.107928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7thv9\" (UniqueName: \"kubernetes.io/projected/79997312-f6a0-415d-9dbb-d29c56ef8fa3-kube-api-access-7thv9\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.108084 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.107958 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61ec268d-ed0d-48c5-900a-379449c25e75-ca-trust-extracted\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.108084 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.107968 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:02:50.108084 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.108028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.108084 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.108063 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls podName:79997312-f6a0-415d-9dbb-d29c56ef8fa3 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:50.608038979 +0000 UTC m=+34.536016438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls") pod "dns-default-q4z4b" (UID: "79997312-f6a0-415d-9dbb-d29c56ef8fa3") : secret "dns-default-metrics-tls" not found Sep 17 14:02:50.108084 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.108063 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79997312-f6a0-415d-9dbb-d29c56ef8fa3-tmp-dir\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.108505 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.108122 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:02:50.108505 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.108139 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57975479c6-fwh6q: secret "image-registry-tls" not found Sep 17 14:02:50.108505 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.108184 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls podName:61ec268d-ed0d-48c5-900a-379449c25e75 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:50.608168961 +0000 UTC m=+34.536146410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls") pod "image-registry-57975479c6-fwh6q" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75") : secret "image-registry-tls" not found Sep 17 14:02:50.108505 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.108121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-installation-pull-secrets\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.108505 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.108229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msp7h\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-kube-api-access-msp7h\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.108693 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.108528 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-registry-certificates\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.108693 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.108535 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61ec268d-ed0d-48c5-900a-379449c25e75-ca-trust-extracted\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.108693 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.108543 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79997312-f6a0-415d-9dbb-d29c56ef8fa3-config-volume\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.108900 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.108883 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-trusted-ca\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.112034 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.112012 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-installation-pull-secrets\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.112034 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.112020 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-image-registry-private-configuration\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.116954 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.116932 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-bound-sa-token\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.117440 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.117422 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msp7h\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-kube-api-access-msp7h\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.122486 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.122463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7thv9\" (UniqueName: \"kubernetes.io/projected/79997312-f6a0-415d-9dbb-d29c56ef8fa3-kube-api-access-7thv9\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.208695 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.208658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:50.208842 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.208725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:50.208842 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.208809 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:50.208842 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.208812 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:50.208986 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.208853 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret podName:f57bcf14-b8f2-4f1b-a64a-c32bf6d87743 nodeName:}" failed. No retries permitted until 2026-09-17 14:03:22.208841108 +0000 UTC m=+66.136818568 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret") pod "global-pull-secret-syncer-t2b6c" (UID: "f57bcf14-b8f2-4f1b-a64a-c32bf6d87743") : object "kube-system"/"original-pull-secret" not registered Sep 17 14:02:50.208986 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.208866 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs podName:11c9baa0-1192-4bca-a430-9b2fd7484dd7 nodeName:}" failed. No retries permitted until 2026-09-17 14:03:22.208859867 +0000 UTC m=+66.136837311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs") pod "network-metrics-daemon-xs7g2" (UID: "11c9baa0-1192-4bca-a430-9b2fd7484dd7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 14:02:50.208986 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.208844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e6ad178-db64-4383-a982-d77b5062c251-cert\") pod \"ingress-canary-zcx7z\" (UID: \"3e6ad178-db64-4383-a982-d77b5062c251\") " pod="openshift-ingress-canary/ingress-canary-zcx7z" Sep 17 14:02:50.208986 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.208946 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwtjb\" (UniqueName: \"kubernetes.io/projected/3e6ad178-db64-4383-a982-d77b5062c251-kube-api-access-jwtjb\") pod \"ingress-canary-zcx7z\" (UID: \"3e6ad178-db64-4383-a982-d77b5062c251\") " pod="openshift-ingress-canary/ingress-canary-zcx7z" Sep 17 14:02:50.211587 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.211553 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e6ad178-db64-4383-a982-d77b5062c251-cert\") pod \"ingress-canary-zcx7z\" (UID: \"3e6ad178-db64-4383-a982-d77b5062c251\") " pod="openshift-ingress-canary/ingress-canary-zcx7z" Sep 17 14:02:50.218330 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.218305 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwtjb\" (UniqueName: \"kubernetes.io/projected/3e6ad178-db64-4383-a982-d77b5062c251-kube-api-access-jwtjb\") pod \"ingress-canary-zcx7z\" (UID: \"3e6ad178-db64-4383-a982-d77b5062c251\") " pod="openshift-ingress-canary/ingress-canary-zcx7z" Sep 17 14:02:50.284116 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.284073 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zcx7z" Sep 17 14:02:50.310322 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.310248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5vzt\" (UniqueName: \"kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt\") pod \"network-check-target-ztd5n\" (UID: \"5ce55ebb-3f80-4447-942c-ffe73e59a5e0\") " pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:50.310412 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.310397 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 14:02:50.310462 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.310420 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 14:02:50.310462 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.310433 2579 projected.go:196] Error preparing data for projected volume kube-api-access-s5vzt for pod openshift-network-diagnostics/network-check-target-ztd5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:50.310524 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.310493 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt podName:5ce55ebb-3f80-4447-942c-ffe73e59a5e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:03:22.310479993 +0000 UTC m=+66.238457442 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5vzt" (UniqueName: "kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt") pod "network-check-target-ztd5n" (UID: "5ce55ebb-3f80-4447-942c-ffe73e59a5e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 14:02:50.567112 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.567073 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:02:50.570635 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.570405 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 14:02:50.570795 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.570404 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gjz48\"" Sep 17 14:02:50.570795 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.570404 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 14:02:50.591564 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.591535 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zcx7z"] Sep 17 14:02:50.595392 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:02:50.595354 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6ad178_db64_4383_a982_d77b5062c251.slice/crio-1d0bb84660cfd1f6d9fc11cbc63d4c987fe9e529368e0a7413ec0fc817b3bd8c WatchSource:0}: Error finding container 1d0bb84660cfd1f6d9fc11cbc63d4c987fe9e529368e0a7413ec0fc817b3bd8c: Status 404 returned error can't find the container with id 1d0bb84660cfd1f6d9fc11cbc63d4c987fe9e529368e0a7413ec0fc817b3bd8c Sep 17 14:02:50.613394 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.613355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:50.613535 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.613427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:50.613535 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.613514 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:02:50.613625 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.613543 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:02:50.613625 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.613564 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57975479c6-fwh6q: secret "image-registry-tls" not found Sep 17 14:02:50.613625 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.613576 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls podName:79997312-f6a0-415d-9dbb-d29c56ef8fa3 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:51.613560962 +0000 UTC m=+35.541538410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls") pod "dns-default-q4z4b" (UID: "79997312-f6a0-415d-9dbb-d29c56ef8fa3") : secret "dns-default-metrics-tls" not found Sep 17 14:02:50.613625 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:50.613616 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls podName:61ec268d-ed0d-48c5-900a-379449c25e75 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:51.613597945 +0000 UTC m=+35.541575394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls") pod "image-registry-57975479c6-fwh6q" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75") : secret "image-registry-tls" not found Sep 17 14:02:50.761935 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.761820 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zcx7z" event={"ID":"3e6ad178-db64-4383-a982-d77b5062c251","Type":"ContainerStarted","Data":"1d0bb84660cfd1f6d9fc11cbc63d4c987fe9e529368e0a7413ec0fc817b3bd8c"} Sep 17 14:02:50.764810 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.764784 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ae198e7-1043-433e-96b8-1e5218562f8c" containerID="d75e326da5c653db407da08d46b9bb56a9c3ec5e3c9aa0065a0909b29d36e045" exitCode=0 Sep 17 14:02:50.764940 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:50.764825 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mrmcc" event={"ID":"6ae198e7-1043-433e-96b8-1e5218562f8c","Type":"ContainerDied","Data":"d75e326da5c653db407da08d46b9bb56a9c3ec5e3c9aa0065a0909b29d36e045"} Sep 17 14:02:51.566997 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:51.566958 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:02:51.567190 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:51.567167 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:02:51.570237 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:51.570214 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 14:02:51.570339 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:51.570223 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 14:02:51.570339 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:51.570258 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kqgfj\"" Sep 17 14:02:51.622382 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:51.622338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:51.622565 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:51.622428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:51.622565 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:51.622512 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:02:51.622565 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:51.622552 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:02:51.622704 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:51.622568 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57975479c6-fwh6q: secret "image-registry-tls" not found Sep 17 14:02:51.622704 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:51.622588 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls podName:79997312-f6a0-415d-9dbb-d29c56ef8fa3 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:53.622570781 +0000 UTC m=+37.550548242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls") pod "dns-default-q4z4b" (UID: "79997312-f6a0-415d-9dbb-d29c56ef8fa3") : secret "dns-default-metrics-tls" not found Sep 17 14:02:51.622704 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:51.622612 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls podName:61ec268d-ed0d-48c5-900a-379449c25e75 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:53.622601292 +0000 UTC m=+37.550578748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls") pod "image-registry-57975479c6-fwh6q" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75") : secret "image-registry-tls" not found Sep 17 14:02:51.772464 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:51.772415 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mrmcc" event={"ID":"6ae198e7-1043-433e-96b8-1e5218562f8c","Type":"ContainerStarted","Data":"e1876c499db6a13e9873972aab46a396f9d8d43d954c8d227d283265dc2bba88"} Sep 17 14:02:51.797170 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:51.797108 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mrmcc" podStartSLOduration=8.431174895 podStartE2EDuration="35.797084142s" totalImagesPullingTime="27.365909247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:02:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:51.796933608 +0000 UTC m=+35.724911075" watchObservedRunningTime="2026-09-17 14:02:51.797084142 +0000 UTC m=+35.725061610" Sep 17 14:02:53.638255 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:53.638210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:53.638695 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:53.638387 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:02:53.638695 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:53.638401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:53.638695 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:53.638459 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls podName:79997312-f6a0-415d-9dbb-d29c56ef8fa3 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:57.638441325 +0000 UTC m=+41.566418871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls") pod "dns-default-q4z4b" (UID: "79997312-f6a0-415d-9dbb-d29c56ef8fa3") : secret "dns-default-metrics-tls" not found Sep 17 14:02:53.638695 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:53.638568 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:02:53.638695 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:53.638587 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57975479c6-fwh6q: secret "image-registry-tls" not found Sep 17 14:02:53.638695 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:53.638647 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls podName:61ec268d-ed0d-48c5-900a-379449c25e75 nodeName:}" failed. No retries permitted until 2026-09-17 14:02:57.638631286 +0000 UTC m=+41.566608730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls") pod "image-registry-57975479c6-fwh6q" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75") : secret "image-registry-tls" not found Sep 17 14:02:53.779777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:53.779690 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zcx7z" event={"ID":"3e6ad178-db64-4383-a982-d77b5062c251","Type":"ContainerStarted","Data":"e72f0feae949a2432ac13c51b44d850183ca97e868ea80b8042852156e4ac3fe"} Sep 17 14:02:53.802860 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:53.802797 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zcx7z" podStartSLOduration=1.851627677 podStartE2EDuration="4.802774685s" totalImagesPullingTime="2.951147008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:02:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:02:53.802254973 +0000 UTC m=+37.730232452" watchObservedRunningTime="2026-09-17 14:02:53.802774685 +0000 UTC m=+37.730752153" Sep 17 14:02:57.671638 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:57.671435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:02:57.672023 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:02:57.671666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:02:57.672023 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:57.671592 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:02:57.672023 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:57.671757 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:02:57.672023 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:57.671768 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57975479c6-fwh6q: secret "image-registry-tls" not found Sep 17 14:02:57.672023 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:57.671762 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls podName:79997312-f6a0-415d-9dbb-d29c56ef8fa3 nodeName:}" failed. No retries permitted until 2026-09-17 14:03:05.671745633 +0000 UTC m=+49.599723077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls") pod "dns-default-q4z4b" (UID: "79997312-f6a0-415d-9dbb-d29c56ef8fa3") : secret "dns-default-metrics-tls" not found Sep 17 14:02:57.672023 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:02:57.671812 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls podName:61ec268d-ed0d-48c5-900a-379449c25e75 nodeName:}" failed. No retries permitted until 2026-09-17 14:03:05.671801386 +0000 UTC m=+49.599778830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls") pod "image-registry-57975479c6-fwh6q" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75") : secret "image-registry-tls" not found Sep 17 14:03:05.728275 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:05.728236 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:03:05.728705 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:05.728304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:03:05.728705 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:05.728408 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:03:05.728705 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:05.728412 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:03:05.728705 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:05.728431 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57975479c6-fwh6q: secret "image-registry-tls" not found Sep 17 14:03:05.728705 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:05.728468 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls podName:79997312-f6a0-415d-9dbb-d29c56ef8fa3 nodeName:}" failed. No retries permitted until 2026-09-17 14:03:21.728454687 +0000 UTC m=+65.656432144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls") pod "dns-default-q4z4b" (UID: "79997312-f6a0-415d-9dbb-d29c56ef8fa3") : secret "dns-default-metrics-tls" not found Sep 17 14:03:05.728705 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:05.728486 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls podName:61ec268d-ed0d-48c5-900a-379449c25e75 nodeName:}" failed. No retries permitted until 2026-09-17 14:03:21.728472729 +0000 UTC m=+65.656450196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls") pod "image-registry-57975479c6-fwh6q" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75") : secret "image-registry-tls" not found Sep 17 14:03:15.755710 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:15.755676 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lclzj" Sep 17 14:03:21.737934 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:21.737897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:03:21.738537 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:21.737954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:03:21.738537 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:21.738062 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:03:21.738537 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:21.738064 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:03:21.738537 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:21.738141 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls podName:79997312-f6a0-415d-9dbb-d29c56ef8fa3 nodeName:}" failed. No retries permitted until 2026-09-17 14:03:53.738119495 +0000 UTC m=+97.666096939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls") pod "dns-default-q4z4b" (UID: "79997312-f6a0-415d-9dbb-d29c56ef8fa3") : secret "dns-default-metrics-tls" not found Sep 17 14:03:21.738537 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:21.738073 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57975479c6-fwh6q: secret "image-registry-tls" not found Sep 17 14:03:21.738537 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:21.738202 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls podName:61ec268d-ed0d-48c5-900a-379449c25e75 nodeName:}" failed. No retries permitted until 2026-09-17 14:03:53.738190419 +0000 UTC m=+97.666167864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls") pod "image-registry-57975479c6-fwh6q" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75") : secret "image-registry-tls" not found Sep 17 14:03:22.241180 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.241141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:03:22.241399 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.241206 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:03:22.243937 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.243916 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 14:03:22.244000 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.243971 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 14:03:22.251909 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:22.251887 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 14:03:22.252055 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:22.251955 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs podName:11c9baa0-1192-4bca-a430-9b2fd7484dd7 nodeName:}" failed. No retries permitted until 2026-09-17 14:04:26.251936221 +0000 UTC m=+130.179913668 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs") pod "network-metrics-daemon-xs7g2" (UID: "11c9baa0-1192-4bca-a430-9b2fd7484dd7") : secret "metrics-daemon-secret" not found Sep 17 14:03:22.255443 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.255423 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f57bcf14-b8f2-4f1b-a64a-c32bf6d87743-original-pull-secret\") pod \"global-pull-secret-syncer-t2b6c\" (UID: \"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743\") " pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:03:22.342305 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.342282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5vzt\" (UniqueName: \"kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt\") pod \"network-check-target-ztd5n\" (UID: \"5ce55ebb-3f80-4447-942c-ffe73e59a5e0\") " pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:03:22.345590 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.345570 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 14:03:22.355089 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.355070 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 14:03:22.366209 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.366185 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5vzt\" (UniqueName: \"kubernetes.io/projected/5ce55ebb-3f80-4447-942c-ffe73e59a5e0-kube-api-access-s5vzt\") pod \"network-check-target-ztd5n\" (UID: \"5ce55ebb-3f80-4447-942c-ffe73e59a5e0\") " pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:03:22.380105 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.380084 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gjz48\"" Sep 17 14:03:22.388184 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.388170 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:03:22.484948 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.484913 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t2b6c" Sep 17 14:03:22.654942 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.654913 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ztd5n"] Sep 17 14:03:22.658791 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:03:22.658766 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce55ebb_3f80_4447_942c_ffe73e59a5e0.slice/crio-bfa6f350750394607046540ec7c78d4f4d99d56c27f1415788da92520f29e8ce WatchSource:0}: Error finding container bfa6f350750394607046540ec7c78d4f4d99d56c27f1415788da92520f29e8ce: Status 404 returned error can't find the container with id bfa6f350750394607046540ec7c78d4f4d99d56c27f1415788da92520f29e8ce Sep 17 14:03:22.749862 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.749803 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t2b6c"] Sep 17 14:03:22.752914 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:03:22.752887 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57bcf14_b8f2_4f1b_a64a_c32bf6d87743.slice/crio-bbc9b49ce90a2ef5735a3fc4e4d0ced4e6b6031f0f73923f0c25af2a0e5b8c7a WatchSource:0}: Error finding container bbc9b49ce90a2ef5735a3fc4e4d0ced4e6b6031f0f73923f0c25af2a0e5b8c7a: Status 404 returned error can't find the container with id bbc9b49ce90a2ef5735a3fc4e4d0ced4e6b6031f0f73923f0c25af2a0e5b8c7a Sep 17 14:03:22.846981 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.846948 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztd5n" event={"ID":"5ce55ebb-3f80-4447-942c-ffe73e59a5e0","Type":"ContainerStarted","Data":"bfa6f350750394607046540ec7c78d4f4d99d56c27f1415788da92520f29e8ce"} Sep 17 14:03:22.847911 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:22.847892 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t2b6c" event={"ID":"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743","Type":"ContainerStarted","Data":"bbc9b49ce90a2ef5735a3fc4e4d0ced4e6b6031f0f73923f0c25af2a0e5b8c7a"} Sep 17 14:03:27.863881 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:27.863841 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ztd5n" event={"ID":"5ce55ebb-3f80-4447-942c-ffe73e59a5e0","Type":"ContainerStarted","Data":"4246cd425c906e629994ac8e1766d5b4a3ec4a07d73d6862d3967b12b8de7f33"} Sep 17 14:03:27.864410 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:27.863949 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:03:27.865323 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:27.865299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t2b6c" event={"ID":"f57bcf14-b8f2-4f1b-a64a-c32bf6d87743","Type":"ContainerStarted","Data":"90d22e5e3af21f15a6bde4ff67010de4ba4f36f7e68029c9ac4bde2a1a701b69"} Sep 17 14:03:27.879276 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:27.879238 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ztd5n" podStartSLOduration=67.012013441 podStartE2EDuration="1m11.879226021s" totalImagesPullingTime="4.86721258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:03:27.879000489 +0000 UTC m=+71.806977956" watchObservedRunningTime="2026-09-17 14:03:27.879226021 +0000 UTC m=+71.807203477" Sep 17 14:03:27.895075 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:27.895038 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t2b6c" podStartSLOduration=67.117379379 podStartE2EDuration="1m11.895026032s" totalImagesPullingTime="4.777646653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:03:27.89411553 +0000 UTC m=+71.822092996" watchObservedRunningTime="2026-09-17 14:03:27.895026032 +0000 UTC m=+71.823003497" Sep 17 14:03:53.755340 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:53.755256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:03:53.755340 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:53.755307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:03:53.755734 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:53.755417 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:03:53.755734 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:53.755492 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls podName:79997312-f6a0-415d-9dbb-d29c56ef8fa3 nodeName:}" failed. No retries permitted until 2026-09-17 14:04:57.755476505 +0000 UTC m=+161.683453952 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls") pod "dns-default-q4z4b" (UID: "79997312-f6a0-415d-9dbb-d29c56ef8fa3") : secret "dns-default-metrics-tls" not found Sep 17 14:03:53.755734 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:53.755421 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:03:53.755734 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:53.755519 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57975479c6-fwh6q: secret "image-registry-tls" not found Sep 17 14:03:53.755734 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:03:53.755562 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls podName:61ec268d-ed0d-48c5-900a-379449c25e75 nodeName:}" failed. No retries permitted until 2026-09-17 14:04:57.755551986 +0000 UTC m=+161.683529430 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls") pod "image-registry-57975479c6-fwh6q" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75") : secret "image-registry-tls" not found Sep 17 14:03:58.870464 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:03:58.870429 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ztd5n" Sep 17 14:04:26.264449 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:04:26.264400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:04:26.264853 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:04:26.264543 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 14:04:26.264853 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:04:26.264604 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs podName:11c9baa0-1192-4bca-a430-9b2fd7484dd7 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:28.264590374 +0000 UTC m=+252.192567817 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs") pod "network-metrics-daemon-xs7g2" (UID: "11c9baa0-1192-4bca-a430-9b2fd7484dd7") : secret "metrics-daemon-secret" not found Sep 17 14:04:52.973709 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:04:52.973661 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-57975479c6-fwh6q" podUID="61ec268d-ed0d-48c5-900a-379449c25e75" Sep 17 14:04:52.979783 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:04:52.979765 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-q4z4b" podUID="79997312-f6a0-415d-9dbb-d29c56ef8fa3" Sep 17 14:04:53.064700 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:04:53.064676 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q4z4b" Sep 17 14:04:53.064810 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:04:53.064675 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:04:54.578868 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:04:54.578830 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:04:57.763258 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:04:57.763216 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls\") pod \"image-registry-57975479c6-fwh6q\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:04:57.763708 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:04:57.763289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:04:57.763708 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:04:57.763354 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 14:04:57.763708 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:04:57.763390 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57975479c6-fwh6q: secret "image-registry-tls" not found Sep 17 14:04:57.763708 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:04:57.763404 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 14:04:57.763708 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:04:57.763439 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls podName:61ec268d-ed0d-48c5-900a-379449c25e75 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:59.763425861 +0000 UTC m=+283.691403317 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls") pod "image-registry-57975479c6-fwh6q" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75") : secret "image-registry-tls" not found Sep 17 14:04:57.763708 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:04:57.763466 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls podName:79997312-f6a0-415d-9dbb-d29c56ef8fa3 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:59.763450868 +0000 UTC m=+283.691428311 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls") pod "dns-default-q4z4b" (UID: "79997312-f6a0-415d-9dbb-d29c56ef8fa3") : secret "dns-default-metrics-tls" not found Sep 17 14:05:05.566666 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:05:05.566625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:06:15.745346 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.745308 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nsh8x"] Sep 17 14:06:15.747324 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.747301 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc"] Sep 17 14:06:15.747482 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.747458 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nsh8x" Sep 17 14:06:15.749066 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.749043 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-c5bsz"] Sep 17 14:06:15.749198 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.749174 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" Sep 17 14:06:15.750265 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.750244 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 17 14:06:15.750407 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.750307 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xgbqw\"" Sep 17 14:06:15.750481 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.750439 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 17 14:06:15.751500 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.751480 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq"] Sep 17 14:06:15.751626 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.751570 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 17 14:06:15.751626 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.751578 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 17 14:06:15.751754 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.751631 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xnk8k\"" Sep 17 14:06:15.751754 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.751647 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.751895 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.751876 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 17 14:06:15.752054 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.752034 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 17 14:06:15.753158 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.753140 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-jxxht"] Sep 17 14:06:15.753259 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.753245 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:15.754119 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.754099 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 17 14:06:15.754235 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.754157 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5985g\"" Sep 17 14:06:15.754582 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.754558 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 14:06:15.754844 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.754827 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 17 14:06:15.754961 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.754946 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 14:06:15.755672 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.755460 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 17 14:06:15.755672 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.755540 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 14:06:15.755672 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.755574 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2twb5\"" Sep 17 14:06:15.756264 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.755837 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 14:06:15.756450 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.756430 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.757562 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.757418 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 17 14:06:15.764453 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.761577 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 17 14:06:15.764453 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.761663 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 17 14:06:15.764453 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.762555 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 17 14:06:15.764453 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.762698 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-srfn9\"" Sep 17 14:06:15.764453 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.763164 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 17 14:06:15.768078 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.768012 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nsh8x"] Sep 17 14:06:15.768320 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.768256 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc"] Sep 17 14:06:15.770895 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.770870 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-c5bsz"] Sep 17 14:06:15.772457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.772429 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-jxxht"] Sep 17 14:06:15.772561 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.772483 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 17 14:06:15.773238 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.773214 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 17 14:06:15.773595 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.773582 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq"] Sep 17 14:06:15.837565 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.837533 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2"] Sep 17 14:06:15.839461 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.839444 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" Sep 17 14:06:15.842115 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.842084 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 17 14:06:15.842728 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.842706 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 17 14:06:15.842847 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.842730 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 17 14:06:15.842847 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.842795 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 17 14:06:15.842847 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.842731 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-22685\"" Sep 17 14:06:15.852430 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.852405 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2"] Sep 17 14:06:15.870538 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.870503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95vwh\" (UniqueName: \"kubernetes.io/projected/38ad25bf-7961-4d1e-8c1f-d37ed537599f-kube-api-access-95vwh\") pod \"volume-data-source-validator-86695b7cc7-nsh8x\" (UID: \"38ad25bf-7961-4d1e-8c1f-d37ed537599f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nsh8x" Sep 17 14:06:15.870538 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.870542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/790e703e-06aa-4154-93ec-a287f61b49eb-tmp\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.870789 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.870570 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad40e6da-5bd3-46cd-abe3-74b253e775e1-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xhzxc\" (UID: \"ad40e6da-5bd3-46cd-abe3-74b253e775e1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" Sep 17 14:06:15.870789 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.870623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13a299bd-26c1-42fe-97ba-4e392899fade-config\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.870789 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.870647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf2jv\" (UniqueName: \"kubernetes.io/projected/790e703e-06aa-4154-93ec-a287f61b49eb-kube-api-access-cf2jv\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.870944 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.870801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/790e703e-06aa-4154-93ec-a287f61b49eb-service-ca-bundle\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.870944 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.870838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4zhs\" (UniqueName: \"kubernetes.io/projected/6f8164c5-f994-4099-b2c6-dd5040564a93-kube-api-access-m4zhs\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:15.870944 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.870862 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnl4l\" (UniqueName: \"kubernetes.io/projected/13a299bd-26c1-42fe-97ba-4e392899fade-kube-api-access-gnl4l\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.870944 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.870899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad40e6da-5bd3-46cd-abe3-74b253e775e1-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xhzxc\" (UID: \"ad40e6da-5bd3-46cd-abe3-74b253e775e1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" Sep 17 14:06:15.870944 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.870922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13a299bd-26c1-42fe-97ba-4e392899fade-trusted-ca\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.870944 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.870936 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/790e703e-06aa-4154-93ec-a287f61b49eb-trusted-ca-bundle\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.871221 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.871001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f8164c5-f994-4099-b2c6-dd5040564a93-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:15.871221 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.871069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/790e703e-06aa-4154-93ec-a287f61b49eb-snapshots\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.871221 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.871107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13a299bd-26c1-42fe-97ba-4e392899fade-serving-cert\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.871221 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.871131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:15.871221 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.871166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/790e703e-06aa-4154-93ec-a287f61b49eb-serving-cert\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.871494 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.871236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4szbv\" (UniqueName: \"kubernetes.io/projected/ad40e6da-5bd3-46cd-abe3-74b253e775e1-kube-api-access-4szbv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xhzxc\" (UID: \"ad40e6da-5bd3-46cd-abe3-74b253e775e1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" Sep 17 14:06:15.971791 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.971736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad40e6da-5bd3-46cd-abe3-74b253e775e1-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xhzxc\" (UID: \"ad40e6da-5bd3-46cd-abe3-74b253e775e1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" Sep 17 14:06:15.971791 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.971794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13a299bd-26c1-42fe-97ba-4e392899fade-trusted-ca\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.972051 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.971823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/790e703e-06aa-4154-93ec-a287f61b49eb-trusted-ca-bundle\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.972051 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.971849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f8164c5-f994-4099-b2c6-dd5040564a93-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:15.972051 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.971890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60ede387-542c-4d98-9a2c-2e790de56339-serving-cert\") pod \"service-ca-operator-cf7c776b7-4kfn2\" (UID: \"60ede387-542c-4d98-9a2c-2e790de56339\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" Sep 17 14:06:15.972051 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.971913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/790e703e-06aa-4154-93ec-a287f61b49eb-snapshots\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.972051 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.971945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13a299bd-26c1-42fe-97ba-4e392899fade-serving-cert\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.972303 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:15.972303 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/790e703e-06aa-4154-93ec-a287f61b49eb-serving-cert\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.972303 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:15.972232 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:15.972488 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:15.972310 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls podName:6f8164c5-f994-4099-b2c6-dd5040564a93 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:16.472286505 +0000 UTC m=+240.400263970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p6vjq" (UID: "6f8164c5-f994-4099-b2c6-dd5040564a93") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:15.972727 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972669 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/790e703e-06aa-4154-93ec-a287f61b49eb-snapshots\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.972727 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4szbv\" (UniqueName: \"kubernetes.io/projected/ad40e6da-5bd3-46cd-abe3-74b253e775e1-kube-api-access-4szbv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xhzxc\" (UID: \"ad40e6da-5bd3-46cd-abe3-74b253e775e1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" Sep 17 14:06:15.972911 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95vwh\" (UniqueName: \"kubernetes.io/projected/38ad25bf-7961-4d1e-8c1f-d37ed537599f-kube-api-access-95vwh\") pod \"volume-data-source-validator-86695b7cc7-nsh8x\" (UID: \"38ad25bf-7961-4d1e-8c1f-d37ed537599f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nsh8x" Sep 17 14:06:15.972911 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/790e703e-06aa-4154-93ec-a287f61b49eb-tmp\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.972911 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/60ede387-542c-4d98-9a2c-2e790de56339-config\") pod \"service-ca-operator-cf7c776b7-4kfn2\" (UID: \"60ede387-542c-4d98-9a2c-2e790de56339\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" Sep 17 14:06:15.972911 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972835 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad40e6da-5bd3-46cd-abe3-74b253e775e1-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xhzxc\" (UID: \"ad40e6da-5bd3-46cd-abe3-74b253e775e1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" Sep 17 14:06:15.972911 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13a299bd-26c1-42fe-97ba-4e392899fade-config\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.972911 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972896 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf2jv\" (UniqueName: \"kubernetes.io/projected/790e703e-06aa-4154-93ec-a287f61b49eb-kube-api-access-cf2jv\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.973195 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/790e703e-06aa-4154-93ec-a287f61b49eb-service-ca-bundle\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.973195 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972933 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f8164c5-f994-4099-b2c6-dd5040564a93-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:15.973195 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4zhs\" (UniqueName: \"kubernetes.io/projected/6f8164c5-f994-4099-b2c6-dd5040564a93-kube-api-access-m4zhs\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:15.973195 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.972992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxbd6\" (UniqueName: \"kubernetes.io/projected/60ede387-542c-4d98-9a2c-2e790de56339-kube-api-access-wxbd6\") pod \"service-ca-operator-cf7c776b7-4kfn2\" (UID: \"60ede387-542c-4d98-9a2c-2e790de56339\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" Sep 17 14:06:15.973195 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.973025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnl4l\" (UniqueName: \"kubernetes.io/projected/13a299bd-26c1-42fe-97ba-4e392899fade-kube-api-access-gnl4l\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.973471 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.973447 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/790e703e-06aa-4154-93ec-a287f61b49eb-trusted-ca-bundle\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.973538 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.973493 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad40e6da-5bd3-46cd-abe3-74b253e775e1-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xhzxc\" (UID: \"ad40e6da-5bd3-46cd-abe3-74b253e775e1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" Sep 17 14:06:15.973615 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.973586 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13a299bd-26c1-42fe-97ba-4e392899fade-trusted-ca\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.973936 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.973907 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13a299bd-26c1-42fe-97ba-4e392899fade-config\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.974036 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.973944 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/790e703e-06aa-4154-93ec-a287f61b49eb-tmp\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.974274 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.974256 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/790e703e-06aa-4154-93ec-a287f61b49eb-service-ca-bundle\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.974718 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.974694 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad40e6da-5bd3-46cd-abe3-74b253e775e1-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xhzxc\" (UID: \"ad40e6da-5bd3-46cd-abe3-74b253e775e1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" Sep 17 14:06:15.974818 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.974798 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13a299bd-26c1-42fe-97ba-4e392899fade-serving-cert\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.975138 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.975119 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/790e703e-06aa-4154-93ec-a287f61b49eb-serving-cert\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.982255 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.982232 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnl4l\" (UniqueName: \"kubernetes.io/projected/13a299bd-26c1-42fe-97ba-4e392899fade-kube-api-access-gnl4l\") pod \"console-operator-696884fb9c-jxxht\" (UID: \"13a299bd-26c1-42fe-97ba-4e392899fade\") " pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:15.983275 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.983249 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf2jv\" (UniqueName: \"kubernetes.io/projected/790e703e-06aa-4154-93ec-a287f61b49eb-kube-api-access-cf2jv\") pod \"insights-operator-5844b856db-c5bsz\" (UID: \"790e703e-06aa-4154-93ec-a287f61b49eb\") " pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:15.983656 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.983636 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95vwh\" (UniqueName: \"kubernetes.io/projected/38ad25bf-7961-4d1e-8c1f-d37ed537599f-kube-api-access-95vwh\") pod \"volume-data-source-validator-86695b7cc7-nsh8x\" (UID: \"38ad25bf-7961-4d1e-8c1f-d37ed537599f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nsh8x" Sep 17 14:06:15.984026 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.984008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4zhs\" (UniqueName: \"kubernetes.io/projected/6f8164c5-f994-4099-b2c6-dd5040564a93-kube-api-access-m4zhs\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:15.984640 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:15.984624 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4szbv\" (UniqueName: \"kubernetes.io/projected/ad40e6da-5bd3-46cd-abe3-74b253e775e1-kube-api-access-4szbv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-xhzxc\" (UID: \"ad40e6da-5bd3-46cd-abe3-74b253e775e1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" Sep 17 14:06:16.060276 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.060174 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nsh8x" Sep 17 14:06:16.073629 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.073601 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" Sep 17 14:06:16.073795 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.073773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60ede387-542c-4d98-9a2c-2e790de56339-serving-cert\") pod \"service-ca-operator-cf7c776b7-4kfn2\" (UID: \"60ede387-542c-4d98-9a2c-2e790de56339\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" Sep 17 14:06:16.073878 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.073825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/60ede387-542c-4d98-9a2c-2e790de56339-config\") pod \"service-ca-operator-cf7c776b7-4kfn2\" (UID: \"60ede387-542c-4d98-9a2c-2e790de56339\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" Sep 17 14:06:16.073946 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.073885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxbd6\" (UniqueName: \"kubernetes.io/projected/60ede387-542c-4d98-9a2c-2e790de56339-kube-api-access-wxbd6\") pod \"service-ca-operator-cf7c776b7-4kfn2\" (UID: \"60ede387-542c-4d98-9a2c-2e790de56339\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" Sep 17 14:06:16.074525 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.074506 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/60ede387-542c-4d98-9a2c-2e790de56339-config\") pod \"service-ca-operator-cf7c776b7-4kfn2\" (UID: \"60ede387-542c-4d98-9a2c-2e790de56339\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" Sep 17 14:06:16.076057 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.076033 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60ede387-542c-4d98-9a2c-2e790de56339-serving-cert\") pod \"service-ca-operator-cf7c776b7-4kfn2\" (UID: \"60ede387-542c-4d98-9a2c-2e790de56339\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" Sep 17 14:06:16.079877 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.079860 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-c5bsz" Sep 17 14:06:16.082087 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.082062 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxbd6\" (UniqueName: \"kubernetes.io/projected/60ede387-542c-4d98-9a2c-2e790de56339-kube-api-access-wxbd6\") pod \"service-ca-operator-cf7c776b7-4kfn2\" (UID: \"60ede387-542c-4d98-9a2c-2e790de56339\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" Sep 17 14:06:16.090895 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.090828 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:16.147871 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.147834 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" Sep 17 14:06:16.336254 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.336219 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nsh8x"] Sep 17 14:06:16.340641 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:16.340610 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ad25bf_7961_4d1e_8c1f_d37ed537599f.slice/crio-951d9166cca0697970ed0a335a2e9ee17712cd9f32ff49ae66664d8486cb75af WatchSource:0}: Error finding container 951d9166cca0697970ed0a335a2e9ee17712cd9f32ff49ae66664d8486cb75af: Status 404 returned error can't find the container with id 951d9166cca0697970ed0a335a2e9ee17712cd9f32ff49ae66664d8486cb75af Sep 17 14:06:16.357305 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.357255 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc"] Sep 17 14:06:16.359594 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:16.359568 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad40e6da_5bd3_46cd_abe3_74b253e775e1.slice/crio-062732a7f3ac829977ffb27ee99d0c2e6f50006c1c6552c73e1184ee20b387ac WatchSource:0}: Error finding container 062732a7f3ac829977ffb27ee99d0c2e6f50006c1c6552c73e1184ee20b387ac: Status 404 returned error can't find the container with id 062732a7f3ac829977ffb27ee99d0c2e6f50006c1c6552c73e1184ee20b387ac Sep 17 14:06:16.381827 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.381807 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-jxxht"] Sep 17 14:06:16.383552 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.383531 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-c5bsz"] Sep 17 14:06:16.385108 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:16.385084 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a299bd_26c1_42fe_97ba_4e392899fade.slice/crio-9301309e2954566ea0cfa50f171e176c2f6a36ff575675fa6761c317eb97edfe WatchSource:0}: Error finding container 9301309e2954566ea0cfa50f171e176c2f6a36ff575675fa6761c317eb97edfe: Status 404 returned error can't find the container with id 9301309e2954566ea0cfa50f171e176c2f6a36ff575675fa6761c317eb97edfe Sep 17 14:06:16.386034 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:16.386015 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790e703e_06aa_4154_93ec_a287f61b49eb.slice/crio-a9d9abc5006d54cdafa9dc2f62047ec54921f28bb006868b53a66937a9deb436 WatchSource:0}: Error finding container a9d9abc5006d54cdafa9dc2f62047ec54921f28bb006868b53a66937a9deb436: Status 404 returned error can't find the container with id a9d9abc5006d54cdafa9dc2f62047ec54921f28bb006868b53a66937a9deb436 Sep 17 14:06:16.425227 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.425198 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2"] Sep 17 14:06:16.428248 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:16.428224 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ede387_542c_4d98_9a2c_2e790de56339.slice/crio-2bbf6a076b98133e431357db6744de2cc30426116d4b33cf294fe4d2496afdcb WatchSource:0}: Error finding container 2bbf6a076b98133e431357db6744de2cc30426116d4b33cf294fe4d2496afdcb: Status 404 returned error can't find the container with id 2bbf6a076b98133e431357db6744de2cc30426116d4b33cf294fe4d2496afdcb Sep 17 14:06:16.477750 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:16.477718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:16.477873 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:16.477854 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:16.477929 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:16.477914 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls podName:6f8164c5-f994-4099-b2c6-dd5040564a93 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:17.477892676 +0000 UTC m=+241.405870120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p6vjq" (UID: "6f8164c5-f994-4099-b2c6-dd5040564a93") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:17.256543 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:17.256475 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" event={"ID":"13a299bd-26c1-42fe-97ba-4e392899fade","Type":"ContainerStarted","Data":"9301309e2954566ea0cfa50f171e176c2f6a36ff575675fa6761c317eb97edfe"} Sep 17 14:06:17.259191 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:17.259161 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" event={"ID":"60ede387-542c-4d98-9a2c-2e790de56339","Type":"ContainerStarted","Data":"2bbf6a076b98133e431357db6744de2cc30426116d4b33cf294fe4d2496afdcb"} Sep 17 14:06:17.261716 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:17.261689 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" event={"ID":"ad40e6da-5bd3-46cd-abe3-74b253e775e1","Type":"ContainerStarted","Data":"062732a7f3ac829977ffb27ee99d0c2e6f50006c1c6552c73e1184ee20b387ac"} Sep 17 14:06:17.263675 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:17.263583 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nsh8x" event={"ID":"38ad25bf-7961-4d1e-8c1f-d37ed537599f","Type":"ContainerStarted","Data":"951d9166cca0697970ed0a335a2e9ee17712cd9f32ff49ae66664d8486cb75af"} Sep 17 14:06:17.265544 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:17.265517 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-c5bsz" event={"ID":"790e703e-06aa-4154-93ec-a287f61b49eb","Type":"ContainerStarted","Data":"a9d9abc5006d54cdafa9dc2f62047ec54921f28bb006868b53a66937a9deb436"} Sep 17 14:06:17.486699 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:17.486102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:17.486699 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:17.486249 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:17.486699 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:17.486313 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls podName:6f8164c5-f994-4099-b2c6-dd5040564a93 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:19.486292969 +0000 UTC m=+243.414270413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p6vjq" (UID: "6f8164c5-f994-4099-b2c6-dd5040564a93") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:18.272135 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:18.272056 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nsh8x" event={"ID":"38ad25bf-7961-4d1e-8c1f-d37ed537599f","Type":"ContainerStarted","Data":"f6eea64742aba8e5cd746f0ba1213f02172c0e6663c9d437dacc9b0b60cee89b"} Sep 17 14:06:18.288102 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:18.287937 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-nsh8x" podStartSLOduration=1.809030467 podStartE2EDuration="3.28791781s" totalImagesPullingTime="1.478887343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:18.28657646 +0000 UTC m=+242.214553927" watchObservedRunningTime="2026-09-17 14:06:18.28791781 +0000 UTC m=+242.215895272" Sep 17 14:06:19.505555 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:19.505511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:19.505968 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:19.505672 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:19.505968 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:19.505749 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls podName:6f8164c5-f994-4099-b2c6-dd5040564a93 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:23.505731562 +0000 UTC m=+247.433709012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p6vjq" (UID: "6f8164c5-f994-4099-b2c6-dd5040564a93") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:21.283582 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.283546 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-jxxht_13a299bd-26c1-42fe-97ba-4e392899fade/console-operator/0.log" Sep 17 14:06:21.284049 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.283600 2579 generic.go:356] "Generic (PLEG): container finished" podID="13a299bd-26c1-42fe-97ba-4e392899fade" containerID="0260e4a4628318d82ef4c668ca2b621b5eebcb63440c9749fae0f80f603ade04" exitCode=255 Sep 17 14:06:21.284049 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.283695 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" event={"ID":"13a299bd-26c1-42fe-97ba-4e392899fade","Type":"ContainerDied","Data":"0260e4a4628318d82ef4c668ca2b621b5eebcb63440c9749fae0f80f603ade04"} Sep 17 14:06:21.284049 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.283941 2579 scope.go:117] "RemoveContainer" containerID="0260e4a4628318d82ef4c668ca2b621b5eebcb63440c9749fae0f80f603ade04" Sep 17 14:06:21.285917 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.285883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" event={"ID":"60ede387-542c-4d98-9a2c-2e790de56339","Type":"ContainerStarted","Data":"58e9a227e43c91a4ae6aaec07fe27450885261a204864822ab440eaccd315431"} Sep 17 14:06:21.287835 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.287810 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" event={"ID":"ad40e6da-5bd3-46cd-abe3-74b253e775e1","Type":"ContainerStarted","Data":"a154b5496e6c09c9e4f858fc438ca311217cef56feff99b924b185db6002efa0"} Sep 17 14:06:21.289444 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.289416 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-c5bsz" event={"ID":"790e703e-06aa-4154-93ec-a287f61b49eb","Type":"ContainerStarted","Data":"6a597ef26251aa8a86a64202ac111bbc9f8f20b34f53433b81626d353fd1259f"} Sep 17 14:06:21.312463 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.312414 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" podStartSLOduration=2.424531581 podStartE2EDuration="6.312396554s" totalImagesPullingTime="3.887864973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:21.311858168 +0000 UTC m=+245.239835625" watchObservedRunningTime="2026-09-17 14:06:21.312396554 +0000 UTC m=+245.240374020" Sep 17 14:06:21.327172 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.326994 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" podStartSLOduration=2.499576616 podStartE2EDuration="6.326972586s" totalImagesPullingTime="3.82739597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:21.325848722 +0000 UTC m=+245.253826190" watchObservedRunningTime="2026-09-17 14:06:21.326972586 +0000 UTC m=+245.254950055" Sep 17 14:06:21.341740 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.341681 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-c5bsz" podStartSLOduration=2.479315338 podStartE2EDuration="6.341640101s" totalImagesPullingTime="3.862324763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:21.340721186 +0000 UTC m=+245.268698653" watchObservedRunningTime="2026-09-17 14:06:21.341640101 +0000 UTC m=+245.269617568" Sep 17 14:06:21.679383 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.679325 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd"] Sep 17 14:06:21.682090 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.682067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd" Sep 17 14:06:21.684355 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.684335 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 17 14:06:21.684591 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.684574 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-22pzp\"" Sep 17 14:06:21.684591 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.684584 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 17 14:06:21.693209 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.693182 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd"] Sep 17 14:06:21.797157 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.797125 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k7c9d"] Sep 17 14:06:21.799339 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.799321 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:21.801358 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.801341 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 14:06:21.801638 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.801622 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 14:06:21.801975 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.801953 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vz7m4\"" Sep 17 14:06:21.811399 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.811349 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k7c9d"] Sep 17 14:06:21.827030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.827003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzzzr\" (UniqueName: \"kubernetes.io/projected/3a76b2ce-a344-4932-985f-502e9e6c2ccb-kube-api-access-nzzzr\") pod \"migrator-8b4d697c5-nktcd\" (UID: \"3a76b2ce-a344-4932-985f-502e9e6c2ccb\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd" Sep 17 14:06:21.928296 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.928269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzzzr\" (UniqueName: \"kubernetes.io/projected/3a76b2ce-a344-4932-985f-502e9e6c2ccb-kube-api-access-nzzzr\") pod \"migrator-8b4d697c5-nktcd\" (UID: \"3a76b2ce-a344-4932-985f-502e9e6c2ccb\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd" Sep 17 14:06:21.928459 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.928303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhbwx\" (UniqueName: \"kubernetes.io/projected/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-api-access-rhbwx\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:21.928459 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.928333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-data-volume\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:21.928596 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.928452 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-crio-socket\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:21.928596 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.928488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:21.928596 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.928514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:21.936102 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.936045 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzzzr\" (UniqueName: \"kubernetes.io/projected/3a76b2ce-a344-4932-985f-502e9e6c2ccb-kube-api-access-nzzzr\") pod \"migrator-8b4d697c5-nktcd\" (UID: \"3a76b2ce-a344-4932-985f-502e9e6c2ccb\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd" Sep 17 14:06:21.992058 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:21.992022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd" Sep 17 14:06:22.029786 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.029753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-crio-socket\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:22.029786 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.029787 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:22.029996 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.029810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:22.029996 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.029871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhbwx\" (UniqueName: \"kubernetes.io/projected/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-api-access-rhbwx\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:22.029996 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.029875 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-crio-socket\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:22.029996 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:22.029927 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:06:22.029996 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.029953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-data-volume\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:22.029996 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:22.029964 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 14:06:22.029996 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:22.029992 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls podName:d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c nodeName:}" failed. No retries permitted until 2026-09-17 14:06:22.52997261 +0000 UTC m=+246.457950067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7c9d" (UID: "d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c") : secret "insights-runtime-extractor-tls" not found Sep 17 14:06:22.030361 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:22.030018 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm podName:d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c nodeName:}" failed. No retries permitted until 2026-09-17 14:06:22.530005455 +0000 UTC m=+246.457982903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k7c9d" (UID: "d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c") : configmap "kube-rbac-proxy" not found Sep 17 14:06:22.030361 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.030227 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-data-volume\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:22.039919 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.039607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhbwx\" (UniqueName: \"kubernetes.io/projected/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-api-access-rhbwx\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:22.255888 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.255804 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd"] Sep 17 14:06:22.259407 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:22.259380 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a76b2ce_a344_4932_985f_502e9e6c2ccb.slice/crio-7ea4488715d7efc635330e1a64de610ab58b847e174920b9e0b86693f8e3dba6 WatchSource:0}: Error finding container 7ea4488715d7efc635330e1a64de610ab58b847e174920b9e0b86693f8e3dba6: Status 404 returned error can't find the container with id 7ea4488715d7efc635330e1a64de610ab58b847e174920b9e0b86693f8e3dba6 Sep 17 14:06:22.293402 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.293358 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd" event={"ID":"3a76b2ce-a344-4932-985f-502e9e6c2ccb","Type":"ContainerStarted","Data":"7ea4488715d7efc635330e1a64de610ab58b847e174920b9e0b86693f8e3dba6"} Sep 17 14:06:22.294801 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.294784 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-jxxht_13a299bd-26c1-42fe-97ba-4e392899fade/console-operator/1.log" Sep 17 14:06:22.295163 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.295150 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-jxxht_13a299bd-26c1-42fe-97ba-4e392899fade/console-operator/0.log" Sep 17 14:06:22.295238 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.295180 2579 generic.go:356] "Generic (PLEG): container finished" podID="13a299bd-26c1-42fe-97ba-4e392899fade" containerID="e4b303c1c07caaac59af046b87ceac6ffcc724a21f165d51a311cc3a91df1937" exitCode=255 Sep 17 14:06:22.295238 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.295208 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" event={"ID":"13a299bd-26c1-42fe-97ba-4e392899fade","Type":"ContainerDied","Data":"e4b303c1c07caaac59af046b87ceac6ffcc724a21f165d51a311cc3a91df1937"} Sep 17 14:06:22.295345 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.295260 2579 scope.go:117] "RemoveContainer" containerID="0260e4a4628318d82ef4c668ca2b621b5eebcb63440c9749fae0f80f603ade04" Sep 17 14:06:22.295547 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.295524 2579 scope.go:117] "RemoveContainer" containerID="e4b303c1c07caaac59af046b87ceac6ffcc724a21f165d51a311cc3a91df1937" Sep 17 14:06:22.295722 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:22.295698 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-jxxht_openshift-console-operator(13a299bd-26c1-42fe-97ba-4e392899fade)\"" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" podUID="13a299bd-26c1-42fe-97ba-4e392899fade" Sep 17 14:06:22.534269 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.534190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:22.534269 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:22.534232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:22.534470 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:22.534343 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:06:22.534470 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:22.534353 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 14:06:22.534470 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:22.534422 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls podName:d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c nodeName:}" failed. No retries permitted until 2026-09-17 14:06:23.534407079 +0000 UTC m=+247.462384524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7c9d" (UID: "d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c") : secret "insights-runtime-extractor-tls" not found Sep 17 14:06:22.534470 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:22.534436 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm podName:d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c nodeName:}" failed. No retries permitted until 2026-09-17 14:06:23.534429402 +0000 UTC m=+247.462406845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k7c9d" (UID: "d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c") : configmap "kube-rbac-proxy" not found Sep 17 14:06:23.300301 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:23.300269 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-jxxht_13a299bd-26c1-42fe-97ba-4e392899fade/console-operator/1.log" Sep 17 14:06:23.300734 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:23.300651 2579 scope.go:117] "RemoveContainer" containerID="e4b303c1c07caaac59af046b87ceac6ffcc724a21f165d51a311cc3a91df1937" Sep 17 14:06:23.300862 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:23.300840 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-jxxht_openshift-console-operator(13a299bd-26c1-42fe-97ba-4e392899fade)\"" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" podUID="13a299bd-26c1-42fe-97ba-4e392899fade" Sep 17 14:06:23.543038 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:23.543015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:23.543151 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:23.543051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:23.543151 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:23.543072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:23.543264 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:23.543168 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:23.543264 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:23.543178 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:06:23.543264 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:23.543219 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 14:06:23.543264 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:23.543226 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls podName:6f8164c5-f994-4099-b2c6-dd5040564a93 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:31.543207337 +0000 UTC m=+255.471184803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p6vjq" (UID: "6f8164c5-f994-4099-b2c6-dd5040564a93") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:23.543422 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:23.543289 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls podName:d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c nodeName:}" failed. No retries permitted until 2026-09-17 14:06:25.54326982 +0000 UTC m=+249.471247277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7c9d" (UID: "d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c") : secret "insights-runtime-extractor-tls" not found Sep 17 14:06:23.543422 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:23.543306 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm podName:d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c nodeName:}" failed. No retries permitted until 2026-09-17 14:06:25.543296164 +0000 UTC m=+249.471273612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k7c9d" (UID: "d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c") : configmap "kube-rbac-proxy" not found Sep 17 14:06:24.304732 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:24.304696 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd" event={"ID":"3a76b2ce-a344-4932-985f-502e9e6c2ccb","Type":"ContainerStarted","Data":"5ef51e643a90c1e7c807cf5587bc69a25f8ad60ef7ebc23c9e1a312a67a87697"} Sep 17 14:06:24.305093 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:24.304749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd" event={"ID":"3a76b2ce-a344-4932-985f-502e9e6c2ccb","Type":"ContainerStarted","Data":"22b86929580382384a283c0227ba559fbfd1bcdd8f943d2c7a1fd0c0f109946a"} Sep 17 14:06:24.320405 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:24.320341 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nktcd" podStartSLOduration=2.097655965 podStartE2EDuration="3.320324526s" totalImagesPullingTime="1.222668561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:24.319236668 +0000 UTC m=+248.247214134" watchObservedRunningTime="2026-09-17 14:06:24.320324526 +0000 UTC m=+248.248301992" Sep 17 14:06:24.554126 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:24.554098 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hvzjz_afc19d28-6130-48cf-9c98-fb7322afb2a4/dns-node-resolver/0.log" Sep 17 14:06:25.561014 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:25.560975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:25.561014 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:25.561011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:25.561469 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:25.561103 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 14:06:25.561469 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:25.561121 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:06:25.561469 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:25.561154 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm podName:d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c nodeName:}" failed. No retries permitted until 2026-09-17 14:06:29.561140063 +0000 UTC m=+253.489117507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k7c9d" (UID: "d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c") : configmap "kube-rbac-proxy" not found Sep 17 14:06:25.561469 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:25.561173 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls podName:d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c nodeName:}" failed. No retries permitted until 2026-09-17 14:06:29.56116052 +0000 UTC m=+253.489137964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7c9d" (UID: "d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c") : secret "insights-runtime-extractor-tls" not found Sep 17 14:06:25.753774 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:25.753745 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8gbj_0b1a09ac-ddc5-4347-ae5d-c72914a28f8c/node-ca/0.log" Sep 17 14:06:26.091202 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:26.091152 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:26.091419 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:26.091223 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:26.091588 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:26.091574 2579 scope.go:117] "RemoveContainer" containerID="e4b303c1c07caaac59af046b87ceac6ffcc724a21f165d51a311cc3a91df1937" Sep 17 14:06:26.091737 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:26.091720 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-jxxht_openshift-console-operator(13a299bd-26c1-42fe-97ba-4e392899fade)\"" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" podUID="13a299bd-26c1-42fe-97ba-4e392899fade" Sep 17 14:06:26.554709 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:26.554633 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zcx7z_3e6ad178-db64-4383-a982-d77b5062c251/serve-healthcheck-canary/0.log" Sep 17 14:06:26.754363 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:26.754334 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-nktcd_3a76b2ce-a344-4932-985f-502e9e6c2ccb/migrator/0.log" Sep 17 14:06:26.954007 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:26.953984 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-nktcd_3a76b2ce-a344-4932-985f-502e9e6c2ccb/graceful-termination/0.log" Sep 17 14:06:27.155235 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:27.155203 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-xhzxc_ad40e6da-5bd3-46cd-abe3-74b253e775e1/kube-storage-version-migrator-operator/0.log" Sep 17 14:06:28.286266 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:28.286203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:06:28.286681 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:28.286403 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 14:06:28.286681 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:28.286476 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs podName:11c9baa0-1192-4bca-a430-9b2fd7484dd7 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:30.286457575 +0000 UTC m=+374.214435040 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs") pod "network-metrics-daemon-xs7g2" (UID: "11c9baa0-1192-4bca-a430-9b2fd7484dd7") : secret "metrics-daemon-secret" not found Sep 17 14:06:29.599462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:29.599425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:29.599462 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:29.599468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:29.599953 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:29.599608 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 14:06:29.599953 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:29.599617 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:06:29.599953 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:29.599667 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm podName:d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c nodeName:}" failed. No retries permitted until 2026-09-17 14:06:37.599651312 +0000 UTC m=+261.527628755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k7c9d" (UID: "d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c") : configmap "kube-rbac-proxy" not found Sep 17 14:06:29.599953 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:29.599690 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls podName:d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c nodeName:}" failed. No retries permitted until 2026-09-17 14:06:37.599672535 +0000 UTC m=+261.527649984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7c9d" (UID: "d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c") : secret "insights-runtime-extractor-tls" not found Sep 17 14:06:31.617263 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:31.617222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:31.617653 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:31.617390 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:31.617653 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:31.617456 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls podName:6f8164c5-f994-4099-b2c6-dd5040564a93 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:47.61743868 +0000 UTC m=+271.545416124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p6vjq" (UID: "6f8164c5-f994-4099-b2c6-dd5040564a93") : secret "cluster-monitoring-operator-tls" not found Sep 17 14:06:37.567072 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:37.567041 2579 scope.go:117] "RemoveContainer" containerID="e4b303c1c07caaac59af046b87ceac6ffcc724a21f165d51a311cc3a91df1937" Sep 17 14:06:37.664969 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:37.664934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:37.665118 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:37.665043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:37.665192 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:37.665051 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 14:06:37.665276 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:37.665254 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls podName:d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c nodeName:}" failed. No retries permitted until 2026-09-17 14:06:53.665231029 +0000 UTC m=+277.593208530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7c9d" (UID: "d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c") : secret "insights-runtime-extractor-tls" not found Sep 17 14:06:37.665581 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:37.665557 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:38.351327 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:38.351300 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-jxxht_13a299bd-26c1-42fe-97ba-4e392899fade/console-operator/1.log" Sep 17 14:06:38.351500 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:38.351399 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" event={"ID":"13a299bd-26c1-42fe-97ba-4e392899fade","Type":"ContainerStarted","Data":"2a5d7a2f979cdac84917e19a8d1fce1958bb0aaa0b2a0f0716760b2fb50da6c6"} Sep 17 14:06:38.351690 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:38.351668 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:38.356391 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:38.356354 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" Sep 17 14:06:38.366988 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:38.366951 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-jxxht" podStartSLOduration=19.508580724 podStartE2EDuration="23.366938482s" totalImagesPullingTime="3.858357758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:38.366029712 +0000 UTC m=+262.294007178" watchObservedRunningTime="2026-09-17 14:06:38.366938482 +0000 UTC m=+262.294916158" Sep 17 14:06:47.639422 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:47.639355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:47.641682 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:47.641656 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8164c5-f994-4099-b2c6-dd5040564a93-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p6vjq\" (UID: \"6f8164c5-f994-4099-b2c6-dd5040564a93\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:47.888609 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:47.888578 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2twb5\"" Sep 17 14:06:47.896808 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:47.896756 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" Sep 17 14:06:48.171284 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:48.171198 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq"] Sep 17 14:06:48.174090 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:48.174053 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8164c5_f994_4099_b2c6_dd5040564a93.slice/crio-ae820c8c14383f1188f923d8f8fb50296291e176551d0d310b5dcbb301bd6b68 WatchSource:0}: Error finding container ae820c8c14383f1188f923d8f8fb50296291e176551d0d310b5dcbb301bd6b68: Status 404 returned error can't find the container with id ae820c8c14383f1188f923d8f8fb50296291e176551d0d310b5dcbb301bd6b68 Sep 17 14:06:48.381589 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:48.381541 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" event={"ID":"6f8164c5-f994-4099-b2c6-dd5040564a93","Type":"ContainerStarted","Data":"ae820c8c14383f1188f923d8f8fb50296291e176551d0d310b5dcbb301bd6b68"} Sep 17 14:06:50.391012 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:50.390976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" event={"ID":"6f8164c5-f994-4099-b2c6-dd5040564a93","Type":"ContainerStarted","Data":"c097c964e52372b9cdab268db4f24b92500b49c4ee8ccc76d28aa8fa401e7874"} Sep 17 14:06:50.409216 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:50.409164 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p6vjq" podStartSLOduration=33.850245854 podStartE2EDuration="35.409146978s" totalImagesPullingTime="1.558901124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:50.40890822 +0000 UTC m=+274.336885687" watchObservedRunningTime="2026-09-17 14:06:50.409146978 +0000 UTC m=+274.337124443" Sep 17 14:06:53.020035 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.019996 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-bzdqb"] Sep 17 14:06:53.050430 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.050401 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-bzdqb"] Sep 17 14:06:53.050600 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.050483 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-bzdqb" Sep 17 14:06:53.052836 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.052818 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 14:06:53.052956 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.052940 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 14:06:53.053287 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.053273 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lkq62\"" Sep 17 14:06:53.072524 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.072493 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57975479c6-fwh6q"] Sep 17 14:06:53.072697 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:53.072679 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-57975479c6-fwh6q" podUID="61ec268d-ed0d-48c5-900a-379449c25e75" Sep 17 14:06:53.085422 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.085395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp8rd\" (UniqueName: \"kubernetes.io/projected/bfcd7362-3d16-41d1-b192-8173b45a3acd-kube-api-access-jp8rd\") pod \"downloads-76f99584f4-bzdqb\" (UID: \"bfcd7362-3d16-41d1-b192-8173b45a3acd\") " pod="openshift-console/downloads-76f99584f4-bzdqb" Sep 17 14:06:53.148553 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.148521 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5"] Sep 17 14:06:53.166416 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.166389 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5" Sep 17 14:06:53.170067 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.170041 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5wbc2\"" Sep 17 14:06:53.170201 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.170136 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 14:06:53.181736 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.181711 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5"] Sep 17 14:06:53.185811 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.185782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp8rd\" (UniqueName: \"kubernetes.io/projected/bfcd7362-3d16-41d1-b192-8173b45a3acd-kube-api-access-jp8rd\") pod \"downloads-76f99584f4-bzdqb\" (UID: \"bfcd7362-3d16-41d1-b192-8173b45a3acd\") " pod="openshift-console/downloads-76f99584f4-bzdqb" Sep 17 14:06:53.185929 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.185869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/46ac7e45-6ba7-4674-9ad1-e0d1e7c6aeeb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-27fp5\" (UID: \"46ac7e45-6ba7-4674-9ad1-e0d1e7c6aeeb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5" Sep 17 14:06:53.202944 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.202918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp8rd\" (UniqueName: \"kubernetes.io/projected/bfcd7362-3d16-41d1-b192-8173b45a3acd-kube-api-access-jp8rd\") pod \"downloads-76f99584f4-bzdqb\" (UID: \"bfcd7362-3d16-41d1-b192-8173b45a3acd\") " pod="openshift-console/downloads-76f99584f4-bzdqb" Sep 17 14:06:53.241539 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.241509 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-678cbb8976-tvr7z"] Sep 17 14:06:53.260424 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.260402 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.263833 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.263810 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-678cbb8976-tvr7z"] Sep 17 14:06:53.286623 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.286552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tkjt\" (UniqueName: \"kubernetes.io/projected/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-kube-api-access-7tkjt\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.286623 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.286608 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-registry-tls\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.286766 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.286651 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-bound-sa-token\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.286766 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.286694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-installation-pull-secrets\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.286766 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.286730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-ca-trust-extracted\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.286766 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.286752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-image-registry-private-configuration\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.286910 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.286775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-registry-certificates\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.286910 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.286814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/46ac7e45-6ba7-4674-9ad1-e0d1e7c6aeeb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-27fp5\" (UID: \"46ac7e45-6ba7-4674-9ad1-e0d1e7c6aeeb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5" Sep 17 14:06:53.286910 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.286838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-trusted-ca\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.289088 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.289069 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/46ac7e45-6ba7-4674-9ad1-e0d1e7c6aeeb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-27fp5\" (UID: \"46ac7e45-6ba7-4674-9ad1-e0d1e7c6aeeb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5" Sep 17 14:06:53.359315 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.359281 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-bzdqb" Sep 17 14:06:53.387592 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.387568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-registry-tls\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.387592 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.387599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-bound-sa-token\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.387738 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.387637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-installation-pull-secrets\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.387908 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.387880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-ca-trust-extracted\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.388001 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.387934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-image-registry-private-configuration\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.388001 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.387976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-registry-certificates\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.388111 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.388028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-trusted-ca\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.388111 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.388092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tkjt\" (UniqueName: \"kubernetes.io/projected/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-kube-api-access-7tkjt\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.388541 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.388502 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-ca-trust-extracted\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.389160 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.389137 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-trusted-ca\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.389300 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.389284 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-registry-certificates\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.390504 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.390477 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-installation-pull-secrets\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.390809 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.390768 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-registry-tls\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.390953 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.390933 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-image-registry-private-configuration\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.397124 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.397012 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tkjt\" (UniqueName: \"kubernetes.io/projected/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-kube-api-access-7tkjt\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.397759 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.397710 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a484fef-5bbb-4c3e-b9fb-46d7f42bf070-bound-sa-token\") pod \"image-registry-678cbb8976-tvr7z\" (UID: \"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070\") " pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.399985 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.399966 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:06:53.439072 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.439024 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:06:53.476457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.476427 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5" Sep 17 14:06:53.488639 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.488608 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-registry-certificates\") pod \"61ec268d-ed0d-48c5-900a-379449c25e75\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " Sep 17 14:06:53.488794 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.488652 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-image-registry-private-configuration\") pod \"61ec268d-ed0d-48c5-900a-379449c25e75\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " Sep 17 14:06:53.488794 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.488678 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-trusted-ca\") pod \"61ec268d-ed0d-48c5-900a-379449c25e75\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " Sep 17 14:06:53.488794 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.488708 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-bound-sa-token\") pod \"61ec268d-ed0d-48c5-900a-379449c25e75\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " Sep 17 14:06:53.488794 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.488732 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61ec268d-ed0d-48c5-900a-379449c25e75-ca-trust-extracted\") pod \"61ec268d-ed0d-48c5-900a-379449c25e75\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " Sep 17 14:06:53.488794 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.488756 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-installation-pull-secrets\") pod \"61ec268d-ed0d-48c5-900a-379449c25e75\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " Sep 17 14:06:53.489049 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.488814 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msp7h\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-kube-api-access-msp7h\") pod \"61ec268d-ed0d-48c5-900a-379449c25e75\" (UID: \"61ec268d-ed0d-48c5-900a-379449c25e75\") " Sep 17 14:06:53.489146 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.489042 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "61ec268d-ed0d-48c5-900a-379449c25e75" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:06:53.489215 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.489138 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61ec268d-ed0d-48c5-900a-379449c25e75-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "61ec268d-ed0d-48c5-900a-379449c25e75" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 14:06:53.489215 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.489169 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "61ec268d-ed0d-48c5-900a-379449c25e75" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:06:53.491387 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.491331 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "61ec268d-ed0d-48c5-900a-379449c25e75" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:06:53.491485 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.491378 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "61ec268d-ed0d-48c5-900a-379449c25e75" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:06:53.491485 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.491411 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "61ec268d-ed0d-48c5-900a-379449c25e75" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:06:53.491485 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.491409 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-kube-api-access-msp7h" (OuterVolumeSpecName: "kube-api-access-msp7h") pod "61ec268d-ed0d-48c5-900a-379449c25e75" (UID: "61ec268d-ed0d-48c5-900a-379449c25e75"). InnerVolumeSpecName "kube-api-access-msp7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:06:53.572895 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.572830 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pd9ps\"" Sep 17 14:06:53.581121 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.581097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:53.589627 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.589604 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-image-registry-private-configuration\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:06:53.589627 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.589629 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-trusted-ca\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:06:53.589772 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.589641 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-bound-sa-token\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:06:53.589772 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.589655 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61ec268d-ed0d-48c5-900a-379449c25e75-ca-trust-extracted\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:06:53.589772 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.589667 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61ec268d-ed0d-48c5-900a-379449c25e75-installation-pull-secrets\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:06:53.589772 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.589680 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msp7h\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-kube-api-access-msp7h\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:06:53.589772 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.589693 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61ec268d-ed0d-48c5-900a-379449c25e75-registry-certificates\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:06:53.648403 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.648355 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-bzdqb"] Sep 17 14:06:53.651987 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:53.651965 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfcd7362_3d16_41d1_b192_8173b45a3acd.slice/crio-5e206ec2137fa73c3979643596b9c01f51a47ccdd4e3a3b4d88573a5598dd9ad WatchSource:0}: Error finding container 5e206ec2137fa73c3979643596b9c01f51a47ccdd4e3a3b4d88573a5598dd9ad: Status 404 returned error can't find the container with id 5e206ec2137fa73c3979643596b9c01f51a47ccdd4e3a3b4d88573a5598dd9ad Sep 17 14:06:53.690316 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.690287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:53.692457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.692433 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7c9d\" (UID: \"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c\") " pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:53.757525 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.757496 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5"] Sep 17 14:06:53.760168 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:53.760140 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ac7e45_6ba7_4674_9ad1_e0d1e7c6aeeb.slice/crio-b44f32bf7afde58107ea49bcb017d81a11663f1a5d948b1f2b965d757133ccc8 WatchSource:0}: Error finding container b44f32bf7afde58107ea49bcb017d81a11663f1a5d948b1f2b965d757133ccc8: Status 404 returned error can't find the container with id b44f32bf7afde58107ea49bcb017d81a11663f1a5d948b1f2b965d757133ccc8 Sep 17 14:06:53.884485 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.884454 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-678cbb8976-tvr7z"] Sep 17 14:06:53.887131 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:53.887098 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a484fef_5bbb_4c3e_b9fb_46d7f42bf070.slice/crio-34b7f2aa558083d6326f49c36d10e6e946cc16a2e52b93e704a690eef8f32c58 WatchSource:0}: Error finding container 34b7f2aa558083d6326f49c36d10e6e946cc16a2e52b93e704a690eef8f32c58: Status 404 returned error can't find the container with id 34b7f2aa558083d6326f49c36d10e6e946cc16a2e52b93e704a690eef8f32c58 Sep 17 14:06:53.908623 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:53.908597 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k7c9d" Sep 17 14:06:54.200210 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.200130 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k7c9d"] Sep 17 14:06:54.203924 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:54.203890 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ea5f60_4d0e_490d_ac5c_b33dafe2f55c.slice/crio-71fc3bb8626ac55fc5a14ff37327500d22899f636afeba7246ac86f287855b09 WatchSource:0}: Error finding container 71fc3bb8626ac55fc5a14ff37327500d22899f636afeba7246ac86f287855b09: Status 404 returned error can't find the container with id 71fc3bb8626ac55fc5a14ff37327500d22899f636afeba7246ac86f287855b09 Sep 17 14:06:54.407010 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.406969 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k7c9d" event={"ID":"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c","Type":"ContainerStarted","Data":"385e6f487a5691181c03a4d42333fe524bf729ec40fbe8d8902df68f30137b2a"} Sep 17 14:06:54.407267 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.407033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k7c9d" event={"ID":"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c","Type":"ContainerStarted","Data":"71fc3bb8626ac55fc5a14ff37327500d22899f636afeba7246ac86f287855b09"} Sep 17 14:06:54.408732 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.408702 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-bzdqb" event={"ID":"bfcd7362-3d16-41d1-b192-8173b45a3acd","Type":"ContainerStarted","Data":"5e206ec2137fa73c3979643596b9c01f51a47ccdd4e3a3b4d88573a5598dd9ad"} Sep 17 14:06:54.410272 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.410241 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5" event={"ID":"46ac7e45-6ba7-4674-9ad1-e0d1e7c6aeeb","Type":"ContainerStarted","Data":"b44f32bf7afde58107ea49bcb017d81a11663f1a5d948b1f2b965d757133ccc8"} Sep 17 14:06:54.412400 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.412311 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" event={"ID":"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070","Type":"ContainerStarted","Data":"3052722127aafb7b88f02c0b8838af6d4d16746bce3679f2b5e446ee9bbde304"} Sep 17 14:06:54.412400 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.412350 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" event={"ID":"5a484fef-5bbb-4c3e-b9fb-46d7f42bf070","Type":"ContainerStarted","Data":"34b7f2aa558083d6326f49c36d10e6e946cc16a2e52b93e704a690eef8f32c58"} Sep 17 14:06:54.412574 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.412400 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57975479c6-fwh6q" Sep 17 14:06:54.436916 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.436861 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" podStartSLOduration=1.4368383169999999 podStartE2EDuration="1.436838317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:54.435452529 +0000 UTC m=+278.363429995" watchObservedRunningTime="2026-09-17 14:06:54.436838317 +0000 UTC m=+278.364815784" Sep 17 14:06:54.461891 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.461799 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57975479c6-fwh6q"] Sep 17 14:06:54.465148 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.465121 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57975479c6-fwh6q"] Sep 17 14:06:54.496931 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.496619 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61ec268d-ed0d-48c5-900a-379449c25e75-registry-tls\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:06:54.571058 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:54.571024 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61ec268d-ed0d-48c5-900a-379449c25e75" path="/var/lib/kubelet/pods/61ec268d-ed0d-48c5-900a-379449c25e75/volumes" Sep 17 14:06:55.415777 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:55.415742 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:06:56.065294 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:06:56.065251 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-q4z4b" podUID="79997312-f6a0-415d-9dbb-d29c56ef8fa3" Sep 17 14:06:56.423230 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:56.423195 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5" event={"ID":"46ac7e45-6ba7-4674-9ad1-e0d1e7c6aeeb","Type":"ContainerStarted","Data":"4e7c8d57476ad9986e02e7db21b426c993089401b6bab0d00981fc3cbe4757c1"} Sep 17 14:06:56.423741 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:56.423398 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5" Sep 17 14:06:56.425665 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:56.425579 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k7c9d" event={"ID":"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c","Type":"ContainerStarted","Data":"e96751bd4bb71563d6bc57cb753ad09515804c7ac05dfbf8297979ee2c6eb918"} Sep 17 14:06:56.425665 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:56.425651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q4z4b" Sep 17 14:06:56.428889 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:56.428858 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5" Sep 17 14:06:56.441595 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:56.441495 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-27fp5" podStartSLOduration=1.7583976319999999 podStartE2EDuration="3.441478971s" totalImagesPullingTime="1.683081339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:56.441142429 +0000 UTC m=+280.369119896" watchObservedRunningTime="2026-09-17 14:06:56.441478971 +0000 UTC m=+280.369456438" Sep 17 14:06:57.416127 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.416093 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg"] Sep 17 14:06:57.418470 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.418444 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.421747 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.421724 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 14:06:57.421747 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.421743 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 14:06:57.422662 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.422639 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 14:06:57.422753 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.422684 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dwn4p\"" Sep 17 14:06:57.442513 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.441489 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg"] Sep 17 14:06:57.526574 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.526534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxwcr\" (UniqueName: \"kubernetes.io/projected/fd33a2e3-d262-4a26-80a2-4fa316eafe80-kube-api-access-nxwcr\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.526740 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.526640 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd33a2e3-d262-4a26-80a2-4fa316eafe80-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.526740 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.526694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd33a2e3-d262-4a26-80a2-4fa316eafe80-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.526740 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.526723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd33a2e3-d262-4a26-80a2-4fa316eafe80-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.627419 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.627362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd33a2e3-d262-4a26-80a2-4fa316eafe80-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.627610 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.627436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd33a2e3-d262-4a26-80a2-4fa316eafe80-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.627610 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.627548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd33a2e3-d262-4a26-80a2-4fa316eafe80-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.627717 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.627620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxwcr\" (UniqueName: \"kubernetes.io/projected/fd33a2e3-d262-4a26-80a2-4fa316eafe80-kube-api-access-nxwcr\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.628219 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.628196 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd33a2e3-d262-4a26-80a2-4fa316eafe80-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.630169 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.630147 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd33a2e3-d262-4a26-80a2-4fa316eafe80-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.630359 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.630334 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd33a2e3-d262-4a26-80a2-4fa316eafe80-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.636695 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.636650 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxwcr\" (UniqueName: \"kubernetes.io/projected/fd33a2e3-d262-4a26-80a2-4fa316eafe80-kube-api-access-nxwcr\") pod \"prometheus-operator-68bcd7f987-b2pdg\" (UID: \"fd33a2e3-d262-4a26-80a2-4fa316eafe80\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:57.729457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:57.729360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" Sep 17 14:06:58.005127 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:58.005032 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg"] Sep 17 14:06:58.008562 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:06:58.008536 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd33a2e3_d262_4a26_80a2_4fa316eafe80.slice/crio-b7f442c5c3ccf3f4f0499681504db0a112a030c83956b6720c5bb8c1d254ee4e WatchSource:0}: Error finding container b7f442c5c3ccf3f4f0499681504db0a112a030c83956b6720c5bb8c1d254ee4e: Status 404 returned error can't find the container with id b7f442c5c3ccf3f4f0499681504db0a112a030c83956b6720c5bb8c1d254ee4e Sep 17 14:06:58.436002 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:58.435956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k7c9d" event={"ID":"d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c","Type":"ContainerStarted","Data":"d4a8eafae93aa349f1bfb9f9a8129c8c8ca7c6f54de06789b986a2ad1a589ed8"} Sep 17 14:06:58.437308 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:58.437274 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" event={"ID":"fd33a2e3-d262-4a26-80a2-4fa316eafe80","Type":"ContainerStarted","Data":"b7f442c5c3ccf3f4f0499681504db0a112a030c83956b6720c5bb8c1d254ee4e"} Sep 17 14:06:58.461617 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:58.461570 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k7c9d" podStartSLOduration=34.406161121 podStartE2EDuration="37.461553306s" totalImagesPullingTime="3.055392185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:58.459831838 +0000 UTC m=+282.387809304" watchObservedRunningTime="2026-09-17 14:06:58.461553306 +0000 UTC m=+282.389530773" Sep 17 14:06:59.443997 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:59.443956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" event={"ID":"fd33a2e3-d262-4a26-80a2-4fa316eafe80","Type":"ContainerStarted","Data":"9fd469afc1821ff7863cc500723cdd83f72169df451b3c6a12bbcf2fab9a93b1"} Sep 17 14:06:59.444170 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:59.444039 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" event={"ID":"fd33a2e3-d262-4a26-80a2-4fa316eafe80","Type":"ContainerStarted","Data":"549d9ef4c2dea86d9c539c735843fcc1f13c57ced13d2c5de1c460e15b7ab551"} Sep 17 14:06:59.463151 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:59.463100 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-b2pdg" podStartSLOduration=1.223756672 podStartE2EDuration="2.463084222s" totalImagesPullingTime="1.23932755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:59.461144603 +0000 UTC m=+283.389122070" watchObservedRunningTime="2026-09-17 14:06:59.463084222 +0000 UTC m=+283.391061695" Sep 17 14:06:59.848197 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:59.848157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:06:59.850889 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:06:59.850860 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79997312-f6a0-415d-9dbb-d29c56ef8fa3-metrics-tls\") pod \"dns-default-q4z4b\" (UID: \"79997312-f6a0-415d-9dbb-d29c56ef8fa3\") " pod="openshift-dns/dns-default-q4z4b" Sep 17 14:07:00.029454 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:00.029416 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f4m2t\"" Sep 17 14:07:00.037521 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:00.037491 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q4z4b" Sep 17 14:07:00.319509 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:00.319431 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q4z4b"] Sep 17 14:07:00.323586 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:07:00.323554 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79997312_f6a0_415d_9dbb_d29c56ef8fa3.slice/crio-64832518ba1923d17a6882f585c0a71fc45cf98f7f51b13bbe23e087387e4347 WatchSource:0}: Error finding container 64832518ba1923d17a6882f585c0a71fc45cf98f7f51b13bbe23e087387e4347: Status 404 returned error can't find the container with id 64832518ba1923d17a6882f585c0a71fc45cf98f7f51b13bbe23e087387e4347 Sep 17 14:07:00.448696 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:00.448661 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q4z4b" event={"ID":"79997312-f6a0-415d-9dbb-d29c56ef8fa3","Type":"ContainerStarted","Data":"64832518ba1923d17a6882f585c0a71fc45cf98f7f51b13bbe23e087387e4347"} Sep 17 14:07:01.804506 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.804466 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l"] Sep 17 14:07:01.807353 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.807314 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.810020 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.809995 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-prkhx\"" Sep 17 14:07:01.810167 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.810143 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 14:07:01.810331 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.810311 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 14:07:01.819741 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.819713 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l"] Sep 17 14:07:01.868171 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.868131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhl94\" (UniqueName: \"kubernetes.io/projected/93280963-56ab-4c51-a375-e2ff203f4528-kube-api-access-mhl94\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.868338 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.868196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93280963-56ab-4c51-a375-e2ff203f4528-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.868338 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.868230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93280963-56ab-4c51-a375-e2ff203f4528-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.868338 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.868282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93280963-56ab-4c51-a375-e2ff203f4528-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.875323 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.875287 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xwzvs"] Sep 17 14:07:01.878196 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.878144 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:01.881483 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.881458 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lcn5d\"" Sep 17 14:07:01.881654 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.881632 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 14:07:01.881753 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.881735 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 14:07:01.882145 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.881999 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 14:07:01.968966 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.968819 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a24d5a7-3c55-475f-919d-5f0e2ff31346-sys\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:01.968966 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.968871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93280963-56ab-4c51-a375-e2ff203f4528-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.968966 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.968919 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7mqg\" (UniqueName: \"kubernetes.io/projected/0a24d5a7-3c55-475f-919d-5f0e2ff31346-kube-api-access-k7mqg\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:01.969196 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.969051 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:01.969196 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.969094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-accelerators-collector-config\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:01.969196 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.969127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a24d5a7-3c55-475f-919d-5f0e2ff31346-root\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:01.969196 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.969149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-textfile\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:01.969196 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.969166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-tls\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:01.969196 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.969196 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93280963-56ab-4c51-a375-e2ff203f4528-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.969505 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.969214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a24d5a7-3c55-475f-919d-5f0e2ff31346-metrics-client-ca\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:01.969505 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.969282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhl94\" (UniqueName: \"kubernetes.io/projected/93280963-56ab-4c51-a375-e2ff203f4528-kube-api-access-mhl94\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.969505 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.969329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-wtmp\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:01.969505 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.969383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93280963-56ab-4c51-a375-e2ff203f4528-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.970069 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.970047 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93280963-56ab-4c51-a375-e2ff203f4528-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.973062 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.973014 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93280963-56ab-4c51-a375-e2ff203f4528-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.973165 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.973134 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93280963-56ab-4c51-a375-e2ff203f4528-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:01.978289 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:01.978262 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhl94\" (UniqueName: \"kubernetes.io/projected/93280963-56ab-4c51-a375-e2ff203f4528-kube-api-access-mhl94\") pod \"openshift-state-metrics-67dcf8c979-kvc4l\" (UID: \"93280963-56ab-4c51-a375-e2ff203f4528\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:02.071499 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.071465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7mqg\" (UniqueName: \"kubernetes.io/projected/0a24d5a7-3c55-475f-919d-5f0e2ff31346-kube-api-access-k7mqg\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.071620 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.071518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.071620 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.071544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-accelerators-collector-config\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.071620 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.071574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a24d5a7-3c55-475f-919d-5f0e2ff31346-root\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.071620 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.071602 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-textfile\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.071820 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.071630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-tls\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.071820 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.071687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a24d5a7-3c55-475f-919d-5f0e2ff31346-metrics-client-ca\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.071820 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.071777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-wtmp\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.071820 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.071808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a24d5a7-3c55-475f-919d-5f0e2ff31346-sys\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.072006 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.071883 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a24d5a7-3c55-475f-919d-5f0e2ff31346-sys\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.072804 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.072777 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-textfile\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.073254 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:07:02.073008 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 17 14:07:02.073254 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:07:02.073078 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-tls podName:0a24d5a7-3c55-475f-919d-5f0e2ff31346 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:02.573058001 +0000 UTC m=+286.501035469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-tls") pod "node-exporter-xwzvs" (UID: "0a24d5a7-3c55-475f-919d-5f0e2ff31346") : secret "node-exporter-tls" not found Sep 17 14:07:02.073254 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.073131 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-wtmp\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.073254 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.073194 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a24d5a7-3c55-475f-919d-5f0e2ff31346-root\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.073746 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.073290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a24d5a7-3c55-475f-919d-5f0e2ff31346-metrics-client-ca\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.073746 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.073295 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-accelerators-collector-config\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.076099 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.076073 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.080898 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.080850 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7mqg\" (UniqueName: \"kubernetes.io/projected/0a24d5a7-3c55-475f-919d-5f0e2ff31346-kube-api-access-k7mqg\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.121328 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.121260 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" Sep 17 14:07:02.408217 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.408126 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l"] Sep 17 14:07:02.410953 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:07:02.410925 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93280963_56ab_4c51_a375_e2ff203f4528.slice/crio-3bcbefbca68826d016175edc248487e5523aa756631ce83373f392129348819b WatchSource:0}: Error finding container 3bcbefbca68826d016175edc248487e5523aa756631ce83373f392129348819b: Status 404 returned error can't find the container with id 3bcbefbca68826d016175edc248487e5523aa756631ce83373f392129348819b Sep 17 14:07:02.458941 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.458907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" event={"ID":"93280963-56ab-4c51-a375-e2ff203f4528","Type":"ContainerStarted","Data":"3bcbefbca68826d016175edc248487e5523aa756631ce83373f392129348819b"} Sep 17 14:07:02.461388 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.461346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q4z4b" event={"ID":"79997312-f6a0-415d-9dbb-d29c56ef8fa3","Type":"ContainerStarted","Data":"796a325bef0ccd00d2bb7440b6ffb25bc6c36ee2943cbd15429e4155cf966cca"} Sep 17 14:07:02.461496 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.461414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q4z4b" event={"ID":"79997312-f6a0-415d-9dbb-d29c56ef8fa3","Type":"ContainerStarted","Data":"733b12e92c22ed3ef3041d4095a8d5cdf8efbd6fb805e30d834e31037b8b2396"} Sep 17 14:07:02.461560 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.461530 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q4z4b" Sep 17 14:07:02.480685 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.480403 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q4z4b" podStartSLOduration=251.858362705 podStartE2EDuration="4m13.480382469s" totalImagesPullingTime="1.622019764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:02:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:02.479889985 +0000 UTC m=+286.407867442" watchObservedRunningTime="2026-09-17 14:07:02.480382469 +0000 UTC m=+286.408359928" Sep 17 14:07:02.576491 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.576060 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-tls\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.578916 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.578883 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a24d5a7-3c55-475f-919d-5f0e2ff31346-node-exporter-tls\") pod \"node-exporter-xwzvs\" (UID: \"0a24d5a7-3c55-475f-919d-5f0e2ff31346\") " pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.791287 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:02.791204 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xwzvs" Sep 17 14:07:02.802552 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:07:02.802517 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a24d5a7_3c55_475f_919d_5f0e2ff31346.slice/crio-37eb92891294995879f4fc3f5f3acad85bc3504ad9fb2cef24ac03cc8d731f23 WatchSource:0}: Error finding container 37eb92891294995879f4fc3f5f3acad85bc3504ad9fb2cef24ac03cc8d731f23: Status 404 returned error can't find the container with id 37eb92891294995879f4fc3f5f3acad85bc3504ad9fb2cef24ac03cc8d731f23 Sep 17 14:07:03.471814 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:03.471773 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" event={"ID":"93280963-56ab-4c51-a375-e2ff203f4528","Type":"ContainerStarted","Data":"a4a42d178adfea8c59fd843b72fa61d94b51825ec3d2e22f7af677148d11c9d0"} Sep 17 14:07:03.472318 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:03.471848 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" event={"ID":"93280963-56ab-4c51-a375-e2ff203f4528","Type":"ContainerStarted","Data":"e5bd5291135aba2a1d0bd9f9a3568578ee3504ccb5b97e080ca40d2968beaabe"} Sep 17 14:07:03.474383 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:03.474329 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xwzvs" event={"ID":"0a24d5a7-3c55-475f-919d-5f0e2ff31346","Type":"ContainerStarted","Data":"37eb92891294995879f4fc3f5f3acad85bc3504ad9fb2cef24ac03cc8d731f23"} Sep 17 14:07:04.480742 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:04.480486 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" event={"ID":"93280963-56ab-4c51-a375-e2ff203f4528","Type":"ContainerStarted","Data":"7869fb87161ea29d78ffbf6ca86330cd54e42b26fc18ffbf41c974a3feef700e"} Sep 17 14:07:04.482562 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:04.482530 2579 generic.go:356] "Generic (PLEG): container finished" podID="0a24d5a7-3c55-475f-919d-5f0e2ff31346" containerID="6b2b23bf8e0fcdd1a40fcc37be639ad71c01b26041614fd09cc07970ea602064" exitCode=0 Sep 17 14:07:04.482677 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:04.482570 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xwzvs" event={"ID":"0a24d5a7-3c55-475f-919d-5f0e2ff31346","Type":"ContainerDied","Data":"6b2b23bf8e0fcdd1a40fcc37be639ad71c01b26041614fd09cc07970ea602064"} Sep 17 14:07:04.500125 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:04.500080 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-kvc4l" podStartSLOduration=2.46810648 podStartE2EDuration="3.500057975s" totalImagesPullingTime="1.031951495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:04.498132115 +0000 UTC m=+288.426109613" watchObservedRunningTime="2026-09-17 14:07:04.500057975 +0000 UTC m=+288.428035442" Sep 17 14:07:06.111036 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.111005 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-797496f795-f8sdb"] Sep 17 14:07:06.114093 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.114065 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.120336 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.120300 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 14:07:06.120506 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.120481 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9q74d\"" Sep 17 14:07:06.120611 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.120589 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 14:07:06.120680 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.120606 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 14:07:06.121177 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.121155 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 14:07:06.123198 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.122150 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-436fv7vtnrp10\"" Sep 17 14:07:06.127198 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.126753 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-797496f795-f8sdb"] Sep 17 14:07:06.207840 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.207800 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/92e2fc74-03a0-4338-ab5e-657d530593a5-secret-metrics-server-client-certs\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.208034 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.207860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/92e2fc74-03a0-4338-ab5e-657d530593a5-audit-log\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.208034 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.207951 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d62wl\" (UniqueName: \"kubernetes.io/projected/92e2fc74-03a0-4338-ab5e-657d530593a5-kube-api-access-d62wl\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.208034 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.207992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/92e2fc74-03a0-4338-ab5e-657d530593a5-metrics-server-audit-profiles\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.208034 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.208021 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92e2fc74-03a0-4338-ab5e-657d530593a5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.208207 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.208050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92e2fc74-03a0-4338-ab5e-657d530593a5-client-ca-bundle\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.208207 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.208156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/92e2fc74-03a0-4338-ab5e-657d530593a5-secret-metrics-server-tls\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.309146 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.309108 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/92e2fc74-03a0-4338-ab5e-657d530593a5-audit-log\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.309315 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.309166 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d62wl\" (UniqueName: \"kubernetes.io/projected/92e2fc74-03a0-4338-ab5e-657d530593a5-kube-api-access-d62wl\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.309315 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.309211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/92e2fc74-03a0-4338-ab5e-657d530593a5-metrics-server-audit-profiles\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.309315 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.309237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92e2fc74-03a0-4338-ab5e-657d530593a5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.309315 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.309260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92e2fc74-03a0-4338-ab5e-657d530593a5-client-ca-bundle\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.309545 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.309331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/92e2fc74-03a0-4338-ab5e-657d530593a5-secret-metrics-server-tls\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.309545 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.309392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/92e2fc74-03a0-4338-ab5e-657d530593a5-secret-metrics-server-client-certs\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.309640 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.309575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/92e2fc74-03a0-4338-ab5e-657d530593a5-audit-log\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.310354 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.310293 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92e2fc74-03a0-4338-ab5e-657d530593a5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.310664 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.310641 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/92e2fc74-03a0-4338-ab5e-657d530593a5-metrics-server-audit-profiles\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.312763 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.312738 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/92e2fc74-03a0-4338-ab5e-657d530593a5-secret-metrics-server-client-certs\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.312865 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.312821 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/92e2fc74-03a0-4338-ab5e-657d530593a5-secret-metrics-server-tls\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.312865 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.312821 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92e2fc74-03a0-4338-ab5e-657d530593a5-client-ca-bundle\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.317713 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.317689 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d62wl\" (UniqueName: \"kubernetes.io/projected/92e2fc74-03a0-4338-ab5e-657d530593a5-kube-api-access-d62wl\") pod \"metrics-server-797496f795-f8sdb\" (UID: \"92e2fc74-03a0-4338-ab5e-657d530593a5\") " pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.432105 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.432022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:06.597574 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.597529 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj"] Sep 17 14:07:06.599948 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.599924 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" Sep 17 14:07:06.602594 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.602521 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cs4ks\"" Sep 17 14:07:06.602790 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.602774 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 14:07:06.609911 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.609879 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj"] Sep 17 14:07:06.642739 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.642709 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-648bc89cb7-927bt"] Sep 17 14:07:06.645025 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.645005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.648999 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.648972 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 14:07:06.649437 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.649217 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 14:07:06.649437 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.649251 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 14:07:06.649437 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.649280 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-n7jsz\"" Sep 17 14:07:06.649437 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.649254 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 14:07:06.650338 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.650316 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 14:07:06.654987 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.654965 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 14:07:06.660076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.660055 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648bc89cb7-927bt"] Sep 17 14:07:06.713306 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.713224 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-trusted-ca-bundle\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.713306 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.713266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-service-ca\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.713551 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.713362 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk2d7\" (UniqueName: \"kubernetes.io/projected/a1397b67-29af-4000-a721-e8d28fb6047f-kube-api-access-jk2d7\") pod \"monitoring-plugin-5d85778b9d-f5cfj\" (UID: \"a1397b67-29af-4000-a721-e8d28fb6047f\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" Sep 17 14:07:06.713551 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.713403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-oauth-config\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.713551 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.713480 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-oauth-serving-cert\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.713551 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.713531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1397b67-29af-4000-a721-e8d28fb6047f-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-f5cfj\" (UID: \"a1397b67-29af-4000-a721-e8d28fb6047f\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" Sep 17 14:07:06.713749 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.713578 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-serving-cert\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.713749 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.713625 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9wz\" (UniqueName: \"kubernetes.io/projected/8c9a0e52-a288-498e-982e-78c459553d45-kube-api-access-5w9wz\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.713749 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.713661 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-console-config\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.814264 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.814228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-console-config\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.814457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.814281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-trusted-ca-bundle\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.814457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.814305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-service-ca\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.814457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.814351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk2d7\" (UniqueName: \"kubernetes.io/projected/a1397b67-29af-4000-a721-e8d28fb6047f-kube-api-access-jk2d7\") pod \"monitoring-plugin-5d85778b9d-f5cfj\" (UID: \"a1397b67-29af-4000-a721-e8d28fb6047f\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" Sep 17 14:07:06.814457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.814391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-oauth-config\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.814457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.814446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-oauth-serving-cert\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.814727 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.814482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1397b67-29af-4000-a721-e8d28fb6047f-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-f5cfj\" (UID: \"a1397b67-29af-4000-a721-e8d28fb6047f\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" Sep 17 14:07:06.814727 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:07:06.814574 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 17 14:07:06.814727 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:07:06.814633 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1397b67-29af-4000-a721-e8d28fb6047f-monitoring-plugin-cert podName:a1397b67-29af-4000-a721-e8d28fb6047f nodeName:}" failed. No retries permitted until 2026-09-17 14:07:07.314613363 +0000 UTC m=+291.242590827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a1397b67-29af-4000-a721-e8d28fb6047f-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-f5cfj" (UID: "a1397b67-29af-4000-a721-e8d28fb6047f") : secret "monitoring-plugin-cert" not found Sep 17 14:07:06.814969 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.814933 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-serving-cert\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.815061 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.815009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9wz\" (UniqueName: \"kubernetes.io/projected/8c9a0e52-a288-498e-982e-78c459553d45-kube-api-access-5w9wz\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.815113 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.815095 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-console-config\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.815245 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.815219 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-service-ca\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.815354 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.815272 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-trusted-ca-bundle\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.815433 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.815396 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-oauth-serving-cert\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.817704 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.817681 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-serving-cert\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.817801 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.817783 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-oauth-config\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.826978 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.826950 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9wz\" (UniqueName: \"kubernetes.io/projected/8c9a0e52-a288-498e-982e-78c459553d45-kube-api-access-5w9wz\") pod \"console-648bc89cb7-927bt\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:06.827129 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.827029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk2d7\" (UniqueName: \"kubernetes.io/projected/a1397b67-29af-4000-a721-e8d28fb6047f-kube-api-access-jk2d7\") pod \"monitoring-plugin-5d85778b9d-f5cfj\" (UID: \"a1397b67-29af-4000-a721-e8d28fb6047f\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" Sep 17 14:07:06.956779 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:06.956717 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:07.319591 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:07.319551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1397b67-29af-4000-a721-e8d28fb6047f-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-f5cfj\" (UID: \"a1397b67-29af-4000-a721-e8d28fb6047f\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" Sep 17 14:07:07.322341 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:07.322310 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1397b67-29af-4000-a721-e8d28fb6047f-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-f5cfj\" (UID: \"a1397b67-29af-4000-a721-e8d28fb6047f\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" Sep 17 14:07:07.511610 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:07.511576 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" Sep 17 14:07:08.126625 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.126587 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:07:08.131454 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.130100 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.133333 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.133298 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 14:07:08.133798 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.133649 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 14:07:08.133798 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.133692 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-834mcghlm853o\"" Sep 17 14:07:08.136031 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.135705 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 14:07:08.136031 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.135769 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 14:07:08.136031 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.135922 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 14:07:08.137989 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.137343 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 14:07:08.137989 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.137421 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 14:07:08.137989 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.137653 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 14:07:08.137989 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.137945 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 14:07:08.137989 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.137953 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 14:07:08.138318 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.137997 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 14:07:08.138318 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.137997 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rm292\"" Sep 17 14:07:08.138318 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.138040 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 14:07:08.145016 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.144990 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 14:07:08.151327 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.151297 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 14:07:08.156119 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.156094 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:07:08.227700 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.227351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9pn5\" (UniqueName: \"kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-kube-api-access-j9pn5\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.227700 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.227429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.227700 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.227474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.227700 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.227505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.227700 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.227548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.227700 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.227573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.227700 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.227624 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-config\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.227700 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.227649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.227700 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.227707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.228271 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.227827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.228271 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.227918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.228271 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.228039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.228271 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.228070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.228271 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.228094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.228271 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.228144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.228271 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.228172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.228271 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.228217 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.228698 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.228244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.228698 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.228411 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.228698 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.228499 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.329402 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329235 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.329402 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.329402 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.329402 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.329402 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329388 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pn5\" (UniqueName: \"kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-kube-api-access-j9pn5\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329480 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329597 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-config\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.329878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.330076 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.330068 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.332203 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.332168 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.333248 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.332819 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.333248 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.333007 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.333416 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.333313 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.333416 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.333383 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.334027 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.333695 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.334027 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.333797 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.335479 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.335239 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-config\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.336037 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.336003 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.336187 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.336169 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.336557 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.336315 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.336557 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.336331 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.336708 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.336661 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.338249 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.338196 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.338612 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.338585 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.338809 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.338732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.341517 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.341495 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.341604 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.341595 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.350196 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.350166 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9pn5\" (UniqueName: \"kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-kube-api-access-j9pn5\") pod \"prometheus-k8s-0\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.452131 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:08.452033 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:08.567858 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:07:08.567815 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xs7g2" podUID="11c9baa0-1192-4bca-a430-9b2fd7484dd7" Sep 17 14:07:11.841238 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:11.841206 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648bc89cb7-927bt"] Sep 17 14:07:11.844509 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:07:11.844456 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c9a0e52_a288_498e_982e_78c459553d45.slice/crio-0b7fd3cdf226ce1e7b576a2a598e4f69936eeaf77648408b491955cdc17fc665 WatchSource:0}: Error finding container 0b7fd3cdf226ce1e7b576a2a598e4f69936eeaf77648408b491955cdc17fc665: Status 404 returned error can't find the container with id 0b7fd3cdf226ce1e7b576a2a598e4f69936eeaf77648408b491955cdc17fc665 Sep 17 14:07:11.845151 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:11.845120 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj"] Sep 17 14:07:11.848045 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:11.848020 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-797496f795-f8sdb"] Sep 17 14:07:11.848841 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:07:11.848814 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1397b67_29af_4000_a721_e8d28fb6047f.slice/crio-4d5f54c340f76767d2fda057ccb9fcd2e30cb9e720060e363525d5b79b9fa99c WatchSource:0}: Error finding container 4d5f54c340f76767d2fda057ccb9fcd2e30cb9e720060e363525d5b79b9fa99c: Status 404 returned error can't find the container with id 4d5f54c340f76767d2fda057ccb9fcd2e30cb9e720060e363525d5b79b9fa99c Sep 17 14:07:11.890794 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:11.890765 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:07:11.893538 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:07:11.893508 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1edec5_bb73_466e_a2f9_10718e44bfef.slice/crio-8758b315664c35813aff224db7f83f486b616046af03ebd9e334498b7d46a85d WatchSource:0}: Error finding container 8758b315664c35813aff224db7f83f486b616046af03ebd9e334498b7d46a85d: Status 404 returned error can't find the container with id 8758b315664c35813aff224db7f83f486b616046af03ebd9e334498b7d46a85d Sep 17 14:07:12.476727 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:12.476691 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q4z4b" Sep 17 14:07:12.532416 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:12.531958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xwzvs" event={"ID":"0a24d5a7-3c55-475f-919d-5f0e2ff31346","Type":"ContainerStarted","Data":"85d710f53abc93fa1107569b4001d0fa13635f36010f895adcc3cc3627d59310"} Sep 17 14:07:12.532416 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:12.532025 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xwzvs" event={"ID":"0a24d5a7-3c55-475f-919d-5f0e2ff31346","Type":"ContainerStarted","Data":"ccbd1d48cb3a00770901c980385955e27920abfd62058b7a926ed6fbc43e34e4"} Sep 17 14:07:12.541311 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:12.536328 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" event={"ID":"a1397b67-29af-4000-a721-e8d28fb6047f","Type":"ContainerStarted","Data":"4d5f54c340f76767d2fda057ccb9fcd2e30cb9e720060e363525d5b79b9fa99c"} Sep 17 14:07:12.544007 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:12.543428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-bzdqb" event={"ID":"bfcd7362-3d16-41d1-b192-8173b45a3acd","Type":"ContainerStarted","Data":"9d53fc130927c9b5f7657253bfd32a3132deb64cc28aa177f80d2e5884f8609f"} Sep 17 14:07:12.544007 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:12.543684 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-bzdqb" Sep 17 14:07:12.546944 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:12.546868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648bc89cb7-927bt" event={"ID":"8c9a0e52-a288-498e-982e-78c459553d45","Type":"ContainerStarted","Data":"0b7fd3cdf226ce1e7b576a2a598e4f69936eeaf77648408b491955cdc17fc665"} Sep 17 14:07:12.558180 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:12.548003 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-bzdqb" Sep 17 14:07:12.569438 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:12.566335 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerStarted","Data":"8758b315664c35813aff224db7f83f486b616046af03ebd9e334498b7d46a85d"} Sep 17 14:07:12.598026 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:12.589477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-797496f795-f8sdb" event={"ID":"92e2fc74-03a0-4338-ab5e-657d530593a5","Type":"ContainerStarted","Data":"a9e613846d88f8e3d1963bf284fb14fdec93f2077267cc74442db1c5ad2a89e0"} Sep 17 14:07:12.598026 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:12.596347 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xwzvs" podStartSLOduration=10.388798849 podStartE2EDuration="11.596326816s" totalImagesPullingTime="1.135202657s" totalInitContainerRuntime="72.32531ms" isStatefulPod=true podCreationTimestamp="2026-09-17 14:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:12.594496603 +0000 UTC m=+296.522474070" watchObservedRunningTime="2026-09-17 14:07:12.596326816 +0000 UTC m=+296.524304278" Sep 17 14:07:13.587863 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:13.587546 2579 patch_prober.go:28] interesting pod/image-registry-678cbb8976-tvr7z container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 14:07:13.587863 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:13.587612 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" podUID="5a484fef-5bbb-4c3e-b9fb-46d7f42bf070" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 14:07:16.432716 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:16.431904 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-678cbb8976-tvr7z" Sep 17 14:07:16.455778 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:16.455709 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-bzdqb" podStartSLOduration=6.445340374 podStartE2EDuration="24.455687517s" totalImagesPullingTime="18.010347143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:12.615293091 +0000 UTC m=+296.543270557" watchObservedRunningTime="2026-09-17 14:07:16.455687517 +0000 UTC m=+300.383664985" Sep 17 14:07:17.630238 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:17.630206 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-jxxht_13a299bd-26c1-42fe-97ba-4e392899fade/console-operator/1.log" Sep 17 14:07:17.630673 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:17.630432 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-jxxht_13a299bd-26c1-42fe-97ba-4e392899fade/console-operator/1.log" Sep 17 14:07:17.648874 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:17.648781 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 14:07:18.628579 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:18.628542 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerID="7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979" exitCode=0 Sep 17 14:07:18.628746 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:18.628644 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerDied","Data":"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979"} Sep 17 14:07:18.630204 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:18.630180 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 14:07:18.630621 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:18.630587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-797496f795-f8sdb" event={"ID":"92e2fc74-03a0-4338-ab5e-657d530593a5","Type":"ContainerStarted","Data":"c5886c8ad9e017fdc171065dcc79325a765b6659ffc831bb045d2687967f1a84"} Sep 17 14:07:18.632662 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:18.632634 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" event={"ID":"a1397b67-29af-4000-a721-e8d28fb6047f","Type":"ContainerStarted","Data":"37acfa022318f50ab9d4ac1cc9e16f8f4fee93b54a00edfd997d66d382524d04"} Sep 17 14:07:18.632874 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:18.632855 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" Sep 17 14:07:18.635313 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:18.635284 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648bc89cb7-927bt" event={"ID":"8c9a0e52-a288-498e-982e-78c459553d45","Type":"ContainerStarted","Data":"5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed"} Sep 17 14:07:18.639446 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:18.639421 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" Sep 17 14:07:18.682144 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:18.682060 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-648bc89cb7-927bt" podStartSLOduration=6.920832186 podStartE2EDuration="12.682041193s" totalImagesPullingTime="5.761209007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:18.680423206 +0000 UTC m=+302.608400673" watchObservedRunningTime="2026-09-17 14:07:18.682041193 +0000 UTC m=+302.610018660" Sep 17 14:07:18.696880 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:18.696832 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-797496f795-f8sdb" podStartSLOduration=6.954408022 podStartE2EDuration="12.696816105s" totalImagesPullingTime="5.742408083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:18.695698593 +0000 UTC m=+302.623676062" watchObservedRunningTime="2026-09-17 14:07:18.696816105 +0000 UTC m=+302.624793570" Sep 17 14:07:18.710701 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:18.710647 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-f5cfj" podStartSLOduration=6.967718116 podStartE2EDuration="12.710632186s" totalImagesPullingTime="5.74291407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:18.709748978 +0000 UTC m=+302.637726443" watchObservedRunningTime="2026-09-17 14:07:18.710632186 +0000 UTC m=+302.638609654" Sep 17 14:07:22.124489 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:22.123901 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648bc89cb7-927bt"] Sep 17 14:07:22.663997 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:22.663963 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerStarted","Data":"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc"} Sep 17 14:07:23.567160 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:23.567117 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:07:23.671850 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:23.671813 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerStarted","Data":"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e"} Sep 17 14:07:25.685799 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:25.685757 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerStarted","Data":"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb"} Sep 17 14:07:25.686270 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:25.685820 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerStarted","Data":"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b"} Sep 17 14:07:25.686270 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:25.685849 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerStarted","Data":"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f"} Sep 17 14:07:25.686270 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:25.685880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerStarted","Data":"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707"} Sep 17 14:07:25.714100 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:25.714036 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.9912967 podStartE2EDuration="17.714015553s" totalImagesPullingTime="11.705949577s" totalInitContainerRuntime="16.769276ms" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:25.712192917 +0000 UTC m=+309.640170383" watchObservedRunningTime="2026-09-17 14:07:25.714015553 +0000 UTC m=+309.641993021" Sep 17 14:07:26.432932 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:26.432902 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:26.433119 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:26.432956 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:26.691293 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:26.691198 2579 generic.go:356] "Generic (PLEG): container finished" podID="ad40e6da-5bd3-46cd-abe3-74b253e775e1" containerID="a154b5496e6c09c9e4f858fc438ca311217cef56feff99b924b185db6002efa0" exitCode=0 Sep 17 14:07:26.691293 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:26.691271 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" event={"ID":"ad40e6da-5bd3-46cd-abe3-74b253e775e1","Type":"ContainerDied","Data":"a154b5496e6c09c9e4f858fc438ca311217cef56feff99b924b185db6002efa0"} Sep 17 14:07:26.691801 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:26.691614 2579 scope.go:117] "RemoveContainer" containerID="a154b5496e6c09c9e4f858fc438ca311217cef56feff99b924b185db6002efa0" Sep 17 14:07:26.957706 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:26.957618 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:27.697847 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:27.697809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-xhzxc" event={"ID":"ad40e6da-5bd3-46cd-abe3-74b253e775e1","Type":"ContainerStarted","Data":"b0a359a1f8c8ee07fb7cf4a002c69bbd81a4081eb9af1109496bda78b46894d6"} Sep 17 14:07:28.452679 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:28.452644 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:07:46.437198 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:46.437164 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:46.441049 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:46.441023 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-797496f795-f8sdb" Sep 17 14:07:46.778034 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:46.777992 2579 generic.go:356] "Generic (PLEG): container finished" podID="60ede387-542c-4d98-9a2c-2e790de56339" containerID="58e9a227e43c91a4ae6aaec07fe27450885261a204864822ab440eaccd315431" exitCode=0 Sep 17 14:07:46.778236 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:46.778064 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" event={"ID":"60ede387-542c-4d98-9a2c-2e790de56339","Type":"ContainerDied","Data":"58e9a227e43c91a4ae6aaec07fe27450885261a204864822ab440eaccd315431"} Sep 17 14:07:46.778553 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:46.778535 2579 scope.go:117] "RemoveContainer" containerID="58e9a227e43c91a4ae6aaec07fe27450885261a204864822ab440eaccd315431" Sep 17 14:07:47.148452 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.148347 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-648bc89cb7-927bt" podUID="8c9a0e52-a288-498e-982e-78c459553d45" containerName="console" containerID="cri-o://5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed" gracePeriod=15 Sep 17 14:07:47.475250 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.475215 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:47.621200 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.621163 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-service-ca\") pod \"8c9a0e52-a288-498e-982e-78c459553d45\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " Sep 17 14:07:47.621413 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.621213 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w9wz\" (UniqueName: \"kubernetes.io/projected/8c9a0e52-a288-498e-982e-78c459553d45-kube-api-access-5w9wz\") pod \"8c9a0e52-a288-498e-982e-78c459553d45\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " Sep 17 14:07:47.621413 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.621352 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-oauth-config\") pod \"8c9a0e52-a288-498e-982e-78c459553d45\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " Sep 17 14:07:47.621549 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.621483 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-console-config\") pod \"8c9a0e52-a288-498e-982e-78c459553d45\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " Sep 17 14:07:47.621549 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.621542 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-trusted-ca-bundle\") pod \"8c9a0e52-a288-498e-982e-78c459553d45\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " Sep 17 14:07:47.621650 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.621569 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-oauth-serving-cert\") pod \"8c9a0e52-a288-498e-982e-78c459553d45\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " Sep 17 14:07:47.621650 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.621593 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-serving-cert\") pod \"8c9a0e52-a288-498e-982e-78c459553d45\" (UID: \"8c9a0e52-a288-498e-982e-78c459553d45\") " Sep 17 14:07:47.621650 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.621620 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-service-ca" (OuterVolumeSpecName: "service-ca") pod "8c9a0e52-a288-498e-982e-78c459553d45" (UID: "8c9a0e52-a288-498e-982e-78c459553d45"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:07:47.621883 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.621864 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-service-ca\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:07:47.622138 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.622096 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8c9a0e52-a288-498e-982e-78c459553d45" (UID: "8c9a0e52-a288-498e-982e-78c459553d45"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:07:47.622264 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.622187 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8c9a0e52-a288-498e-982e-78c459553d45" (UID: "8c9a0e52-a288-498e-982e-78c459553d45"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:07:47.622264 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.622202 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-console-config" (OuterVolumeSpecName: "console-config") pod "8c9a0e52-a288-498e-982e-78c459553d45" (UID: "8c9a0e52-a288-498e-982e-78c459553d45"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:07:47.623903 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.623764 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c9a0e52-a288-498e-982e-78c459553d45-kube-api-access-5w9wz" (OuterVolumeSpecName: "kube-api-access-5w9wz") pod "8c9a0e52-a288-498e-982e-78c459553d45" (UID: "8c9a0e52-a288-498e-982e-78c459553d45"). InnerVolumeSpecName "kube-api-access-5w9wz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:07:47.624023 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.623914 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8c9a0e52-a288-498e-982e-78c459553d45" (UID: "8c9a0e52-a288-498e-982e-78c459553d45"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:07:47.624436 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.624408 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8c9a0e52-a288-498e-982e-78c459553d45" (UID: "8c9a0e52-a288-498e-982e-78c459553d45"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:07:47.722724 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.722627 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-console-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:07:47.722724 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.722662 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-trusted-ca-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:07:47.722724 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.722676 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c9a0e52-a288-498e-982e-78c459553d45-oauth-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:07:47.722724 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.722687 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:07:47.722724 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.722699 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w9wz\" (UniqueName: \"kubernetes.io/projected/8c9a0e52-a288-498e-982e-78c459553d45-kube-api-access-5w9wz\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:07:47.722724 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.722711 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c9a0e52-a288-498e-982e-78c459553d45-console-oauth-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:07:47.784769 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.784731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4kfn2" event={"ID":"60ede387-542c-4d98-9a2c-2e790de56339","Type":"ContainerStarted","Data":"e6f02f3f02b7d1f56cfbda66cff3c5c8ad829adcfc07ee52f4fad01b072fdfdf"} Sep 17 14:07:47.786152 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.786122 2579 generic.go:356] "Generic (PLEG): container finished" podID="8c9a0e52-a288-498e-982e-78c459553d45" containerID="5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed" exitCode=0 Sep 17 14:07:47.786265 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.786163 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648bc89cb7-927bt" Sep 17 14:07:47.786265 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.786191 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648bc89cb7-927bt" event={"ID":"8c9a0e52-a288-498e-982e-78c459553d45","Type":"ContainerDied","Data":"5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed"} Sep 17 14:07:47.786265 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.786231 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648bc89cb7-927bt" event={"ID":"8c9a0e52-a288-498e-982e-78c459553d45","Type":"ContainerDied","Data":"0b7fd3cdf226ce1e7b576a2a598e4f69936eeaf77648408b491955cdc17fc665"} Sep 17 14:07:47.786265 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.786257 2579 scope.go:117] "RemoveContainer" containerID="5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed" Sep 17 14:07:47.796091 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.796058 2579 scope.go:117] "RemoveContainer" containerID="5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed" Sep 17 14:07:47.796487 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:07:47.796463 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed\": container with ID starting with 5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed not found: ID does not exist" containerID="5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed" Sep 17 14:07:47.796573 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.796499 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed"} err="failed to get container status \"5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed\": rpc error: code = NotFound desc = could not find container \"5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed\": container with ID starting with 5203ee66bb6f41924cc540fcfb403f1bf59a9c76a3702f050d4e86de7f9ee6ed not found: ID does not exist" Sep 17 14:07:47.815450 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.815420 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648bc89cb7-927bt"] Sep 17 14:07:47.820197 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:47.820169 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-648bc89cb7-927bt"] Sep 17 14:07:48.571802 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:48.571767 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c9a0e52-a288-498e-982e-78c459553d45" path="/var/lib/kubelet/pods/8c9a0e52-a288-498e-982e-78c459553d45/volumes" Sep 17 14:07:56.823575 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:56.823544 2579 generic.go:356] "Generic (PLEG): container finished" podID="790e703e-06aa-4154-93ec-a287f61b49eb" containerID="6a597ef26251aa8a86a64202ac111bbc9f8f20b34f53433b81626d353fd1259f" exitCode=0 Sep 17 14:07:56.824025 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:56.823623 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-c5bsz" event={"ID":"790e703e-06aa-4154-93ec-a287f61b49eb","Type":"ContainerDied","Data":"6a597ef26251aa8a86a64202ac111bbc9f8f20b34f53433b81626d353fd1259f"} Sep 17 14:07:56.824025 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:56.823969 2579 scope.go:117] "RemoveContainer" containerID="6a597ef26251aa8a86a64202ac111bbc9f8f20b34f53433b81626d353fd1259f" Sep 17 14:07:57.830265 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:07:57.830231 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-c5bsz" event={"ID":"790e703e-06aa-4154-93ec-a287f61b49eb","Type":"ContainerStarted","Data":"c084ea4c38f1a2dccbc4a693f89ba3f599f59497b72e34505289f2836ee62858"} Sep 17 14:08:08.453501 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:08.453462 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:08.473052 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:08.473026 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:08.890991 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:08.890960 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:26.531425 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.531359 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:08:26.531916 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.531812 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="prometheus" containerID="cri-o://92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc" gracePeriod=600 Sep 17 14:08:26.531916 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.531844 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb" gracePeriod=600 Sep 17 14:08:26.531916 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.531854 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy-web" containerID="cri-o://a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f" gracePeriod=600 Sep 17 14:08:26.531916 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.531874 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="config-reloader" containerID="cri-o://762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e" gracePeriod=600 Sep 17 14:08:26.532110 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.531791 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy" containerID="cri-o://5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b" gracePeriod=600 Sep 17 14:08:26.532110 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.531800 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="thanos-sidecar" containerID="cri-o://83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707" gracePeriod=600 Sep 17 14:08:26.781989 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.781911 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:26.868081 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868043 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-web-config\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868327 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868089 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-1\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868327 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868122 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9pn5\" (UniqueName: \"kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-kube-api-access-j9pn5\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868327 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868153 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-0\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868327 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868177 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-metrics-client-ca\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868327 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868208 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-tls-assets\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868327 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868236 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-db\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868327 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868268 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-tls\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868327 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868290 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-2\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868358 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-config\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868406 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868437 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-trusted-ca-bundle\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868465 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-config-out\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868496 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-metrics-client-certs\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868552 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-kubelet-serving-ca-bundle\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868580 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868605 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868641 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-grpc-tls\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868676 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-thanos-prometheus-http-client-file\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868723 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-serving-certs-ca-bundle\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.868781 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868755 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-kube-rbac-proxy\") pod \"ba1edec5-bb73-466e-a2f9-10718e44bfef\" (UID: \"ba1edec5-bb73-466e-a2f9-10718e44bfef\") " Sep 17 14:08:26.869404 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.868933 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:08:26.869404 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.869023 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.869404 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.869041 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.869404 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.869188 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:08:26.869610 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.869536 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 14:08:26.870485 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.869732 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:08:26.870602 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.870487 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:08:26.872749 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.872619 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:08:26.872874 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.872776 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 14:08:26.872963 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.872935 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:08:26.873092 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.872978 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:08:26.873188 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.873039 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:08:26.873269 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.873045 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-kube-api-access-j9pn5" (OuterVolumeSpecName: "kube-api-access-j9pn5") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "kube-api-access-j9pn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:08:26.873347 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.873299 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:08:26.873813 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.873775 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:08:26.873966 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.873928 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-config" (OuterVolumeSpecName: "config") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:08:26.874058 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.874040 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-config-out" (OuterVolumeSpecName: "config-out") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 14:08:26.874453 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.874426 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:08:26.874957 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.874935 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:08:26.875274 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.875253 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:08:26.884340 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.884316 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-web-config" (OuterVolumeSpecName: "web-config") pod "ba1edec5-bb73-466e-a2f9-10718e44bfef" (UID: "ba1edec5-bb73-466e-a2f9-10718e44bfef"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 14:08:26.945877 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.945847 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerID="1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb" exitCode=0 Sep 17 14:08:26.945877 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.945871 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerID="5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b" exitCode=0 Sep 17 14:08:26.945877 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.945877 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerID="a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f" exitCode=0 Sep 17 14:08:26.945877 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.945883 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerID="83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707" exitCode=0 Sep 17 14:08:26.945877 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.945888 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerID="762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e" exitCode=0 Sep 17 14:08:26.946145 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.945893 2579 generic.go:356] "Generic (PLEG): container finished" podID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerID="92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc" exitCode=0 Sep 17 14:08:26.946145 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.945929 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:26.946145 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.945933 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerDied","Data":"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb"} Sep 17 14:08:26.946145 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.946018 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerDied","Data":"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b"} Sep 17 14:08:26.946145 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.946059 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerDied","Data":"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f"} Sep 17 14:08:26.946145 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.946090 2579 scope.go:117] "RemoveContainer" containerID="1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb" Sep 17 14:08:26.946145 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.946101 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerDied","Data":"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707"} Sep 17 14:08:26.946145 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.946144 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerDied","Data":"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e"} Sep 17 14:08:26.946475 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.946185 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerDied","Data":"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc"} Sep 17 14:08:26.946475 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.946228 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba1edec5-bb73-466e-a2f9-10718e44bfef","Type":"ContainerDied","Data":"8758b315664c35813aff224db7f83f486b616046af03ebd9e334498b7d46a85d"} Sep 17 14:08:26.954496 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.954477 2579 scope.go:117] "RemoveContainer" containerID="5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b" Sep 17 14:08:26.962706 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.962690 2579 scope.go:117] "RemoveContainer" containerID="a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f" Sep 17 14:08:26.969880 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.969854 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:08:26.970198 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970180 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-db\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970241 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970201 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970241 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970210 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970241 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970219 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970241 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970228 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970241 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970237 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba1edec5-bb73-466e-a2f9-10718e44bfef-config-out\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970245 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-metrics-client-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970254 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970263 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970271 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-grpc-tls\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970281 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970289 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970298 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-secret-kube-rbac-proxy\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970306 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba1edec5-bb73-466e-a2f9-10718e44bfef-web-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970314 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9pn5\" (UniqueName: \"kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-kube-api-access-j9pn5\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970323 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970331 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba1edec5-bb73-466e-a2f9-10718e44bfef-configmap-metrics-client-ca\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970417 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970339 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba1edec5-bb73-466e-a2f9-10718e44bfef-tls-assets\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:08:26.970864 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.970850 2579 scope.go:117] "RemoveContainer" containerID="83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707" Sep 17 14:08:26.974659 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.974637 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:08:26.980402 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.980380 2579 scope.go:117] "RemoveContainer" containerID="762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e" Sep 17 14:08:26.987457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.987439 2579 scope.go:117] "RemoveContainer" containerID="92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc" Sep 17 14:08:26.994541 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:26.994524 2579 scope.go:117] "RemoveContainer" containerID="7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979" Sep 17 14:08:27.001172 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.001153 2579 scope.go:117] "RemoveContainer" containerID="1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb" Sep 17 14:08:27.001509 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:08:27.001482 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": container with ID starting with 1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb not found: ID does not exist" containerID="1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb" Sep 17 14:08:27.001588 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.001518 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb"} err="failed to get container status \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": rpc error: code = NotFound desc = could not find container \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": container with ID starting with 1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb not found: ID does not exist" Sep 17 14:08:27.001588 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.001537 2579 scope.go:117] "RemoveContainer" containerID="5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b" Sep 17 14:08:27.001816 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:08:27.001800 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": container with ID starting with 5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b not found: ID does not exist" containerID="5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b" Sep 17 14:08:27.001883 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.001825 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b"} err="failed to get container status \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": rpc error: code = NotFound desc = could not find container \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": container with ID starting with 5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b not found: ID does not exist" Sep 17 14:08:27.001883 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.001839 2579 scope.go:117] "RemoveContainer" containerID="a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f" Sep 17 14:08:27.002107 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:08:27.002093 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": container with ID starting with a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f not found: ID does not exist" containerID="a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f" Sep 17 14:08:27.002161 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.002118 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f"} err="failed to get container status \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": rpc error: code = NotFound desc = could not find container \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": container with ID starting with a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f not found: ID does not exist" Sep 17 14:08:27.002161 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.002130 2579 scope.go:117] "RemoveContainer" containerID="83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707" Sep 17 14:08:27.002399 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:08:27.002358 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": container with ID starting with 83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707 not found: ID does not exist" containerID="83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707" Sep 17 14:08:27.002507 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.002401 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707"} err="failed to get container status \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": rpc error: code = NotFound desc = could not find container \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": container with ID starting with 83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707 not found: ID does not exist" Sep 17 14:08:27.002507 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.002414 2579 scope.go:117] "RemoveContainer" containerID="762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e" Sep 17 14:08:27.002666 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:08:27.002649 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": container with ID starting with 762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e not found: ID does not exist" containerID="762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e" Sep 17 14:08:27.002711 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.002668 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e"} err="failed to get container status \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": rpc error: code = NotFound desc = could not find container \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": container with ID starting with 762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e not found: ID does not exist" Sep 17 14:08:27.002711 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.002680 2579 scope.go:117] "RemoveContainer" containerID="92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc" Sep 17 14:08:27.002940 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:08:27.002919 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": container with ID starting with 92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc not found: ID does not exist" containerID="92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc" Sep 17 14:08:27.002978 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.002947 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc"} err="failed to get container status \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": rpc error: code = NotFound desc = could not find container \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": container with ID starting with 92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc not found: ID does not exist" Sep 17 14:08:27.002978 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.002964 2579 scope.go:117] "RemoveContainer" containerID="7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979" Sep 17 14:08:27.003210 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:08:27.003192 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": container with ID starting with 7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979 not found: ID does not exist" containerID="7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979" Sep 17 14:08:27.003254 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.003214 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979"} err="failed to get container status \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": rpc error: code = NotFound desc = could not find container \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": container with ID starting with 7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979 not found: ID does not exist" Sep 17 14:08:27.003254 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.003230 2579 scope.go:117] "RemoveContainer" containerID="1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb" Sep 17 14:08:27.003504 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.003487 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb"} err="failed to get container status \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": rpc error: code = NotFound desc = could not find container \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": container with ID starting with 1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb not found: ID does not exist" Sep 17 14:08:27.003561 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.003504 2579 scope.go:117] "RemoveContainer" containerID="5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b" Sep 17 14:08:27.003736 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.003719 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b"} err="failed to get container status \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": rpc error: code = NotFound desc = could not find container \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": container with ID starting with 5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b not found: ID does not exist" Sep 17 14:08:27.003736 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.003735 2579 scope.go:117] "RemoveContainer" containerID="a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f" Sep 17 14:08:27.003969 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.003950 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f"} err="failed to get container status \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": rpc error: code = NotFound desc = could not find container \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": container with ID starting with a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f not found: ID does not exist" Sep 17 14:08:27.004014 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.003970 2579 scope.go:117] "RemoveContainer" containerID="83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707" Sep 17 14:08:27.004245 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.004228 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707"} err="failed to get container status \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": rpc error: code = NotFound desc = could not find container \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": container with ID starting with 83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707 not found: ID does not exist" Sep 17 14:08:27.004304 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.004245 2579 scope.go:117] "RemoveContainer" containerID="762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e" Sep 17 14:08:27.004502 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.004484 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e"} err="failed to get container status \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": rpc error: code = NotFound desc = could not find container \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": container with ID starting with 762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e not found: ID does not exist" Sep 17 14:08:27.004562 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.004502 2579 scope.go:117] "RemoveContainer" containerID="92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc" Sep 17 14:08:27.004740 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.004720 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc"} err="failed to get container status \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": rpc error: code = NotFound desc = could not find container \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": container with ID starting with 92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc not found: ID does not exist" Sep 17 14:08:27.004783 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.004741 2579 scope.go:117] "RemoveContainer" containerID="7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979" Sep 17 14:08:27.004953 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.004938 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979"} err="failed to get container status \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": rpc error: code = NotFound desc = could not find container \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": container with ID starting with 7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979 not found: ID does not exist" Sep 17 14:08:27.004995 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.004952 2579 scope.go:117] "RemoveContainer" containerID="1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb" Sep 17 14:08:27.005172 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.005157 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb"} err="failed to get container status \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": rpc error: code = NotFound desc = could not find container \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": container with ID starting with 1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb not found: ID does not exist" Sep 17 14:08:27.005172 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.005171 2579 scope.go:117] "RemoveContainer" containerID="5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b" Sep 17 14:08:27.005416 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.005400 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b"} err="failed to get container status \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": rpc error: code = NotFound desc = could not find container \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": container with ID starting with 5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b not found: ID does not exist" Sep 17 14:08:27.005416 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.005415 2579 scope.go:117] "RemoveContainer" containerID="a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f" Sep 17 14:08:27.005633 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.005617 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f"} err="failed to get container status \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": rpc error: code = NotFound desc = could not find container \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": container with ID starting with a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f not found: ID does not exist" Sep 17 14:08:27.005633 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.005633 2579 scope.go:117] "RemoveContainer" containerID="83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707" Sep 17 14:08:27.005844 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.005829 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707"} err="failed to get container status \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": rpc error: code = NotFound desc = could not find container \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": container with ID starting with 83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707 not found: ID does not exist" Sep 17 14:08:27.005844 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.005842 2579 scope.go:117] "RemoveContainer" containerID="762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e" Sep 17 14:08:27.006063 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.006048 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e"} err="failed to get container status \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": rpc error: code = NotFound desc = could not find container \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": container with ID starting with 762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e not found: ID does not exist" Sep 17 14:08:27.006063 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.006062 2579 scope.go:117] "RemoveContainer" containerID="92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc" Sep 17 14:08:27.006296 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.006281 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc"} err="failed to get container status \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": rpc error: code = NotFound desc = could not find container \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": container with ID starting with 92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc not found: ID does not exist" Sep 17 14:08:27.006353 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.006296 2579 scope.go:117] "RemoveContainer" containerID="7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979" Sep 17 14:08:27.006532 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.006512 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979"} err="failed to get container status \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": rpc error: code = NotFound desc = could not find container \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": container with ID starting with 7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979 not found: ID does not exist" Sep 17 14:08:27.006582 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.006533 2579 scope.go:117] "RemoveContainer" containerID="1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb" Sep 17 14:08:27.006747 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.006730 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb"} err="failed to get container status \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": rpc error: code = NotFound desc = could not find container \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": container with ID starting with 1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb not found: ID does not exist" Sep 17 14:08:27.006794 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.006748 2579 scope.go:117] "RemoveContainer" containerID="5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b" Sep 17 14:08:27.006991 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.006974 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b"} err="failed to get container status \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": rpc error: code = NotFound desc = could not find container \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": container with ID starting with 5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b not found: ID does not exist" Sep 17 14:08:27.007030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.006991 2579 scope.go:117] "RemoveContainer" containerID="a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f" Sep 17 14:08:27.007221 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.007206 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f"} err="failed to get container status \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": rpc error: code = NotFound desc = could not find container \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": container with ID starting with a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f not found: ID does not exist" Sep 17 14:08:27.007261 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.007221 2579 scope.go:117] "RemoveContainer" containerID="83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707" Sep 17 14:08:27.007562 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.007530 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707"} err="failed to get container status \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": rpc error: code = NotFound desc = could not find container \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": container with ID starting with 83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707 not found: ID does not exist" Sep 17 14:08:27.007562 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.007558 2579 scope.go:117] "RemoveContainer" containerID="762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e" Sep 17 14:08:27.007873 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.007850 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e"} err="failed to get container status \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": rpc error: code = NotFound desc = could not find container \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": container with ID starting with 762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e not found: ID does not exist" Sep 17 14:08:27.007936 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.007875 2579 scope.go:117] "RemoveContainer" containerID="92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc" Sep 17 14:08:27.008152 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.008130 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc"} err="failed to get container status \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": rpc error: code = NotFound desc = could not find container \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": container with ID starting with 92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc not found: ID does not exist" Sep 17 14:08:27.008223 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.008153 2579 scope.go:117] "RemoveContainer" containerID="7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979" Sep 17 14:08:27.008566 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.008542 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979"} err="failed to get container status \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": rpc error: code = NotFound desc = could not find container \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": container with ID starting with 7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979 not found: ID does not exist" Sep 17 14:08:27.008643 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.008568 2579 scope.go:117] "RemoveContainer" containerID="1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb" Sep 17 14:08:27.008874 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.008851 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb"} err="failed to get container status \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": rpc error: code = NotFound desc = could not find container \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": container with ID starting with 1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb not found: ID does not exist" Sep 17 14:08:27.008928 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.008875 2579 scope.go:117] "RemoveContainer" containerID="5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b" Sep 17 14:08:27.009160 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009136 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b"} err="failed to get container status \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": rpc error: code = NotFound desc = could not find container \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": container with ID starting with 5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b not found: ID does not exist" Sep 17 14:08:27.009160 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009159 2579 scope.go:117] "RemoveContainer" containerID="a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f" Sep 17 14:08:27.009424 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009401 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f"} err="failed to get container status \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": rpc error: code = NotFound desc = could not find container \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": container with ID starting with a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f not found: ID does not exist" Sep 17 14:08:27.009473 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009426 2579 scope.go:117] "RemoveContainer" containerID="83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707" Sep 17 14:08:27.009588 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009572 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:08:27.009724 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009702 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707"} err="failed to get container status \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": rpc error: code = NotFound desc = could not find container \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": container with ID starting with 83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707 not found: ID does not exist" Sep 17 14:08:27.009768 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009726 2579 scope.go:117] "RemoveContainer" containerID="762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e" Sep 17 14:08:27.009897 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009880 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="init-config-reloader" Sep 17 14:08:27.009897 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009898 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="init-config-reloader" Sep 17 14:08:27.010030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009914 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="prometheus" Sep 17 14:08:27.010030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009922 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="prometheus" Sep 17 14:08:27.010030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009927 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy-web" Sep 17 14:08:27.010030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009933 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy-web" Sep 17 14:08:27.010030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009957 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="thanos-sidecar" Sep 17 14:08:27.010030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009964 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="thanos-sidecar" Sep 17 14:08:27.010030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009972 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy" Sep 17 14:08:27.010030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009977 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy" Sep 17 14:08:27.010030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009984 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy-thanos" Sep 17 14:08:27.010030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009979 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e"} err="failed to get container status \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": rpc error: code = NotFound desc = could not find container \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": container with ID starting with 762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e not found: ID does not exist" Sep 17 14:08:27.010030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010003 2579 scope.go:117] "RemoveContainer" containerID="92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.009989 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy-thanos" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010053 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="config-reloader" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010060 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="config-reloader" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010074 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c9a0e52-a288-498e-982e-78c459553d45" containerName="console" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010083 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c9a0e52-a288-498e-982e-78c459553d45" containerName="console" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010152 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="prometheus" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010162 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="thanos-sidecar" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010173 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010182 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy-web" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010191 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="kube-rbac-proxy-thanos" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010197 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" containerName="config-reloader" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010202 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c9a0e52-a288-498e-982e-78c459553d45" containerName="console" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010259 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc"} err="failed to get container status \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": rpc error: code = NotFound desc = could not find container \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": container with ID starting with 92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc not found: ID does not exist" Sep 17 14:08:27.010432 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010274 2579 scope.go:117] "RemoveContainer" containerID="7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979" Sep 17 14:08:27.010854 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010524 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979"} err="failed to get container status \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": rpc error: code = NotFound desc = could not find container \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": container with ID starting with 7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979 not found: ID does not exist" Sep 17 14:08:27.010854 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010542 2579 scope.go:117] "RemoveContainer" containerID="1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb" Sep 17 14:08:27.010854 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010811 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb"} err="failed to get container status \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": rpc error: code = NotFound desc = could not find container \"1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb\": container with ID starting with 1c4ebdd1c74052a22fc49b889cfb88f79d169a77470162c5438ea716d9ba44bb not found: ID does not exist" Sep 17 14:08:27.010854 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.010826 2579 scope.go:117] "RemoveContainer" containerID="5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b" Sep 17 14:08:27.011037 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.011023 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b"} err="failed to get container status \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": rpc error: code = NotFound desc = could not find container \"5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b\": container with ID starting with 5c3f6f33eff08e61679ae27880730929d378c15d50fb37fb6643139512827f0b not found: ID does not exist" Sep 17 14:08:27.011037 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.011037 2579 scope.go:117] "RemoveContainer" containerID="a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f" Sep 17 14:08:27.011294 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.011275 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f"} err="failed to get container status \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": rpc error: code = NotFound desc = could not find container \"a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f\": container with ID starting with a516f13210e00211fb90d4b6a0872969c40426e3e8ab712c8c2684e2051d9d1f not found: ID does not exist" Sep 17 14:08:27.011386 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.011296 2579 scope.go:117] "RemoveContainer" containerID="83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707" Sep 17 14:08:27.011572 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.011554 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707"} err="failed to get container status \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": rpc error: code = NotFound desc = could not find container \"83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707\": container with ID starting with 83e5437c25e2e3258f85d403b03dcc57eb24a26467081a9eaa6cc223facf6707 not found: ID does not exist" Sep 17 14:08:27.011662 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.011573 2579 scope.go:117] "RemoveContainer" containerID="762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e" Sep 17 14:08:27.011809 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.011791 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e"} err="failed to get container status \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": rpc error: code = NotFound desc = could not find container \"762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e\": container with ID starting with 762089eaba1b6bc09be4989593ca7d88516b6b60e2132f9d90cf0ef06449169e not found: ID does not exist" Sep 17 14:08:27.011879 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.011810 2579 scope.go:117] "RemoveContainer" containerID="92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc" Sep 17 14:08:27.012054 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.012033 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc"} err="failed to get container status \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": rpc error: code = NotFound desc = could not find container \"92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc\": container with ID starting with 92863e561b90e1041c006a92a96e6cef0c7ed450fbe3b275ee8fe0a8f23aafbc not found: ID does not exist" Sep 17 14:08:27.012110 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.012057 2579 scope.go:117] "RemoveContainer" containerID="7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979" Sep 17 14:08:27.012295 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.012278 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979"} err="failed to get container status \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": rpc error: code = NotFound desc = could not find container \"7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979\": container with ID starting with 7331999f1caf46ec25b89af86bfa350c6d8d5535af1385892409b7deba83a979 not found: ID does not exist" Sep 17 14:08:27.014175 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.014157 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.016605 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.016586 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 14:08:27.016692 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.016586 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 14:08:27.016692 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.016587 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-834mcghlm853o\"" Sep 17 14:08:27.016692 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.016658 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 14:08:27.016861 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.016754 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 14:08:27.017217 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.017195 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 14:08:27.017351 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.017328 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 14:08:27.017455 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.017400 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 14:08:27.017552 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.017478 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 14:08:27.017552 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.017489 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 14:08:27.017552 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.017543 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 14:08:27.017897 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.017881 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 14:08:27.017979 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.017910 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 14:08:27.018031 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.017917 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rm292\"" Sep 17 14:08:27.019403 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.019380 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 14:08:27.023092 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.023076 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 14:08:27.030260 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.030238 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:08:27.172038 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172038 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172329 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172329 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172076 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172329 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-config\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172329 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172329 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172329 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172329 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172329 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172329 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bd107db-d5c7-4755-99e9-db6c18a1f71c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172644 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172338 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172644 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9z7k\" (UniqueName: \"kubernetes.io/projected/9bd107db-d5c7-4755-99e9-db6c18a1f71c-kube-api-access-k9z7k\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172644 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172644 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172459 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bd107db-d5c7-4755-99e9-db6c18a1f71c-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172644 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172482 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172644 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172644 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172527 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172644 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.172644 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.172573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.273582 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.273541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.273582 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.273585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.273787 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.273711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.273787 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.273756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bd107db-d5c7-4755-99e9-db6c18a1f71c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.273853 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.273784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.273921 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.273903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9z7k\" (UniqueName: \"kubernetes.io/projected/9bd107db-d5c7-4755-99e9-db6c18a1f71c-kube-api-access-k9z7k\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.273982 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.273952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274036 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bd107db-d5c7-4755-99e9-db6c18a1f71c-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274088 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274088 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274178 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274178 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274178 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274133 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274178 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274477 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274446 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274866 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274833 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274977 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274977 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.274977 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274950 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.275140 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.275140 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.274999 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.275140 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.275001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-config\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.275140 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.275043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.275140 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.275080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.275624 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.275600 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.275711 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.275646 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.276685 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.276661 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bd107db-d5c7-4755-99e9-db6c18a1f71c-config-out\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.276789 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.276753 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bd107db-d5c7-4755-99e9-db6c18a1f71c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.277010 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.276982 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.277666 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.277642 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-config\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.277825 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.277682 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.278079 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.278055 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.278287 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.278260 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.279402 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.279351 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.279496 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.279353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.279691 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.279663 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.279758 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.279691 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.279758 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.279672 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bd107db-d5c7-4755-99e9-db6c18a1f71c-web-config\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.280850 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.280828 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9bd107db-d5c7-4755-99e9-db6c18a1f71c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.284647 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.284618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9z7k\" (UniqueName: \"kubernetes.io/projected/9bd107db-d5c7-4755-99e9-db6c18a1f71c-kube-api-access-k9z7k\") pod \"prometheus-k8s-0\" (UID: \"9bd107db-d5c7-4755-99e9-db6c18a1f71c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.325710 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.325678 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:08:27.613425 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.613395 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 14:08:27.615815 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:08:27.615782 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd107db_d5c7_4755_99e9_db6c18a1f71c.slice/crio-0b6eb458f28a491823bbfa2534362a2fd48909deb23132bd82d9e26c66179355 WatchSource:0}: Error finding container 0b6eb458f28a491823bbfa2534362a2fd48909deb23132bd82d9e26c66179355: Status 404 returned error can't find the container with id 0b6eb458f28a491823bbfa2534362a2fd48909deb23132bd82d9e26c66179355 Sep 17 14:08:27.951962 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.951928 2579 generic.go:356] "Generic (PLEG): container finished" podID="9bd107db-d5c7-4755-99e9-db6c18a1f71c" containerID="bfd3613fe60da759e37cbd72fd117ee57d57f4c910f792d7d7d302b079e74a17" exitCode=0 Sep 17 14:08:27.952155 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.951989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bd107db-d5c7-4755-99e9-db6c18a1f71c","Type":"ContainerDied","Data":"bfd3613fe60da759e37cbd72fd117ee57d57f4c910f792d7d7d302b079e74a17"} Sep 17 14:08:27.952155 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:27.952038 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bd107db-d5c7-4755-99e9-db6c18a1f71c","Type":"ContainerStarted","Data":"0b6eb458f28a491823bbfa2534362a2fd48909deb23132bd82d9e26c66179355"} Sep 17 14:08:28.572646 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:28.572609 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba1edec5-bb73-466e-a2f9-10718e44bfef" path="/var/lib/kubelet/pods/ba1edec5-bb73-466e-a2f9-10718e44bfef/volumes" Sep 17 14:08:28.959710 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:28.959676 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bd107db-d5c7-4755-99e9-db6c18a1f71c","Type":"ContainerStarted","Data":"b6b12889f9daba55688e4efeaaecd972dbef9ea4433b5fbc1d43b3bdf7bda515"} Sep 17 14:08:28.960093 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:28.959739 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bd107db-d5c7-4755-99e9-db6c18a1f71c","Type":"ContainerStarted","Data":"5e3b35615e04d9593bb4f9609ddd1cc5ee061246b132c138f7958cef9a73f4cd"} Sep 17 14:08:28.960093 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:28.959765 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bd107db-d5c7-4755-99e9-db6c18a1f71c","Type":"ContainerStarted","Data":"8f1266c2d7bb306e05ecf0b5b3ebca650282b337308d4329df14504dedf3483e"} Sep 17 14:08:28.960093 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:28.959788 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bd107db-d5c7-4755-99e9-db6c18a1f71c","Type":"ContainerStarted","Data":"54c173cc73a34de9fde2ebd4db9ae0eb692896bd3971c8e15d1610d2a6a7e50d"} Sep 17 14:08:28.960093 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:28.959811 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bd107db-d5c7-4755-99e9-db6c18a1f71c","Type":"ContainerStarted","Data":"dbca820e525b6e930e3620448435c0e13557c9ef888b55d1bd98e0a56099421d"} Sep 17 14:08:28.960093 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:28.959834 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9bd107db-d5c7-4755-99e9-db6c18a1f71c","Type":"ContainerStarted","Data":"44ba19100a941f7ec82edd837136028974bb79b42684c74ce07b759a92fd6352"} Sep 17 14:08:28.988476 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:28.988412 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.970386873 podStartE2EDuration="2.988390045s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.003172ms" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:28.986802367 +0000 UTC m=+372.914779834" watchObservedRunningTime="2026-09-17 14:08:28.988390045 +0000 UTC m=+372.916367510" Sep 17 14:08:30.301429 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:30.301387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:08:30.303707 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:30.303675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11c9baa0-1192-4bca-a430-9b2fd7484dd7-metrics-certs\") pod \"network-metrics-daemon-xs7g2\" (UID: \"11c9baa0-1192-4bca-a430-9b2fd7484dd7\") " pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:08:30.470094 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:30.470059 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kqgfj\"" Sep 17 14:08:30.478457 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:30.478430 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xs7g2" Sep 17 14:08:30.748383 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:30.748322 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xs7g2"] Sep 17 14:08:30.751335 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:08:30.751297 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c9baa0_1192_4bca_a430_9b2fd7484dd7.slice/crio-37fff0373adde6af0503a6378a49b79170bc62bfe570d477fadf259f2a425cb1 WatchSource:0}: Error finding container 37fff0373adde6af0503a6378a49b79170bc62bfe570d477fadf259f2a425cb1: Status 404 returned error can't find the container with id 37fff0373adde6af0503a6378a49b79170bc62bfe570d477fadf259f2a425cb1 Sep 17 14:08:30.969867 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:30.969833 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xs7g2" event={"ID":"11c9baa0-1192-4bca-a430-9b2fd7484dd7","Type":"ContainerStarted","Data":"37fff0373adde6af0503a6378a49b79170bc62bfe570d477fadf259f2a425cb1"} Sep 17 14:08:31.975791 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:31.975755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xs7g2" event={"ID":"11c9baa0-1192-4bca-a430-9b2fd7484dd7","Type":"ContainerStarted","Data":"cb7c8253cbc2695d231010c626e78877b850c0289e5958f534afc23c7f4bf39d"} Sep 17 14:08:31.976160 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:31.975812 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xs7g2" event={"ID":"11c9baa0-1192-4bca-a430-9b2fd7484dd7","Type":"ContainerStarted","Data":"decd9589e34d1a4599ca8e67b22e391f2c6093ab1fa25efe64bb29fcd6f3d9c2"} Sep 17 14:08:31.991674 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:31.991624 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xs7g2" podStartSLOduration=375.190833342 podStartE2EDuration="6m15.991606639s" totalImagesPullingTime="800.773297ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:31.990461815 +0000 UTC m=+375.918439282" watchObservedRunningTime="2026-09-17 14:08:31.991606639 +0000 UTC m=+375.919584104" Sep 17 14:08:32.326546 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:08:32.326445 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:09:27.325939 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:09:27.325887 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:09:27.341422 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:09:27.341397 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:09:28.219320 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:09:28.219292 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 14:12:17.663701 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.663670 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-jxxht_13a299bd-26c1-42fe-97ba-4e392899fade/console-operator/1.log" Sep 17 14:12:17.665565 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.664743 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-jxxht_13a299bd-26c1-42fe-97ba-4e392899fade/console-operator/1.log" Sep 17 14:12:17.750442 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.750405 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229"] Sep 17 14:12:17.752905 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.752889 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:17.755205 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.755180 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 17 14:12:17.755334 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.755214 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 17 14:12:17.755334 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.755224 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-7n9hz\"" Sep 17 14:12:17.756053 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.756025 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 17 14:12:17.756171 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.756082 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 17 14:12:17.762614 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.762592 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229"] Sep 17 14:12:17.818089 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.818061 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5db3543f-86bb-4425-a1a4-07fae74aec8d-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-lw229\" (UID: \"5db3543f-86bb-4425-a1a4-07fae74aec8d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:17.818089 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.818093 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjnjj\" (UniqueName: \"kubernetes.io/projected/5db3543f-86bb-4425-a1a4-07fae74aec8d-kube-api-access-cjnjj\") pod \"kubeflow-trainer-controller-manager-7f9b886978-lw229\" (UID: \"5db3543f-86bb-4425-a1a4-07fae74aec8d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:17.818292 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.818185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/5db3543f-86bb-4425-a1a4-07fae74aec8d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-lw229\" (UID: \"5db3543f-86bb-4425-a1a4-07fae74aec8d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:17.918653 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.918577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5db3543f-86bb-4425-a1a4-07fae74aec8d-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-lw229\" (UID: \"5db3543f-86bb-4425-a1a4-07fae74aec8d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:17.918653 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.918610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjnjj\" (UniqueName: \"kubernetes.io/projected/5db3543f-86bb-4425-a1a4-07fae74aec8d-kube-api-access-cjnjj\") pod \"kubeflow-trainer-controller-manager-7f9b886978-lw229\" (UID: \"5db3543f-86bb-4425-a1a4-07fae74aec8d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:17.918840 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.918660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/5db3543f-86bb-4425-a1a4-07fae74aec8d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-lw229\" (UID: \"5db3543f-86bb-4425-a1a4-07fae74aec8d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:17.919310 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.919286 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/5db3543f-86bb-4425-a1a4-07fae74aec8d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-lw229\" (UID: \"5db3543f-86bb-4425-a1a4-07fae74aec8d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:17.921176 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.921155 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5db3543f-86bb-4425-a1a4-07fae74aec8d-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-lw229\" (UID: \"5db3543f-86bb-4425-a1a4-07fae74aec8d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:17.926446 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:17.926426 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjnjj\" (UniqueName: \"kubernetes.io/projected/5db3543f-86bb-4425-a1a4-07fae74aec8d-kube-api-access-cjnjj\") pod \"kubeflow-trainer-controller-manager-7f9b886978-lw229\" (UID: \"5db3543f-86bb-4425-a1a4-07fae74aec8d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:18.078728 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:18.078679 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:18.349549 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:18.349491 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229"] Sep 17 14:12:18.352230 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:12:18.352194 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5db3543f_86bb_4425_a1a4_07fae74aec8d.slice/crio-83f1d787fac8730d9fb3fe8ca31ffae6360561318990e759fd3a872eb89b0faa WatchSource:0}: Error finding container 83f1d787fac8730d9fb3fe8ca31ffae6360561318990e759fd3a872eb89b0faa: Status 404 returned error can't find the container with id 83f1d787fac8730d9fb3fe8ca31ffae6360561318990e759fd3a872eb89b0faa Sep 17 14:12:18.882850 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:18.882812 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" event={"ID":"5db3543f-86bb-4425-a1a4-07fae74aec8d","Type":"ContainerStarted","Data":"83f1d787fac8730d9fb3fe8ca31ffae6360561318990e759fd3a872eb89b0faa"} Sep 17 14:12:20.896887 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:20.896842 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" event={"ID":"5db3543f-86bb-4425-a1a4-07fae74aec8d","Type":"ContainerStarted","Data":"b94cc09f46d7e9fd3a9d1fae284cf3a34783864b1bab8c2cfae35995edbefa80"} Sep 17 14:12:20.897682 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:20.897106 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:36.906999 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:36.906968 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" Sep 17 14:12:36.922017 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:12:36.921956 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-lw229" podStartSLOduration=17.473226158 podStartE2EDuration="19.921939566s" totalImagesPullingTime="2.448713408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:12:20.912229235 +0000 UTC m=+604.840206706" watchObservedRunningTime="2026-09-17 14:12:36.921939566 +0000 UTC m=+620.849917031" Sep 17 14:13:14.080558 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.080468 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sx5pr/must-gather-p9pg9"] Sep 17 14:13:14.083170 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.083147 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:13:14.085805 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.085782 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sx5pr\"/\"openshift-service-ca.crt\"" Sep 17 14:13:14.085963 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.085943 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sx5pr\"/\"kube-root-ca.crt\"" Sep 17 14:13:14.093160 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.093135 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sx5pr/must-gather-p9pg9"] Sep 17 14:13:14.209587 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.209547 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h276\" (UniqueName: \"kubernetes.io/projected/011b10da-0613-4b73-8387-61ee34f647f8-kube-api-access-9h276\") pod \"must-gather-p9pg9\" (UID: \"011b10da-0613-4b73-8387-61ee34f647f8\") " pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:13:14.209587 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.209610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/011b10da-0613-4b73-8387-61ee34f647f8-must-gather-output\") pod \"must-gather-p9pg9\" (UID: \"011b10da-0613-4b73-8387-61ee34f647f8\") " pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:13:14.310337 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.310292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h276\" (UniqueName: \"kubernetes.io/projected/011b10da-0613-4b73-8387-61ee34f647f8-kube-api-access-9h276\") pod \"must-gather-p9pg9\" (UID: \"011b10da-0613-4b73-8387-61ee34f647f8\") " pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:13:14.310526 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.310358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/011b10da-0613-4b73-8387-61ee34f647f8-must-gather-output\") pod \"must-gather-p9pg9\" (UID: \"011b10da-0613-4b73-8387-61ee34f647f8\") " pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:13:14.310688 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.310664 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/011b10da-0613-4b73-8387-61ee34f647f8-must-gather-output\") pod \"must-gather-p9pg9\" (UID: \"011b10da-0613-4b73-8387-61ee34f647f8\") " pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:13:14.317960 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.317930 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h276\" (UniqueName: \"kubernetes.io/projected/011b10da-0613-4b73-8387-61ee34f647f8-kube-api-access-9h276\") pod \"must-gather-p9pg9\" (UID: \"011b10da-0613-4b73-8387-61ee34f647f8\") " pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:13:14.393195 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.393121 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:13:14.661579 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.661554 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sx5pr/must-gather-p9pg9"] Sep 17 14:13:14.664248 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:13:14.664207 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod011b10da_0613_4b73_8387_61ee34f647f8.slice/crio-b0f6018dabbd26138777d5576eb0e5f7953a6b093b0767cee23451e1c30e99d8 WatchSource:0}: Error finding container b0f6018dabbd26138777d5576eb0e5f7953a6b093b0767cee23451e1c30e99d8: Status 404 returned error can't find the container with id b0f6018dabbd26138777d5576eb0e5f7953a6b093b0767cee23451e1c30e99d8 Sep 17 14:13:14.666035 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:14.666020 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 14:13:15.116675 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:15.116642 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" event={"ID":"011b10da-0613-4b73-8387-61ee34f647f8","Type":"ContainerStarted","Data":"b0f6018dabbd26138777d5576eb0e5f7953a6b093b0767cee23451e1c30e99d8"} Sep 17 14:13:21.149100 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:21.149055 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" event={"ID":"011b10da-0613-4b73-8387-61ee34f647f8","Type":"ContainerStarted","Data":"a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208"} Sep 17 14:13:21.149554 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:21.149114 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" event={"ID":"011b10da-0613-4b73-8387-61ee34f647f8","Type":"ContainerStarted","Data":"7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada"} Sep 17 14:13:21.165330 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:21.165269 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" podStartSLOduration=1.094514321 podStartE2EDuration="7.16524794s" totalImagesPullingTime="6.070733619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:13:21.162593516 +0000 UTC m=+665.090570985" watchObservedRunningTime="2026-09-17 14:13:21.16524794 +0000 UTC m=+665.093225409" Sep 17 14:13:30.586660 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:30.586625 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-lw229_5db3543f-86bb-4425-a1a4-07fae74aec8d/manager/0.log" Sep 17 14:13:31.048883 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:31.048783 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-lw229_5db3543f-86bb-4425-a1a4-07fae74aec8d/manager/0.log" Sep 17 14:13:31.493959 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:13:31.493933 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-lw229_5db3543f-86bb-4425-a1a4-07fae74aec8d/manager/0.log" Sep 17 14:14:08.377529 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:08.377495 2579 generic.go:356] "Generic (PLEG): container finished" podID="011b10da-0613-4b73-8387-61ee34f647f8" containerID="7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada" exitCode=0 Sep 17 14:14:08.377529 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:08.377534 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" event={"ID":"011b10da-0613-4b73-8387-61ee34f647f8","Type":"ContainerDied","Data":"7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada"} Sep 17 14:14:08.378043 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:08.377826 2579 scope.go:117] "RemoveContainer" containerID="7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada" Sep 17 14:14:08.658842 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:08.658738 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sx5pr_must-gather-p9pg9_011b10da-0613-4b73-8387-61ee34f647f8/gather/0.log" Sep 17 14:14:12.133445 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:12.133415 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t2b6c_f57bcf14-b8f2-4f1b-a64a-c32bf6d87743/global-pull-secret-syncer/0.log" Sep 17 14:14:12.222990 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:12.222962 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zsgrc_80c8b6bc-2e0e-4d2e-85da-b5a1aa6b34bb/konnectivity-agent/0.log" Sep 17 14:14:12.295517 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:12.295489 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-162.ec2.internal_49ae931469b3a9145df59c7a406661a1/haproxy/0.log" Sep 17 14:14:14.001380 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.001330 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-sx5pr/must-gather-p9pg9"] Sep 17 14:14:14.001876 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.001545 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" podUID="011b10da-0613-4b73-8387-61ee34f647f8" containerName="copy" containerID="cri-o://a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208" gracePeriod=2 Sep 17 14:14:14.004205 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:14:14.004162 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-p9pg9\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sx5pr\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object" podUID="011b10da-0613-4b73-8387-61ee34f647f8" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:14:14.004803 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.004773 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-sx5pr/must-gather-p9pg9"] Sep 17 14:14:14.235885 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.235860 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sx5pr_must-gather-p9pg9_011b10da-0613-4b73-8387-61ee34f647f8/copy/0.log" Sep 17 14:14:14.238310 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.238294 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:14:14.240271 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:14:14.240250 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-p9pg9\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sx5pr\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object" podUID="011b10da-0613-4b73-8387-61ee34f647f8" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:14:14.371452 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.371416 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/011b10da-0613-4b73-8387-61ee34f647f8-must-gather-output\") pod \"011b10da-0613-4b73-8387-61ee34f647f8\" (UID: \"011b10da-0613-4b73-8387-61ee34f647f8\") " Sep 17 14:14:14.371623 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.371471 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h276\" (UniqueName: \"kubernetes.io/projected/011b10da-0613-4b73-8387-61ee34f647f8-kube-api-access-9h276\") pod \"011b10da-0613-4b73-8387-61ee34f647f8\" (UID: \"011b10da-0613-4b73-8387-61ee34f647f8\") " Sep 17 14:14:14.373724 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.373697 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011b10da-0613-4b73-8387-61ee34f647f8-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "011b10da-0613-4b73-8387-61ee34f647f8" (UID: "011b10da-0613-4b73-8387-61ee34f647f8"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 14:14:14.373779 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.373729 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/011b10da-0613-4b73-8387-61ee34f647f8-kube-api-access-9h276" (OuterVolumeSpecName: "kube-api-access-9h276") pod "011b10da-0613-4b73-8387-61ee34f647f8" (UID: "011b10da-0613-4b73-8387-61ee34f647f8"). InnerVolumeSpecName "kube-api-access-9h276". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 14:14:14.405268 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.405244 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sx5pr_must-gather-p9pg9_011b10da-0613-4b73-8387-61ee34f647f8/copy/0.log" Sep 17 14:14:14.405618 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.405598 2579 generic.go:356] "Generic (PLEG): container finished" podID="011b10da-0613-4b73-8387-61ee34f647f8" containerID="a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208" exitCode=143 Sep 17 14:14:14.405676 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.405650 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:14:14.405717 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.405701 2579 scope.go:117] "RemoveContainer" containerID="a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208" Sep 17 14:14:14.407925 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:14:14.407897 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-p9pg9\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sx5pr\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object" podUID="011b10da-0613-4b73-8387-61ee34f647f8" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:14:14.413742 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.413725 2579 scope.go:117] "RemoveContainer" containerID="7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada" Sep 17 14:14:14.415763 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:14:14.415738 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-p9pg9\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sx5pr\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object" podUID="011b10da-0613-4b73-8387-61ee34f647f8" pod="openshift-must-gather-sx5pr/must-gather-p9pg9" Sep 17 14:14:14.425589 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.425573 2579 scope.go:117] "RemoveContainer" containerID="a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208" Sep 17 14:14:14.425873 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:14:14.425852 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208\": container with ID starting with a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208 not found: ID does not exist" containerID="a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208" Sep 17 14:14:14.425929 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.425882 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208"} err="failed to get container status \"a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208\": rpc error: code = NotFound desc = could not find container \"a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208\": container with ID starting with a8ecb3149f907dea279bf4f177be2ff780c17acf95e458ac16b86046504ff208 not found: ID does not exist" Sep 17 14:14:14.425929 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.425901 2579 scope.go:117] "RemoveContainer" containerID="7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada" Sep 17 14:14:14.426184 ip-10-0-141-162 kubenswrapper[2579]: E0917 14:14:14.426169 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada\": container with ID starting with 7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada not found: ID does not exist" containerID="7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada" Sep 17 14:14:14.426227 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.426187 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada"} err="failed to get container status \"7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada\": rpc error: code = NotFound desc = could not find container \"7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada\": container with ID starting with 7c0b1ce0bb4bf284869b0f87391edb56764061aa9c3dfab47e85bd6d44753ada not found: ID does not exist" Sep 17 14:14:14.472245 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.472211 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h276\" (UniqueName: \"kubernetes.io/projected/011b10da-0613-4b73-8387-61ee34f647f8-kube-api-access-9h276\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:14:14.472245 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.472237 2579 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/011b10da-0613-4b73-8387-61ee34f647f8-must-gather-output\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\"" Sep 17 14:14:14.572720 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:14.572682 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="011b10da-0613-4b73-8387-61ee34f647f8" path="/var/lib/kubelet/pods/011b10da-0613-4b73-8387-61ee34f647f8/volumes" Sep 17 14:14:16.194234 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.194200 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-p6vjq_6f8164c5-f994-4099-b2c6-dd5040564a93/cluster-monitoring-operator/0.log" Sep 17 14:14:16.305138 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.305111 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-797496f795-f8sdb_92e2fc74-03a0-4338-ab5e-657d530593a5/metrics-server/0.log" Sep 17 14:14:16.329336 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.329308 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-f5cfj_a1397b67-29af-4000-a721-e8d28fb6047f/monitoring-plugin/0.log" Sep 17 14:14:16.516854 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.516776 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xwzvs_0a24d5a7-3c55-475f-919d-5f0e2ff31346/node-exporter/0.log" Sep 17 14:14:16.536319 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.536302 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xwzvs_0a24d5a7-3c55-475f-919d-5f0e2ff31346/kube-rbac-proxy/0.log" Sep 17 14:14:16.557159 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.557139 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xwzvs_0a24d5a7-3c55-475f-919d-5f0e2ff31346/init-textfile/0.log" Sep 17 14:14:16.585717 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.585692 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-kvc4l_93280963-56ab-4c51-a375-e2ff203f4528/kube-rbac-proxy-main/0.log" Sep 17 14:14:16.612052 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.612028 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-kvc4l_93280963-56ab-4c51-a375-e2ff203f4528/kube-rbac-proxy-self/0.log" Sep 17 14:14:16.640869 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.640845 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-kvc4l_93280963-56ab-4c51-a375-e2ff203f4528/openshift-state-metrics/0.log" Sep 17 14:14:16.681122 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.681096 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bd107db-d5c7-4755-99e9-db6c18a1f71c/prometheus/0.log" Sep 17 14:14:16.702029 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.701994 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bd107db-d5c7-4755-99e9-db6c18a1f71c/config-reloader/0.log" Sep 17 14:14:16.723121 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.723100 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bd107db-d5c7-4755-99e9-db6c18a1f71c/thanos-sidecar/0.log" Sep 17 14:14:16.744961 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.744940 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bd107db-d5c7-4755-99e9-db6c18a1f71c/kube-rbac-proxy-web/0.log" Sep 17 14:14:16.775319 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.775256 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bd107db-d5c7-4755-99e9-db6c18a1f71c/kube-rbac-proxy/0.log" Sep 17 14:14:16.796805 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.796784 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bd107db-d5c7-4755-99e9-db6c18a1f71c/kube-rbac-proxy-thanos/0.log" Sep 17 14:14:16.823183 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.823161 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9bd107db-d5c7-4755-99e9-db6c18a1f71c/init-config-reloader/0.log" Sep 17 14:14:16.855403 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.855357 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-b2pdg_fd33a2e3-d262-4a26-80a2-4fa316eafe80/prometheus-operator/0.log" Sep 17 14:14:16.874142 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.874118 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-b2pdg_fd33a2e3-d262-4a26-80a2-4fa316eafe80/kube-rbac-proxy/0.log" Sep 17 14:14:16.906247 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:16.906223 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-27fp5_46ac7e45-6ba7-4674-9ad1-e0d1e7c6aeeb/prometheus-operator-admission-webhook/0.log" Sep 17 14:14:18.806983 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:18.806956 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-jxxht_13a299bd-26c1-42fe-97ba-4e392899fade/console-operator/1.log" Sep 17 14:14:18.811964 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:18.811946 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-jxxht_13a299bd-26c1-42fe-97ba-4e392899fade/console-operator/2.log" Sep 17 14:14:19.216547 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.216498 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-bzdqb_bfcd7362-3d16-41d1-b192-8173b45a3acd/download-server/0.log" Sep 17 14:14:19.399584 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.399554 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz"] Sep 17 14:14:19.399891 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.399880 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011b10da-0613-4b73-8387-61ee34f647f8" containerName="gather" Sep 17 14:14:19.399935 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.399894 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="011b10da-0613-4b73-8387-61ee34f647f8" containerName="gather" Sep 17 14:14:19.399935 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.399902 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011b10da-0613-4b73-8387-61ee34f647f8" containerName="copy" Sep 17 14:14:19.399935 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.399908 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="011b10da-0613-4b73-8387-61ee34f647f8" containerName="copy" Sep 17 14:14:19.400031 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.399959 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="011b10da-0613-4b73-8387-61ee34f647f8" containerName="copy" Sep 17 14:14:19.400031 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.399968 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="011b10da-0613-4b73-8387-61ee34f647f8" containerName="gather" Sep 17 14:14:19.405157 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.405130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.407557 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.407534 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mj95w\"/\"default-dockercfg-8wsm7\"" Sep 17 14:14:19.407748 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.407607 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mj95w\"/\"kube-root-ca.crt\"" Sep 17 14:14:19.408312 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.408293 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mj95w\"/\"openshift-service-ca.crt\"" Sep 17 14:14:19.410168 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.410144 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz"] Sep 17 14:14:19.512268 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.512180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-podres\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.512268 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.512230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-sys\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.512268 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.512250 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-proc\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.512268 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.512269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-lib-modules\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.512597 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.512333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkcw9\" (UniqueName: \"kubernetes.io/projected/d86e02cc-e703-48e7-acd3-3613dd4c6097-kube-api-access-bkcw9\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.613627 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.613588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-podres\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.613784 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.613642 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-sys\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.613784 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.613668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-proc\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.613784 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.613690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-lib-modules\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.613784 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.613714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkcw9\" (UniqueName: \"kubernetes.io/projected/d86e02cc-e703-48e7-acd3-3613dd4c6097-kube-api-access-bkcw9\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.613784 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.613726 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-sys\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.613945 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.613780 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-podres\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.613945 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.613807 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-proc\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.613945 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.613833 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d86e02cc-e703-48e7-acd3-3613dd4c6097-lib-modules\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.620972 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.620945 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkcw9\" (UniqueName: \"kubernetes.io/projected/d86e02cc-e703-48e7-acd3-3613dd4c6097-kube-api-access-bkcw9\") pod \"perf-node-gather-daemonset-srdqz\" (UID: \"d86e02cc-e703-48e7-acd3-3613dd4c6097\") " pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.716314 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.716282 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:19.720706 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.720689 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-nsh8x_38ad25bf-7961-4d1e-8c1f-d37ed537599f/volume-data-source-validator/0.log" Sep 17 14:14:19.985030 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:19.984915 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz"] Sep 17 14:14:19.987414 ip-10-0-141-162 kubenswrapper[2579]: W0917 14:14:19.987381 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd86e02cc_e703_48e7_acd3_3613dd4c6097.slice/crio-35773b7a0bf18a31028db2f237018200ae08c850b139e2e3e30493c706dfecff WatchSource:0}: Error finding container 35773b7a0bf18a31028db2f237018200ae08c850b139e2e3e30493c706dfecff: Status 404 returned error can't find the container with id 35773b7a0bf18a31028db2f237018200ae08c850b139e2e3e30493c706dfecff Sep 17 14:14:20.432875 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:20.432840 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" event={"ID":"d86e02cc-e703-48e7-acd3-3613dd4c6097","Type":"ContainerStarted","Data":"1a002dbd67d2aff7290b80df2578bed729562d02c5f91519422bdc55b385db49"} Sep 17 14:14:20.433067 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:20.432893 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" event={"ID":"d86e02cc-e703-48e7-acd3-3613dd4c6097","Type":"ContainerStarted","Data":"35773b7a0bf18a31028db2f237018200ae08c850b139e2e3e30493c706dfecff"} Sep 17 14:14:20.433067 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:20.432959 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:20.449957 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:20.449905 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" podStartSLOduration=1.449889186 podStartE2EDuration="1.449889186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:14:20.447531467 +0000 UTC m=+724.375508934" watchObservedRunningTime="2026-09-17 14:14:20.449889186 +0000 UTC m=+724.377866651" Sep 17 14:14:20.527360 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:20.527336 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q4z4b_79997312-f6a0-415d-9dbb-d29c56ef8fa3/dns/0.log" Sep 17 14:14:20.548622 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:20.548599 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q4z4b_79997312-f6a0-415d-9dbb-d29c56ef8fa3/kube-rbac-proxy/0.log" Sep 17 14:14:20.677094 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:20.677066 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hvzjz_afc19d28-6130-48cf-9c98-fb7322afb2a4/dns-node-resolver/0.log" Sep 17 14:14:21.090500 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:21.090468 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-678cbb8976-tvr7z_5a484fef-5bbb-4c3e-b9fb-46d7f42bf070/registry/0.log" Sep 17 14:14:21.157504 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:21.157477 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8gbj_0b1a09ac-ddc5-4347-ae5d-c72914a28f8c/node-ca/0.log" Sep 17 14:14:22.237793 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:22.237766 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zcx7z_3e6ad178-db64-4383-a982-d77b5062c251/serve-healthcheck-canary/0.log" Sep 17 14:14:22.556351 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:22.556274 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-c5bsz_790e703e-06aa-4154-93ec-a287f61b49eb/insights-operator/1.log" Sep 17 14:14:22.563328 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:22.563303 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-c5bsz_790e703e-06aa-4154-93ec-a287f61b49eb/insights-operator/0.log" Sep 17 14:14:22.645489 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:22.645461 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k7c9d_d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c/kube-rbac-proxy/0.log" Sep 17 14:14:22.695970 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:22.695939 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k7c9d_d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c/exporter/0.log" Sep 17 14:14:22.721873 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:22.721845 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k7c9d_d9ea5f60-4d0e-490d-ac5c-b33dafe2f55c/extractor/0.log" Sep 17 14:14:26.447362 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:26.447333 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mj95w/perf-node-gather-daemonset-srdqz" Sep 17 14:14:27.653562 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:27.653530 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-nktcd_3a76b2ce-a344-4932-985f-502e9e6c2ccb/migrator/0.log" Sep 17 14:14:27.673423 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:27.673397 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-nktcd_3a76b2ce-a344-4932-985f-502e9e6c2ccb/graceful-termination/0.log" Sep 17 14:14:28.022438 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:28.022351 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-xhzxc_ad40e6da-5bd3-46cd-abe3-74b253e775e1/kube-storage-version-migrator-operator/1.log" Sep 17 14:14:28.023342 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:28.023314 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-xhzxc_ad40e6da-5bd3-46cd-abe3-74b253e775e1/kube-storage-version-migrator-operator/0.log" Sep 17 14:14:29.016593 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:29.016553 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2x9fn_6d19c6d2-15a4-4b4b-a801-82a2be0ea93a/kube-multus/0.log" Sep 17 14:14:29.213181 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:29.213094 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mrmcc_6ae198e7-1043-433e-96b8-1e5218562f8c/kube-multus-additional-cni-plugins/0.log" Sep 17 14:14:29.228521 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:29.228492 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mrmcc_6ae198e7-1043-433e-96b8-1e5218562f8c/egress-router-binary-copy/0.log" Sep 17 14:14:29.248680 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:29.248657 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mrmcc_6ae198e7-1043-433e-96b8-1e5218562f8c/cni-plugins/0.log" Sep 17 14:14:29.274948 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:29.274923 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mrmcc_6ae198e7-1043-433e-96b8-1e5218562f8c/bond-cni-plugin/0.log" Sep 17 14:14:29.293523 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:29.293483 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mrmcc_6ae198e7-1043-433e-96b8-1e5218562f8c/routeoverride-cni/0.log" Sep 17 14:14:29.313101 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:29.313063 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mrmcc_6ae198e7-1043-433e-96b8-1e5218562f8c/whereabouts-cni-bincopy/0.log" Sep 17 14:14:29.331589 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:29.331565 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mrmcc_6ae198e7-1043-433e-96b8-1e5218562f8c/whereabouts-cni/0.log" Sep 17 14:14:29.635341 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:29.635307 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xs7g2_11c9baa0-1192-4bca-a430-9b2fd7484dd7/network-metrics-daemon/0.log" Sep 17 14:14:29.652902 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:29.652877 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xs7g2_11c9baa0-1192-4bca-a430-9b2fd7484dd7/kube-rbac-proxy/0.log" Sep 17 14:14:30.616937 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:30.616908 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lclzj_ccee8267-a695-4631-a023-f61378ce1aa8/ovn-controller/0.log" Sep 17 14:14:30.634383 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:30.634342 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lclzj_ccee8267-a695-4631-a023-f61378ce1aa8/ovn-acl-logging/0.log" Sep 17 14:14:30.657114 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:30.657089 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lclzj_ccee8267-a695-4631-a023-f61378ce1aa8/kube-rbac-proxy-node/0.log" Sep 17 14:14:30.676204 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:30.676165 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lclzj_ccee8267-a695-4631-a023-f61378ce1aa8/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 14:14:30.690787 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:30.690755 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lclzj_ccee8267-a695-4631-a023-f61378ce1aa8/northd/0.log" Sep 17 14:14:30.708831 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:30.708804 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lclzj_ccee8267-a695-4631-a023-f61378ce1aa8/nbdb/0.log" Sep 17 14:14:30.728728 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:30.728708 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lclzj_ccee8267-a695-4631-a023-f61378ce1aa8/sbdb/0.log" Sep 17 14:14:30.762198 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:30.762166 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lclzj_ccee8267-a695-4631-a023-f61378ce1aa8/ovnkube-controller/0.log" Sep 17 14:14:31.946302 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:31.946274 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ztd5n_5ce55ebb-3f80-4447-942c-ffe73e59a5e0/network-check-target-container/0.log" Sep 17 14:14:32.806954 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:32.806880 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-n466b_3200be8a-6fdd-4af6-9129-f4e1075f110f/iptables-alerter/0.log" Sep 17 14:14:33.502632 ip-10-0-141-162 kubenswrapper[2579]: I0917 14:14:33.502603 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-l2fst_630dbd91-2a35-4ff7-9d36-6444a6463349/tuned/0.log"