Sep 10 17:39:32.357327 ip-10-0-143-62 systemd[1]: Starting Kubernetes Kubelet... Sep 10 17:39:32.754466 ip-10-0-143-62 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:39:32.754466 ip-10-0-143-62 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 17:39:32.754466 ip-10-0-143-62 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:39:32.754466 ip-10-0-143-62 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 17:39:32.754466 ip-10-0-143-62 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:39:32.755327 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.755245 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 17:39:32.760140 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760125 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:32.760140 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760139 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760145 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760149 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760153 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760156 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760159 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760162 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760165 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760168 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760171 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760173 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760176 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760178 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760181 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760183 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760186 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760189 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760192 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760194 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760197 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:32.760207 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760200 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760203 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760205 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760208 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760210 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760213 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760216 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760219 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760222 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760224 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760227 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760229 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760232 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760234 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760237 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760239 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760242 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760245 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760247 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:32.760685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760250 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760253 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760255 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760258 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760260 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760263 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760265 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760268 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760272 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760275 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760278 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760281 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760284 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760286 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760289 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760293 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760296 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760300 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760303 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:32.761189 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760305 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760308 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760311 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760313 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760316 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760318 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760321 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760324 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760326 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760329 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760331 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760334 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760337 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760339 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760342 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760344 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760347 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760349 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760352 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760354 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:32.761642 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760357 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760360 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760364 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760368 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760371 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760373 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760376 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760379 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760382 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760385 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760388 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760390 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760393 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760395 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760398 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760400 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760403 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760406 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760408 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:32.762132 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.760411 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761165 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761174 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761177 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761180 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761184 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761195 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761199 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761201 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761205 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761208 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761211 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761214 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761217 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761220 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761222 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761225 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761228 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761230 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:32.762687 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761233 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761236 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761239 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761242 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761244 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761247 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761250 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761253 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761255 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761258 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761260 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761263 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761265 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761268 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761270 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761273 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761275 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761278 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761280 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761282 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:32.763181 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761293 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761296 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761298 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761301 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761306 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761308 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761310 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761313 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761315 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761318 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761320 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761324 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761328 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761331 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761335 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761338 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761341 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761344 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761346 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:32.763657 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761349 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761352 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761354 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761357 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761360 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761362 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761364 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761367 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761370 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761372 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761375 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761377 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761380 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761382 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761390 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761393 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761395 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761398 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761401 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761404 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:32.764142 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761406 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761408 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761411 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761414 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761418 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761422 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761425 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761427 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761430 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761432 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761435 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761437 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761440 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761442 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761444 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761447 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761449 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761452 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761454 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:32.764635 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761457 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761459 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761462 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761839 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761844 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761848 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761852 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761856 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761860 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761863 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761865 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761868 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761871 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761874 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761876 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761879 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761881 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761884 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761887 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:32.765133 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761890 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761892 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761895 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761898 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761901 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761904 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761906 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761909 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761911 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761914 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761916 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761919 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761921 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761924 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761926 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761929 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761931 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761934 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761937 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761939 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:32.765595 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761941 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761947 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761950 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761952 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761955 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761957 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761960 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761962 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761965 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761967 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761970 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761972 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761975 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761978 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761981 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761984 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761987 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761990 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761993 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761995 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:32.766096 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.761999 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762002 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762004 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762007 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762009 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762012 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762015 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762018 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762020 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762023 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762027 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762047 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762050 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762055 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762059 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762062 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762065 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762068 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762070 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762072 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:32.766702 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762075 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762078 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762080 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762083 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762085 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762088 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762092 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762094 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762097 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762099 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762102 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762105 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762109 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762112 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762114 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762117 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762119 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762122 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762124 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:32.767208 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762127 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762129 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762132 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762135 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762206 2570 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762247 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762256 2570 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762261 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762266 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762269 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762274 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762278 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762281 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762285 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762288 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762291 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762294 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762298 2570 flags.go:64] FLAG: --cgroup-root="" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762301 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762304 2570 flags.go:64] FLAG: --client-ca-file="" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762307 2570 flags.go:64] FLAG: --cloud-provider="external" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762310 2570 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762313 2570 flags.go:64] FLAG: --cluster-domain="" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762316 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 17:39:32.767685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762319 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762324 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762327 2570 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762331 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762335 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762338 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762341 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762344 2570 flags.go:64] FLAG: --contention-profiling="false" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762347 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762350 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762353 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762356 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762361 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762363 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762381 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762385 2570 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762388 2570 flags.go:64] FLAG: --enable-server="true" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762392 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762396 2570 flags.go:64] FLAG: --event-burst="100" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762400 2570 flags.go:64] FLAG: --event-qps="50" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762403 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762406 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762409 2570 flags.go:64] FLAG: --eviction-hard="" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762413 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 17:39:32.768304 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762416 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762419 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762422 2570 flags.go:64] FLAG: --eviction-soft="" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762425 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762428 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762430 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762433 2570 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762436 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762439 2570 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762443 2570 flags.go:64] FLAG: --feature-gates="" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762447 2570 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762451 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762454 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762457 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762460 2570 flags.go:64] FLAG: --healthz-port="10248" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762463 2570 flags.go:64] FLAG: --help="false" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762466 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-143-62.ec2.internal" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762469 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762473 2570 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762476 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762479 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762482 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762487 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 17:39:32.768872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762490 2570 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762492 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762495 2570 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762499 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762502 2570 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762505 2570 flags.go:64] FLAG: --kube-reserved="" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762508 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762511 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762514 2570 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762517 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762520 2570 flags.go:64] FLAG: --lock-file="" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762522 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762525 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762528 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762533 2570 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762536 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762539 2570 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762542 2570 flags.go:64] FLAG: --logging-format="text" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762546 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762549 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762552 2570 flags.go:64] FLAG: --manifest-url="" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762555 2570 flags.go:64] FLAG: --manifest-url-header="" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762559 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762562 2570 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762566 2570 flags.go:64] FLAG: --max-pods="110" Sep 10 17:39:32.769463 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762569 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762572 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762575 2570 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762578 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762581 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762584 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762587 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762594 2570 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762597 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762600 2570 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762603 2570 flags.go:64] FLAG: --pod-cidr="" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762607 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762613 2570 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762616 2570 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762619 2570 flags.go:64] FLAG: --pods-per-core="0" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762622 2570 flags.go:64] FLAG: --port="10250" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762625 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762628 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-082b09dd9d575c438" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762631 2570 flags.go:64] FLAG: --qos-reserved="" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762634 2570 flags.go:64] FLAG: --read-only-port="10255" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762637 2570 flags.go:64] FLAG: --register-node="true" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762639 2570 flags.go:64] FLAG: --register-with-taints="" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762651 2570 flags.go:64] FLAG: --registry-burst="10" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762654 2570 flags.go:64] FLAG: --registry-qps="5" Sep 10 17:39:32.770079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762657 2570 flags.go:64] FLAG: --reserved-cpus="" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762662 2570 flags.go:64] FLAG: --reserved-memory="" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762665 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762669 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762672 2570 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762675 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762678 2570 flags.go:64] FLAG: --runonce="false" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762681 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762685 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762687 2570 flags.go:64] FLAG: --seccomp-default="false" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762690 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762693 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762697 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762700 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762703 2570 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762707 2570 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762710 2570 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762713 2570 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762716 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762719 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762723 2570 flags.go:64] FLAG: --system-cgroups="" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762726 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762732 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762735 2570 flags.go:64] FLAG: --tls-cert-file="" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762738 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 17:39:32.770682 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762741 2570 flags.go:64] FLAG: --tls-min-version="" Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762744 2570 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762746 2570 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762749 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762752 2570 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762755 2570 flags.go:64] FLAG: --v="2" Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762759 2570 flags.go:64] FLAG: --version="false" Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762763 2570 flags.go:64] FLAG: --vmodule="" Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762768 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.762771 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762890 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762893 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762896 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762900 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762902 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762905 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762907 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762910 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762912 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762915 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762918 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762920 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:32.771317 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762924 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762927 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762929 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762932 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762934 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762937 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762940 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762943 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762946 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762948 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762951 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762953 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762956 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762958 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762961 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762964 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762967 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762970 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762974 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:32.771889 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762976 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762979 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762981 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762984 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762986 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762989 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762991 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762994 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762996 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.762999 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763001 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763004 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763006 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763010 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763013 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763015 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763018 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763020 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763023 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763025 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:32.772360 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763028 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763043 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763046 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763048 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763051 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763055 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763059 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763062 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763065 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763068 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763071 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763076 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763079 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763081 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763091 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763094 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763098 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763102 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763105 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:32.772837 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763108 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763110 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763113 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763116 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763120 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763123 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763128 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763131 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763134 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763137 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763140 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763143 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763146 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763149 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763152 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763155 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763158 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763161 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763164 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:32.773300 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763167 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763169 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763172 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763175 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763177 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763181 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763184 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763187 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763190 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.763192 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.763198 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.770829 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.770845 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.771666 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.771673 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 17:39:32.773772 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771725 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771730 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771734 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771737 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771740 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771743 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771745 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771748 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771751 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771755 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771760 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771764 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771767 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771770 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771773 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771776 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771779 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771781 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771784 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:32.774398 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771788 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771790 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771793 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771796 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771798 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771801 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771803 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771806 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771810 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771812 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771816 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771819 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771822 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771824 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771827 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771829 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771834 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771837 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771840 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771843 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:32.775131 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771846 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771848 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771851 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771854 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771856 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771859 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771861 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771863 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771866 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771869 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771871 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771874 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771876 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771879 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771881 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771884 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771887 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771889 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771892 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:32.775660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771895 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771898 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771901 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771904 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771907 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771909 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771912 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771915 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771917 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771919 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771923 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771926 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771929 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771932 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771934 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771936 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771939 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771942 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771944 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771947 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:32.776308 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771949 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771952 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771954 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771957 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771959 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771962 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771964 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771967 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771969 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771972 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771975 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771977 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771980 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771983 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771986 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771989 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771992 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771995 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.771997 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772000 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:32.776790 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772002 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.772007 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772142 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772148 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772151 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772154 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772156 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772159 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772162 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772164 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772167 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772169 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772172 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772174 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772177 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:39:32.777299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772179 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772182 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772184 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772187 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772189 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772191 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772194 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772196 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772199 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772201 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772203 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772206 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772210 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772212 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772215 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772218 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772221 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772223 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772226 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772229 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:39:32.777664 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772231 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772234 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772236 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772239 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772241 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772244 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772247 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772249 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772252 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772254 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772257 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772259 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772262 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772265 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772267 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772269 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772272 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772274 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772277 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772279 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:39:32.778168 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772282 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772285 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772287 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772290 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772293 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772295 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772298 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772300 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772303 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772306 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772308 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772310 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772313 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772316 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772319 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772323 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772326 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772328 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772331 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772333 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:39:32.778654 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772336 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772338 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772341 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772344 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772348 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772351 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772354 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772357 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772359 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772362 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772365 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772369 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772372 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772375 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772378 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772381 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772384 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772387 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:39:32.779150 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772389 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772392 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772394 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772397 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772400 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772403 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772405 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:32.772407 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.772412 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.772510 2570 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.776823 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.777776 2570 server.go:1019] "Starting client certificate rotation" Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.777871 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 17:39:32.779592 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.777907 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 17:39:32.780178 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.780164 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 17:39:32.781308 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.781289 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 17:39:32.791363 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.791346 2570 log.go:25] "Validated CRI v1 runtime API" Sep 10 17:39:32.794412 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.794398 2570 log.go:25] "Validated CRI v1 image API" Sep 10 17:39:32.797667 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.797645 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 17:39:32.800149 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.800130 2570 fs.go:135] Filesystem UUIDs: map[0f21b0c4-0e94-46ad-80bf-3a001cc03848:/dev/nvme0n1p3 7594c919-b210-4a3b-8e09-26a8653ce0d5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 10 17:39:32.800228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.800147 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 17:39:32.805381 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.805275 2570 manager.go:216] Machine: {Timestamp:2026-09-10 17:39:32.803830481 +0000 UTC m=+0.318866872 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097986 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2225db8cde5a06227383c04557d92a SystemUUID:ec2225db-8cde-5a06-2273-83c04557d92a BootID:8245037c-d25b-4ad1-b49e-d9169e419a43 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fc:47:81:f4:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fc:47:81:f4:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:3e:af:07:c1:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 17:39:32.805381 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.805375 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 17:39:32.805502 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.805482 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 17:39:32.808449 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.808423 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 17:39:32.808582 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.808452 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-62.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 17:39:32.809218 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.809208 2570 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 17:39:32.809254 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.809221 2570 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 17:39:32.809254 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.809229 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 17:39:32.810471 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.810461 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 17:39:32.811563 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.811552 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 17:39:32.816579 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.816566 2570 state_mem.go:36] "Initialized new in-memory state store" Sep 10 17:39:32.816690 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.816681 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 17:39:32.816722 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.816712 2570 kubelet.go:486] "Attempting to sync node with API server" Sep 10 17:39:32.816754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.816723 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 17:39:32.816754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.816738 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 17:39:32.816754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.816746 2570 kubelet.go:398] "Adding apiserver pod source" Sep 10 17:39:32.816754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.816754 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 17:39:32.817171 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.817139 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 17:39:32.817232 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.817181 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 17:39:32.817916 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.817703 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 17:39:32.820644 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.820622 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 17:39:32.823487 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.823474 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 17:39:32.823542 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.823503 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 17:39:32.825412 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825399 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 17:39:32.825451 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825420 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 17:39:32.825451 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825426 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 17:39:32.825451 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825431 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 17:39:32.825451 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825440 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 17:39:32.825451 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825445 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 17:39:32.825591 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825458 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 17:39:32.825591 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825464 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 17:39:32.825591 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825471 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 17:39:32.825591 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825476 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 17:39:32.825591 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825485 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 17:39:32.825591 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.825490 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 17:39:32.827367 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.827353 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 17:39:32.827367 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.827366 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 17:39:32.829432 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.829404 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 17:39:32.829493 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.829402 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 17:39:32.831058 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.831028 2570 server.go:1268] "Started kubelet" Sep 10 17:39:32.831151 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.831131 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 17:39:32.831202 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.831124 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 17:39:32.831202 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.831188 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 17:39:32.831855 ip-10-0-143-62 systemd[1]: Started Kubernetes Kubelet. Sep 10 17:39:32.832855 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.832762 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 17:39:32.836126 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.836091 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 17:39:32.836366 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.836353 2570 server.go:310] "Adding debug handlers to kubelet server" Sep 10 17:39:32.841074 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.841060 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 17:39:32.841628 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.841611 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 17:39:32.841823 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.841796 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:32.841963 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.841945 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-62.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 17:39:32.842490 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842470 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 17:39:32.842490 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842472 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 17:39:32.842621 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842498 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 17:39:32.842621 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842516 2570 factory.go:55] Registering systemd factory Sep 10 17:39:32.842621 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842534 2570 factory.go:223] Registration of the systemd container factory successfully Sep 10 17:39:32.842783 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842753 2570 factory.go:153] Registering CRI-O factory Sep 10 17:39:32.842783 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842762 2570 factory.go:223] Registration of the crio container factory successfully Sep 10 17:39:32.842866 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842786 2570 reconstruct.go:97] "Volume reconstruction finished" Sep 10 17:39:32.842866 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842795 2570 reconciler.go:29] "Reconciler: start to sync state" Sep 10 17:39:32.842866 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842836 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 17:39:32.842866 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842854 2570 factory.go:103] Registering Raw factory Sep 10 17:39:32.843065 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.842868 2570 manager.go:1196] Started watching for new ooms in manager Sep 10 17:39:32.843065 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.841860 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-62.ec2.internal.18d40662abc05cb0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-62.ec2.internal,UID:ip-10-0-143-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-62.ec2.internal,},FirstTimestamp:2026-09-10 17:39:32.831001776 +0000 UTC m=+0.346038150,LastTimestamp:2026-09-10 17:39:32.831001776 +0000 UTC m=+0.346038150,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-62.ec2.internal,}" Sep 10 17:39:32.843897 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.843883 2570 manager.go:349] Starting recovery of all containers Sep 10 17:39:32.844502 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.844477 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 17:39:32.844580 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.844504 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 17:39:32.855792 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.855773 2570 manager.go:354] Recovery completed Sep 10 17:39:32.857083 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.857056 2570 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 10 17:39:32.860417 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.860406 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:32.862210 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.862185 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:32.862282 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.862228 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:32.862282 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.862242 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:32.862858 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.862841 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 17:39:32.862858 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.862850 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:32.862858 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.862856 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 17:39:32.863013 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.862873 2570 state_mem.go:36] "Initialized new in-memory state store" Sep 10 17:39:32.863923 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.863902 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:32.863923 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.863925 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:32.864017 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.863935 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:32.865002 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.864936 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-62.ec2.internal.18d40662ad9c8f1f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-62.ec2.internal,UID:ip-10-0-143-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-62.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-62.ec2.internal,},FirstTimestamp:2026-09-10 17:39:32.862209823 +0000 UTC m=+0.377246203,LastTimestamp:2026-09-10 17:39:32.862209823 +0000 UTC m=+0.377246203,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-62.ec2.internal,}" Sep 10 17:39:32.880188 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.880111 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-62.ec2.internal.18d40662ad9cee0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-62.ec2.internal,UID:ip-10-0-143-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-62.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-62.ec2.internal,},FirstTimestamp:2026-09-10 17:39:32.862234125 +0000 UTC m=+0.377270502,LastTimestamp:2026-09-10 17:39:32.862234125 +0000 UTC m=+0.377270502,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-62.ec2.internal,}" Sep 10 17:39:32.887738 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.887673 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-62.ec2.internal.18d40662ad9d2436 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-62.ec2.internal,UID:ip-10-0-143-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-62.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-62.ec2.internal,},FirstTimestamp:2026-09-10 17:39:32.86224799 +0000 UTC m=+0.377284366,LastTimestamp:2026-09-10 17:39:32.86224799 +0000 UTC m=+0.377284366,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-62.ec2.internal,}" Sep 10 17:39:32.891205 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.890242 2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-62.ec2.internal.18d40662ad9c8f1f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-62.ec2.internal.18d40662ad9c8f1f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-62.ec2.internal,UID:ip-10-0-143-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-62.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-62.ec2.internal,},FirstTimestamp:2026-09-10 17:39:32.862209823 +0000 UTC m=+0.377246203,LastTimestamp:2026-09-10 17:39:32.863913997 +0000 UTC m=+0.378950374,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-62.ec2.internal,}" Sep 10 17:39:32.895914 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.895893 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-59kmk" Sep 10 17:39:32.898002 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.897946 2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-62.ec2.internal.18d40662ad9cee0d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-62.ec2.internal.18d40662ad9cee0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-62.ec2.internal,UID:ip-10-0-143-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-62.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-62.ec2.internal,},FirstTimestamp:2026-09-10 17:39:32.862234125 +0000 UTC m=+0.377270502,LastTimestamp:2026-09-10 17:39:32.86393002 +0000 UTC m=+0.378966399,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-62.ec2.internal,}" Sep 10 17:39:32.902706 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:32.902690 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-59kmk" Sep 10 17:39:32.904619 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.904565 2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-62.ec2.internal.18d40662ad9d2436\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-62.ec2.internal.18d40662ad9d2436 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-62.ec2.internal,UID:ip-10-0-143-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-62.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-62.ec2.internal,},FirstTimestamp:2026-09-10 17:39:32.86224799 +0000 UTC m=+0.377284366,LastTimestamp:2026-09-10 17:39:32.863939172 +0000 UTC m=+0.378975550,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-62.ec2.internal,}" Sep 10 17:39:32.942440 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:32.942417 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:33.007135 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.007055 2570 policy_none.go:49] "None policy: Start" Sep 10 17:39:33.007135 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.007085 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 17:39:33.007135 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.007097 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 17:39:33.009153 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.009138 2570 policy_none.go:47] "Start" Sep 10 17:39:33.040563 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.040543 2570 manager.go:337] "Starting Device Plugin manager" Sep 10 17:39:33.040700 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.040587 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 17:39:33.040700 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.040601 2570 server.go:87] "Starting device plugin registration server" Sep 10 17:39:33.040889 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.040875 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 17:39:33.040925 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.040895 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 17:39:33.041011 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.040984 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 17:39:33.041091 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.041085 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 17:39:33.041140 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.041094 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 17:39:33.042174 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.042153 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 17:39:33.042245 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.042199 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:33.044735 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.044651 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-62.ec2.internal.18d40662b85e7369 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-62.ec2.internal,UID:ip-10-0-143-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-143-62.ec2.internal,},FirstTimestamp:2026-09-10 17:39:33.042688873 +0000 UTC m=+0.557725238,LastTimestamp:2026-09-10 17:39:33.042688873 +0000 UTC m=+0.557725238,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-62.ec2.internal,}" Sep 10 17:39:33.058774 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.058751 2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-62.ec2.internal\" not found" node="ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.069917 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.069891 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 17:39:33.071301 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.071278 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 17:39:33.071380 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.071335 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 17:39:33.071380 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.071359 2570 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 17:39:33.071455 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.071396 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 17:39:33.074330 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.074311 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:33.142051 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.142001 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:33.142954 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.142938 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:33.143064 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.142965 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:33.143064 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.142975 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:33.143064 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.143004 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.159543 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.159522 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.159623 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.159546 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-62.ec2.internal\": node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:33.171942 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.171920 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-62.ec2.internal"] Sep 10 17:39:33.172065 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.172000 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:33.172880 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.172864 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:33.172953 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.172893 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:33.172953 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.172902 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:33.175000 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.174987 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:33.175129 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.175115 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.175169 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.175143 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:33.175683 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.175665 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:33.175683 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.175674 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:33.175805 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.175696 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:33.175805 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.175700 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:33.175805 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.175708 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:33.175805 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.175711 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:33.177713 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.177700 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.177764 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.177724 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:39:33.178321 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.178308 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:39:33.178389 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.178336 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:39:33.178389 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.178347 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:39:33.186245 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.186230 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:33.201709 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.201684 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-62.ec2.internal\" not found" node="ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.205991 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.205974 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-62.ec2.internal\" not found" node="ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.244782 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.244755 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c07934797882c1f299c442a974c47d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal\" (UID: \"4c07934797882c1f299c442a974c47d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.244879 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.244784 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c07934797882c1f299c442a974c47d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal\" (UID: \"4c07934797882c1f299c442a974c47d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.244879 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.244802 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90b12f471b7c3e45831e3875b9139835-config\") pod \"kube-apiserver-proxy-ip-10-0-143-62.ec2.internal\" (UID: \"90b12f471b7c3e45831e3875b9139835\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.287148 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.287074 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:33.345372 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.345337 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90b12f471b7c3e45831e3875b9139835-config\") pod \"kube-apiserver-proxy-ip-10-0-143-62.ec2.internal\" (UID: \"90b12f471b7c3e45831e3875b9139835\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.345540 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.345391 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c07934797882c1f299c442a974c47d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal\" (UID: \"4c07934797882c1f299c442a974c47d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.345540 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.345407 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90b12f471b7c3e45831e3875b9139835-config\") pod \"kube-apiserver-proxy-ip-10-0-143-62.ec2.internal\" (UID: \"90b12f471b7c3e45831e3875b9139835\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.345540 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.345430 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c07934797882c1f299c442a974c47d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal\" (UID: \"4c07934797882c1f299c442a974c47d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.345540 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.345416 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c07934797882c1f299c442a974c47d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal\" (UID: \"4c07934797882c1f299c442a974c47d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.345540 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.345441 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c07934797882c1f299c442a974c47d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal\" (UID: \"4c07934797882c1f299c442a974c47d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.388009 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.387985 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:33.488563 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.488530 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:33.504733 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.504705 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.510750 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.510726 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-62.ec2.internal" Sep 10 17:39:33.589009 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.588917 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:33.689484 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.689457 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:33.728565 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.728379 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:33.777978 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.777945 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 17:39:33.778431 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.778111 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 17:39:33.778431 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.778127 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 17:39:33.790087 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.790060 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:33.890651 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.890572 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:33.909123 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.909074 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 17:34:33 +0000 UTC" deadline="2028-05-18 19:09:16.529345168 +0000 UTC" Sep 10 17:39:33.909123 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:33.909110 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14785h29m42.620238838s" Sep 10 17:39:33.991562 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:33.991525 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-62.ec2.internal\" not found" Sep 10 17:39:34.083103 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.083079 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:34.141954 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.141871 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-62.ec2.internal" Sep 10 17:39:34.157834 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.157804 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 17:39:34.159389 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.159370 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" Sep 10 17:39:34.178193 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.178170 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 17:39:34.246345 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:34.246305 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c07934797882c1f299c442a974c47d9.slice/crio-effc5e09a2fa93e2438e23e5c4de80256a46846e1764910e5ea50ecc375356c3 WatchSource:0}: Error finding container effc5e09a2fa93e2438e23e5c4de80256a46846e1764910e5ea50ecc375356c3: Status 404 returned error can't find the container with id effc5e09a2fa93e2438e23e5c4de80256a46846e1764910e5ea50ecc375356c3 Sep 10 17:39:34.249994 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.249931 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:39:34.250286 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.250263 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:34.256747 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:34.256718 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b12f471b7c3e45831e3875b9139835.slice/crio-05e5037a630d4d18bbd581832509bafd72db39653bd1ff673c76c4e9d0f57aa2 WatchSource:0}: Error finding container 05e5037a630d4d18bbd581832509bafd72db39653bd1ff673c76c4e9d0f57aa2: Status 404 returned error can't find the container with id 05e5037a630d4d18bbd581832509bafd72db39653bd1ff673c76c4e9d0f57aa2 Sep 10 17:39:34.818631 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.818602 2570 apiserver.go:52] "Watching apiserver" Sep 10 17:39:34.828540 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.828515 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 17:39:34.828910 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.828887 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal","openshift-multus/multus-jttf7","openshift-multus/network-metrics-daemon-q7vrb","openshift-network-diagnostics/network-check-target-xgb5w","openshift-network-operator/iptables-alerter-sfcwg","kube-system/global-pull-secret-syncer-jjrq9","kube-system/kube-apiserver-proxy-ip-10-0-143-62.ec2.internal","openshift-cluster-node-tuning-operator/tuned-tnl5h","openshift-dns/node-resolver-282gm","openshift-multus/multus-additional-cni-plugins-5pnk7","openshift-ovn-kubernetes/ovnkube-node-4kn7g","kube-system/konnectivity-agent-9kng8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj","openshift-image-registry/node-ca-ht8ws"] Sep 10 17:39:34.831758 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.831737 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.833994 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.833976 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.835245 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.835221 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 17:39:34.835366 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.835255 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 17:39:34.835366 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.835261 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 17:39:34.835489 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.835475 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xdph4\"" Sep 10 17:39:34.835735 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.835716 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 17:39:34.835824 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.835745 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 17:39:34.837045 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.837022 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:34.837164 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.837072 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 17:39:34.837164 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:34.837112 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:34.837573 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.837551 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 17:39:34.837681 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.837659 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 17:39:34.837774 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.837756 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w5v8n\"" Sep 10 17:39:34.839725 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.839615 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:34.839725 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:34.839681 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:34.842829 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.842810 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 17:39:34.842969 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.842949 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sfcwg" Sep 10 17:39:34.845545 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.845520 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:39:34.845749 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.845726 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 17:39:34.846124 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.846106 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:34.846225 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:34.846176 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:34.847210 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.847189 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 17:39:34.847336 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.847311 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8kh2s\"" Sep 10 17:39:34.849609 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.849586 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-282gm" Sep 10 17:39:34.853325 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853299 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-socket-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.853504 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853342 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-device-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.853504 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853370 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd929\" (UniqueName: \"kubernetes.io/projected/448d8b33-6d1d-47d2-96c9-33f04a59e28b-kube-api-access-gd929\") pod \"iptables-alerter-sfcwg\" (UID: \"448d8b33-6d1d-47d2-96c9-33f04a59e28b\") " pod="openshift-network-operator/iptables-alerter-sfcwg" Sep 10 17:39:34.853504 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853396 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de45abfe-1156-4ea1-8c4e-d09c9fb00720-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.853504 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853437 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de45abfe-1156-4ea1-8c4e-d09c9fb00720-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.853504 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853464 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gzjn\" (UniqueName: \"kubernetes.io/projected/de45abfe-1156-4ea1-8c4e-d09c9fb00720-kube-api-access-8gzjn\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.853504 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853488 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853512 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-etc-selinux\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853535 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853538 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7spb\" (UniqueName: \"kubernetes.io/projected/ec8eba52-69db-4066-8153-32bdd26a7a66-kube-api-access-f7spb\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853602 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/448d8b33-6d1d-47d2-96c9-33f04a59e28b-iptables-alerter-script\") pod \"iptables-alerter-sfcwg\" (UID: \"448d8b33-6d1d-47d2-96c9-33f04a59e28b\") " pod="openshift-network-operator/iptables-alerter-sfcwg" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853627 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de45abfe-1156-4ea1-8c4e-d09c9fb00720-cni-binary-copy\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853648 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853653 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de45abfe-1156-4ea1-8c4e-d09c9fb00720-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853733 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-registration-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853765 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-sys-fs\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853792 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853817 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9r6zz\"" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853819 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tswh\" (UniqueName: \"kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh\") pod \"network-check-target-xgb5w\" (UID: \"546e4ffc-92e6-41ac-b5bc-04b376d58073\") " pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853852 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ht8ws" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/448d8b33-6d1d-47d2-96c9-33f04a59e28b-host-slash\") pod \"iptables-alerter-sfcwg\" (UID: \"448d8b33-6d1d-47d2-96c9-33f04a59e28b\") " pod="openshift-network-operator/iptables-alerter-sfcwg" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853885 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de45abfe-1156-4ea1-8c4e-d09c9fb00720-cnibin\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853909 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcrn2\" (UniqueName: \"kubernetes.io/projected/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-kube-api-access-zcrn2\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853934 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-kubelet-config\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:34.853979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853956 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-dbus\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:34.854778 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.853981 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:34.854778 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.854004 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de45abfe-1156-4ea1-8c4e-d09c9fb00720-system-cni-dir\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.856035 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.856007 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.856842 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.856804 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 17:39:34.856945 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.856896 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 17:39:34.856945 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.856899 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rv5zr\"" Sep 10 17:39:34.857659 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.857190 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 17:39:34.858600 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.858581 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.858709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.858622 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4zdl9\"" Sep 10 17:39:34.859029 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.859010 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 17:39:34.861295 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.861271 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.861754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.861478 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 17:39:34.861754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.861519 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j59cz\"" Sep 10 17:39:34.861754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.861544 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:39:34.863826 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.863806 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:39:34.865386 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.865341 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 17:39:34.867179 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.866934 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 17:39:34.867179 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.866987 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 17:39:34.867436 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.867273 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 17:39:34.868707 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.868398 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 17:39:34.868707 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.868448 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kft6h\"" Sep 10 17:39:34.868707 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.868448 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 17:39:34.868707 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.868408 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 17:39:34.868707 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.868540 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 17:39:34.868707 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.868466 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vh96r\"" Sep 10 17:39:34.869087 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.868770 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 17:39:34.901272 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.901244 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-74l9w" Sep 10 17:39:34.911244 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.911225 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-74l9w" Sep 10 17:39:34.943683 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.943653 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 17:39:34.954238 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954210 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-var-lib-kubelet\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.954238 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954242 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-run-multus-certs\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.954453 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954264 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-host\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.954453 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954302 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-systemd-units\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.954453 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954348 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/448d8b33-6d1d-47d2-96c9-33f04a59e28b-host-slash\") pod \"iptables-alerter-sfcwg\" (UID: \"448d8b33-6d1d-47d2-96c9-33f04a59e28b\") " pod="openshift-network-operator/iptables-alerter-sfcwg" Sep 10 17:39:34.954453 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954396 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de45abfe-1156-4ea1-8c4e-d09c9fb00720-cnibin\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.954453 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954398 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/448d8b33-6d1d-47d2-96c9-33f04a59e28b-host-slash\") pod \"iptables-alerter-sfcwg\" (UID: \"448d8b33-6d1d-47d2-96c9-33f04a59e28b\") " pod="openshift-network-operator/iptables-alerter-sfcwg" Sep 10 17:39:34.954453 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954425 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d756089e-495a-4d2b-aed2-414349e8ca4e-serviceca\") pod \"node-ca-ht8ws\" (UID: \"d756089e-495a-4d2b-aed2-414349e8ca4e\") " pod="openshift-image-registry/node-ca-ht8ws" Sep 10 17:39:34.954453 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954451 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de45abfe-1156-4ea1-8c4e-d09c9fb00720-cnibin\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954451 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-kubelet\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954484 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-log-socket\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954509 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c281aa7f-4f94-415c-ad6f-fea23e1a877d-konnectivity-ca\") pod \"konnectivity-agent-9kng8\" (UID: \"c281aa7f-4f94-415c-ad6f-fea23e1a877d\") " pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954537 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-dbus\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954564 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de45abfe-1156-4ea1-8c4e-d09c9fb00720-system-cni-dir\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954626 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de45abfe-1156-4ea1-8c4e-d09c9fb00720-system-cni-dir\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954660 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/651a4d52-994d-4698-9b73-4946ab6459db-tmp-dir\") pod \"node-resolver-282gm\" (UID: \"651a4d52-994d-4698-9b73-4946ab6459db\") " pod="openshift-dns/node-resolver-282gm" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954686 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-cni-dir\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954713 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-tuned\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954738 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-tmp\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954756 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-dbus\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954761 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-run-netns\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954785 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-etc-openvswitch\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.954809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954810 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-etc-kubernetes\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954834 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd99z\" (UniqueName: \"kubernetes.io/projected/fe904ee3-e962-4a60-a5ba-65d502d9d68d-kube-api-access-hd99z\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954858 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-run-ovn-kubernetes\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954883 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-cni-bin\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954933 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-run-k8s-cni-cncf-io\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.954969 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-var-lib-cni-multus\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955004 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-modprobe-d\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955026 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955069 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-etc-selinux\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/448d8b33-6d1d-47d2-96c9-33f04a59e28b-iptables-alerter-script\") pod \"iptables-alerter-sfcwg\" (UID: \"448d8b33-6d1d-47d2-96c9-33f04a59e28b\") " pod="openshift-network-operator/iptables-alerter-sfcwg" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955109 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tnfd\" (UniqueName: \"kubernetes.io/projected/651a4d52-994d-4698-9b73-4946ab6459db-kube-api-access-8tnfd\") pod \"node-resolver-282gm\" (UID: \"651a4d52-994d-4698-9b73-4946ab6459db\") " pod="openshift-dns/node-resolver-282gm" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955132 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d756089e-495a-4d2b-aed2-414349e8ca4e-host\") pod \"node-ca-ht8ws\" (UID: \"d756089e-495a-4d2b-aed2-414349e8ca4e\") " pod="openshift-image-registry/node-ca-ht8ws" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955151 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-system-cni-dir\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955156 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955172 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-conf-dir\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955195 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-kubernetes\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955222 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-etc-selinux\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.955557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955242 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcrn2\" (UniqueName: \"kubernetes.io/projected/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-kube-api-access-zcrn2\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955281 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-kubelet-config\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955351 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-kubelet-config\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955383 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-var-lib-kubelet\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955411 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-var-lib-openvswitch\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955438 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-device-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955462 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe904ee3-e962-4a60-a5ba-65d502d9d68d-cni-binary-copy\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955486 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-socket-dir-parent\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955497 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-device-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955509 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-run-netns\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955557 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-run-systemd\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955580 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-cni-netd\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955605 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4de79992-6c23-4f1d-a95b-5c0b3627cdff-ovn-node-metrics-cert\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955634 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de45abfe-1156-4ea1-8c4e-d09c9fb00720-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955660 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-sysctl-d\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955687 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-sys-fs\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955711 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:34.956478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955734 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-sysconfig\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955760 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-sysctl-conf\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955780 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/448d8b33-6d1d-47d2-96c9-33f04a59e28b-iptables-alerter-script\") pod \"iptables-alerter-sfcwg\" (UID: \"448d8b33-6d1d-47d2-96c9-33f04a59e28b\") " pod="openshift-network-operator/iptables-alerter-sfcwg" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955805 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-systemd\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955809 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-sys-fs\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955853 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-run-ovn\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:34.955877 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955887 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955915 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxrlb\" (UniqueName: \"kubernetes.io/projected/d756089e-495a-4d2b-aed2-414349e8ca4e-kube-api-access-cxrlb\") pod \"node-ca-ht8ws\" (UID: \"d756089e-495a-4d2b-aed2-414349e8ca4e\") " pod="openshift-image-registry/node-ca-ht8ws" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:34.955969 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs podName:7e939930-7b98-4f9a-95a8-3a9ec4c72e61 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:35.455932265 +0000 UTC m=+2.970968629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs") pod "network-metrics-daemon-q7vrb" (UID: "7e939930-7b98-4f9a-95a8-3a9ec4c72e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.955986 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-run\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:34.955989 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956005 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-lib-modules\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956028 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4de79992-6c23-4f1d-a95b-5c0b3627cdff-ovnkube-script-lib\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956049 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-socket-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956075 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd929\" (UniqueName: \"kubernetes.io/projected/448d8b33-6d1d-47d2-96c9-33f04a59e28b-kube-api-access-gd929\") pod \"iptables-alerter-sfcwg\" (UID: \"448d8b33-6d1d-47d2-96c9-33f04a59e28b\") " pod="openshift-network-operator/iptables-alerter-sfcwg" Sep 10 17:39:34.957228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956092 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de45abfe-1156-4ea1-8c4e-d09c9fb00720-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:34.956109 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret podName:cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:35.456091595 +0000 UTC m=+2.971127979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret") pod "global-pull-secret-syncer-jjrq9" (UID: "cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956132 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de45abfe-1156-4ea1-8c4e-d09c9fb00720-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-hostroot\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956175 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-run-openvswitch\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956190 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-var-lib-cni-bin\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956192 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-socket-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956205 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-sys\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956238 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7spb\" (UniqueName: \"kubernetes.io/projected/ec8eba52-69db-4066-8153-32bdd26a7a66-kube-api-access-f7spb\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de45abfe-1156-4ea1-8c4e-d09c9fb00720-cni-binary-copy\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956294 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76cd8\" (UniqueName: \"kubernetes.io/projected/4de79992-6c23-4f1d-a95b-5c0b3627cdff-kube-api-access-76cd8\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956297 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de45abfe-1156-4ea1-8c4e-d09c9fb00720-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956321 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-registration-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956348 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tswh\" (UniqueName: \"kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh\") pod \"network-check-target-xgb5w\" (UID: \"546e4ffc-92e6-41ac-b5bc-04b376d58073\") " pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956364 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de45abfe-1156-4ea1-8c4e-d09c9fb00720-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.958022 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956372 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4de79992-6c23-4f1d-a95b-5c0b3627cdff-env-overrides\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956400 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c281aa7f-4f94-415c-ad6f-fea23e1a877d-agent-certs\") pod \"konnectivity-agent-9kng8\" (UID: \"c281aa7f-4f94-415c-ad6f-fea23e1a877d\") " pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956412 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec8eba52-69db-4066-8153-32bdd26a7a66-registration-dir\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956424 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/651a4d52-994d-4698-9b73-4946ab6459db-hosts-file\") pod \"node-resolver-282gm\" (UID: \"651a4d52-994d-4698-9b73-4946ab6459db\") " pod="openshift-dns/node-resolver-282gm" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956449 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-cnibin\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956580 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ndxd\" (UniqueName: \"kubernetes.io/projected/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-kube-api-access-9ndxd\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956609 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-slash\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956635 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-node-log\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956664 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gzjn\" (UniqueName: \"kubernetes.io/projected/de45abfe-1156-4ea1-8c4e-d09c9fb00720-kube-api-access-8gzjn\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956691 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-daemon-config\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956688 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de45abfe-1156-4ea1-8c4e-d09c9fb00720-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956718 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956776 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4de79992-6c23-4f1d-a95b-5c0b3627cdff-ovnkube-config\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:34.958647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.956779 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de45abfe-1156-4ea1-8c4e-d09c9fb00720-cni-binary-copy\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.977213 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.977175 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 17:39:34.981780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.981753 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gzjn\" (UniqueName: \"kubernetes.io/projected/de45abfe-1156-4ea1-8c4e-d09c9fb00720-kube-api-access-8gzjn\") pod \"multus-additional-cni-plugins-5pnk7\" (UID: \"de45abfe-1156-4ea1-8c4e-d09c9fb00720\") " pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:34.985854 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:34.985823 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:34.985854 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:34.985853 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:34.986034 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:34.985869 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5tswh for pod openshift-network-diagnostics/network-check-target-xgb5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:34.986034 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:34.985935 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh podName:546e4ffc-92e6-41ac-b5bc-04b376d58073 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:35.485914729 +0000 UTC m=+3.000951111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5tswh" (UniqueName: "kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh") pod "network-check-target-xgb5w" (UID: "546e4ffc-92e6-41ac-b5bc-04b376d58073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:34.990363 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.990307 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd929\" (UniqueName: \"kubernetes.io/projected/448d8b33-6d1d-47d2-96c9-33f04a59e28b-kube-api-access-gd929\") pod \"iptables-alerter-sfcwg\" (UID: \"448d8b33-6d1d-47d2-96c9-33f04a59e28b\") " pod="openshift-network-operator/iptables-alerter-sfcwg" Sep 10 17:39:34.991125 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.991057 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcrn2\" (UniqueName: \"kubernetes.io/projected/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-kube-api-access-zcrn2\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:34.991978 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:34.991951 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7spb\" (UniqueName: \"kubernetes.io/projected/ec8eba52-69db-4066-8153-32bdd26a7a66-kube-api-access-f7spb\") pod \"aws-ebs-csi-driver-node-smtkj\" (UID: \"ec8eba52-69db-4066-8153-32bdd26a7a66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:35.057462 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057422 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-run-k8s-cni-cncf-io\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.057656 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057471 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-var-lib-cni-multus\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.057656 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057510 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-modprobe-d\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.057656 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057546 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tnfd\" (UniqueName: \"kubernetes.io/projected/651a4d52-994d-4698-9b73-4946ab6459db-kube-api-access-8tnfd\") pod \"node-resolver-282gm\" (UID: \"651a4d52-994d-4698-9b73-4946ab6459db\") " pod="openshift-dns/node-resolver-282gm" Sep 10 17:39:35.057656 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057572 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d756089e-495a-4d2b-aed2-414349e8ca4e-host\") pod \"node-ca-ht8ws\" (UID: \"d756089e-495a-4d2b-aed2-414349e8ca4e\") " pod="openshift-image-registry/node-ca-ht8ws" Sep 10 17:39:35.057656 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057579 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-var-lib-cni-multus\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.057656 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057544 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-run-k8s-cni-cncf-io\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057683 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-modprobe-d\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057694 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-system-cni-dir\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057727 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-conf-dir\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057748 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-system-cni-dir\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057756 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-kubernetes\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057732 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d756089e-495a-4d2b-aed2-414349e8ca4e-host\") pod \"node-ca-ht8ws\" (UID: \"d756089e-495a-4d2b-aed2-414349e8ca4e\") " pod="openshift-image-registry/node-ca-ht8ws" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057768 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-conf-dir\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057793 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-var-lib-kubelet\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057812 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-kubernetes\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057821 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-var-lib-openvswitch\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057848 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe904ee3-e962-4a60-a5ba-65d502d9d68d-cni-binary-copy\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057872 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-socket-dir-parent\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057886 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-var-lib-kubelet\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057891 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-var-lib-openvswitch\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057896 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-run-netns\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057944 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-socket-dir-parent\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057955 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-run-systemd\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.058034 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057977 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-run-netns\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.057982 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-cni-netd\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058010 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4de79992-6c23-4f1d-a95b-5c0b3627cdff-ovn-node-metrics-cert\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058020 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-run-systemd\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058038 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-sysctl-d\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058084 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-cni-netd\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058126 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-sysconfig\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058146 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-sysctl-conf\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058171 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-systemd\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058188 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-sysctl-d\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058192 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-sysconfig\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058196 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-run-ovn\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058234 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-run-ovn\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxrlb\" (UniqueName: \"kubernetes.io/projected/d756089e-495a-4d2b-aed2-414349e8ca4e-kube-api-access-cxrlb\") pod \"node-ca-ht8ws\" (UID: \"d756089e-495a-4d2b-aed2-414349e8ca4e\") " pod="openshift-image-registry/node-ca-ht8ws" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058271 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-systemd\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058305 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-run\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058315 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-sysctl-conf\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058355 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-lib-modules\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.058980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058374 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-run\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058385 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4de79992-6c23-4f1d-a95b-5c0b3627cdff-ovnkube-script-lib\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058423 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-hostroot\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058438 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe904ee3-e962-4a60-a5ba-65d502d9d68d-cni-binary-copy\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058450 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-run-openvswitch\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058475 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-var-lib-cni-bin\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058480 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-hostroot\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058498 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-sys\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058527 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76cd8\" (UniqueName: \"kubernetes.io/projected/4de79992-6c23-4f1d-a95b-5c0b3627cdff-kube-api-access-76cd8\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058566 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4de79992-6c23-4f1d-a95b-5c0b3627cdff-env-overrides\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058573 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-var-lib-cni-bin\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058589 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c281aa7f-4f94-415c-ad6f-fea23e1a877d-agent-certs\") pod \"konnectivity-agent-9kng8\" (UID: \"c281aa7f-4f94-415c-ad6f-fea23e1a877d\") " pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058595 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-lib-modules\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058630 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/651a4d52-994d-4698-9b73-4946ab6459db-hosts-file\") pod \"node-resolver-282gm\" (UID: \"651a4d52-994d-4698-9b73-4946ab6459db\") " pod="openshift-dns/node-resolver-282gm" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058635 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-sys\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058665 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-cnibin\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058631 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-run-openvswitch\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058694 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ndxd\" (UniqueName: \"kubernetes.io/projected/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-kube-api-access-9ndxd\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.059912 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058739 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-slash\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058766 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-node-log\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058794 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-daemon-config\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058822 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058855 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4de79992-6c23-4f1d-a95b-5c0b3627cdff-ovnkube-config\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058881 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-var-lib-kubelet\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058934 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-var-lib-kubelet\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058941 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/651a4d52-994d-4698-9b73-4946ab6459db-hosts-file\") pod \"node-resolver-282gm\" (UID: \"651a4d52-994d-4698-9b73-4946ab6459db\") " pod="openshift-dns/node-resolver-282gm" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.058984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-run-multus-certs\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059013 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-host\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-systemd-units\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059057 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4de79992-6c23-4f1d-a95b-5c0b3627cdff-env-overrides\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059065 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d756089e-495a-4d2b-aed2-414349e8ca4e-serviceca\") pod \"node-ca-ht8ws\" (UID: \"d756089e-495a-4d2b-aed2-414349e8ca4e\") " pod="openshift-image-registry/node-ca-ht8ws" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059101 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4de79992-6c23-4f1d-a95b-5c0b3627cdff-ovnkube-script-lib\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059114 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-kubelet\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059146 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-log-socket\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059174 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c281aa7f-4f94-415c-ad6f-fea23e1a877d-konnectivity-ca\") pod \"konnectivity-agent-9kng8\" (UID: \"c281aa7f-4f94-415c-ad6f-fea23e1a877d\") " pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059186 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-node-log\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.060860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059146 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-slash\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059202 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/651a4d52-994d-4698-9b73-4946ab6459db-tmp-dir\") pod \"node-resolver-282gm\" (UID: \"651a4d52-994d-4698-9b73-4946ab6459db\") " pod="openshift-dns/node-resolver-282gm" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059205 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-cnibin\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059236 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-kubelet\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059270 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-systemd-units\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059287 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-log-socket\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059205 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059310 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-host-run-multus-certs\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059338 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-cni-dir\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059364 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-tuned\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059389 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-tmp\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059414 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-run-netns\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059438 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-etc-openvswitch\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059468 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-etc-kubernetes\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059494 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd99z\" (UniqueName: \"kubernetes.io/projected/fe904ee3-e962-4a60-a5ba-65d502d9d68d-kube-api-access-hd99z\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059522 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-run-ovn-kubernetes\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059555 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-cni-bin\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059594 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-etc-openvswitch\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.061779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059554 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/651a4d52-994d-4698-9b73-4946ab6459db-tmp-dir\") pod \"node-resolver-282gm\" (UID: \"651a4d52-994d-4698-9b73-4946ab6459db\") " pod="openshift-dns/node-resolver-282gm" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059627 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d756089e-495a-4d2b-aed2-414349e8ca4e-serviceca\") pod \"node-ca-ht8ws\" (UID: \"d756089e-495a-4d2b-aed2-414349e8ca4e\") " pod="openshift-image-registry/node-ca-ht8ws" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059689 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-cni-dir\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059760 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4de79992-6c23-4f1d-a95b-5c0b3627cdff-ovnkube-config\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059866 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-run-ovn-kubernetes\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059920 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-cni-bin\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059962 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4de79992-6c23-4f1d-a95b-5c0b3627cdff-host-run-netns\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.060009 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-host\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.059629 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe904ee3-e962-4a60-a5ba-65d502d9d68d-etc-kubernetes\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.060271 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c281aa7f-4f94-415c-ad6f-fea23e1a877d-konnectivity-ca\") pod \"konnectivity-agent-9kng8\" (UID: \"c281aa7f-4f94-415c-ad6f-fea23e1a877d\") " pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.061084 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe904ee3-e962-4a60-a5ba-65d502d9d68d-multus-daemon-config\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.061564 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c281aa7f-4f94-415c-ad6f-fea23e1a877d-agent-certs\") pod \"konnectivity-agent-9kng8\" (UID: \"c281aa7f-4f94-415c-ad6f-fea23e1a877d\") " pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:39:35.062720 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.062559 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4de79992-6c23-4f1d-a95b-5c0b3627cdff-ovn-node-metrics-cert\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.063659 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.063587 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-etc-tuned\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.063910 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.063889 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-tmp\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.078548 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.078443 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-62.ec2.internal" event={"ID":"90b12f471b7c3e45831e3875b9139835","Type":"ContainerStarted","Data":"05e5037a630d4d18bbd581832509bafd72db39653bd1ff673c76c4e9d0f57aa2"} Sep 10 17:39:35.080902 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.080844 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" event={"ID":"4c07934797882c1f299c442a974c47d9","Type":"ContainerStarted","Data":"effc5e09a2fa93e2438e23e5c4de80256a46846e1764910e5ea50ecc375356c3"} Sep 10 17:39:35.082522 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.081992 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tnfd\" (UniqueName: \"kubernetes.io/projected/651a4d52-994d-4698-9b73-4946ab6459db-kube-api-access-8tnfd\") pod \"node-resolver-282gm\" (UID: \"651a4d52-994d-4698-9b73-4946ab6459db\") " pod="openshift-dns/node-resolver-282gm" Sep 10 17:39:35.087856 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.087810 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76cd8\" (UniqueName: \"kubernetes.io/projected/4de79992-6c23-4f1d-a95b-5c0b3627cdff-kube-api-access-76cd8\") pod \"ovnkube-node-4kn7g\" (UID: \"4de79992-6c23-4f1d-a95b-5c0b3627cdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.094158 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.093613 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxrlb\" (UniqueName: \"kubernetes.io/projected/d756089e-495a-4d2b-aed2-414349e8ca4e-kube-api-access-cxrlb\") pod \"node-ca-ht8ws\" (UID: \"d756089e-495a-4d2b-aed2-414349e8ca4e\") " pod="openshift-image-registry/node-ca-ht8ws" Sep 10 17:39:35.095543 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.095007 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ndxd\" (UniqueName: \"kubernetes.io/projected/79d2eb93-8dc1-4a1b-a8af-e14b088519fa-kube-api-access-9ndxd\") pod \"tuned-tnl5h\" (UID: \"79d2eb93-8dc1-4a1b-a8af-e14b088519fa\") " pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.095543 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.095424 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd99z\" (UniqueName: \"kubernetes.io/projected/fe904ee3-e962-4a60-a5ba-65d502d9d68d-kube-api-access-hd99z\") pod \"multus-jttf7\" (UID: \"fe904ee3-e962-4a60-a5ba-65d502d9d68d\") " pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.143902 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.143869 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5pnk7" Sep 10 17:39:35.152723 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.152699 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" Sep 10 17:39:35.156299 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:35.156151 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde45abfe_1156_4ea1_8c4e_d09c9fb00720.slice/crio-51a9b47907ef425bae73426657660e95e6ab0d0d00c1b15145dfa3bb56ef2b6f WatchSource:0}: Error finding container 51a9b47907ef425bae73426657660e95e6ab0d0d00c1b15145dfa3bb56ef2b6f: Status 404 returned error can't find the container with id 51a9b47907ef425bae73426657660e95e6ab0d0d00c1b15145dfa3bb56ef2b6f Sep 10 17:39:35.163859 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:35.163815 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8eba52_69db_4066_8153_32bdd26a7a66.slice/crio-92fb8856507b7bc0fe3ed7ac7b83e4eac3df7150a84be20c51942e37a69b7f57 WatchSource:0}: Error finding container 92fb8856507b7bc0fe3ed7ac7b83e4eac3df7150a84be20c51942e37a69b7f57: Status 404 returned error can't find the container with id 92fb8856507b7bc0fe3ed7ac7b83e4eac3df7150a84be20c51942e37a69b7f57 Sep 10 17:39:35.163953 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.163869 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sfcwg" Sep 10 17:39:35.171379 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.171181 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-282gm" Sep 10 17:39:35.177474 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:35.177394 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod448d8b33_6d1d_47d2_96c9_33f04a59e28b.slice/crio-193dd99d12a6e327fe2d6f4c61e4d5bbe90c635505974dc6e520e1f7f0a8c2e1 WatchSource:0}: Error finding container 193dd99d12a6e327fe2d6f4c61e4d5bbe90c635505974dc6e520e1f7f0a8c2e1: Status 404 returned error can't find the container with id 193dd99d12a6e327fe2d6f4c61e4d5bbe90c635505974dc6e520e1f7f0a8c2e1 Sep 10 17:39:35.177474 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.177411 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ht8ws" Sep 10 17:39:35.187835 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.187626 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jttf7" Sep 10 17:39:35.193251 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.193227 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" Sep 10 17:39:35.201706 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.201670 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:39:35.208645 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.208479 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:39:35.215795 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:35.215763 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe904ee3_e962_4a60_a5ba_65d502d9d68d.slice/crio-841cd5cc7bdec7f63a640f1734ded3bee2eca41f69a229d3e1e056486bf52b30 WatchSource:0}: Error finding container 841cd5cc7bdec7f63a640f1734ded3bee2eca41f69a229d3e1e056486bf52b30: Status 404 returned error can't find the container with id 841cd5cc7bdec7f63a640f1734ded3bee2eca41f69a229d3e1e056486bf52b30 Sep 10 17:39:35.220705 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:35.220673 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d2eb93_8dc1_4a1b_a8af_e14b088519fa.slice/crio-47d4960b23e089ff776b0c9525a3af783e3b1945a9b377ffccf045026d46d161 WatchSource:0}: Error finding container 47d4960b23e089ff776b0c9525a3af783e3b1945a9b377ffccf045026d46d161: Status 404 returned error can't find the container with id 47d4960b23e089ff776b0c9525a3af783e3b1945a9b377ffccf045026d46d161 Sep 10 17:39:35.223051 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:35.222999 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de79992_6c23_4f1d_a95b_5c0b3627cdff.slice/crio-10241ea421765098b007118b90856fc999bd9922ee246a73141e920caf83cbe0 WatchSource:0}: Error finding container 10241ea421765098b007118b90856fc999bd9922ee246a73141e920caf83cbe0: Status 404 returned error can't find the container with id 10241ea421765098b007118b90856fc999bd9922ee246a73141e920caf83cbe0 Sep 10 17:39:35.228402 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:39:35.228375 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc281aa7f_4f94_415c_ad6f_fea23e1a877d.slice/crio-2e34544c7b6f335b083bf1263e83ba65f9875199206fafb44a21983c2a4e8e22 WatchSource:0}: Error finding container 2e34544c7b6f335b083bf1263e83ba65f9875199206fafb44a21983c2a4e8e22: Status 404 returned error can't find the container with id 2e34544c7b6f335b083bf1263e83ba65f9875199206fafb44a21983c2a4e8e22 Sep 10 17:39:35.362351 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.362272 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:35.462499 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.462453 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:35.462663 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.462513 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:35.462663 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:35.462636 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:35.462800 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:35.462663 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:35.462800 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:35.462718 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs podName:7e939930-7b98-4f9a-95a8-3a9ec4c72e61 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:36.462701573 +0000 UTC m=+3.977737949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs") pod "network-metrics-daemon-q7vrb" (UID: "7e939930-7b98-4f9a-95a8-3a9ec4c72e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:35.462800 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:35.462739 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret podName:cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:36.462729149 +0000 UTC m=+3.977765513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret") pod "global-pull-secret-syncer-jjrq9" (UID: "cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:35.563607 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.563569 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tswh\" (UniqueName: \"kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh\") pod \"network-check-target-xgb5w\" (UID: \"546e4ffc-92e6-41ac-b5bc-04b376d58073\") " pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:35.563773 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:35.563713 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:35.563773 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:35.563732 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:35.563773 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:35.563748 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5tswh for pod openshift-network-diagnostics/network-check-target-xgb5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:35.563925 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:35.563810 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh podName:546e4ffc-92e6-41ac-b5bc-04b376d58073 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:36.563793131 +0000 UTC m=+4.078829501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5tswh" (UniqueName: "kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh") pod "network-check-target-xgb5w" (UID: "546e4ffc-92e6-41ac-b5bc-04b376d58073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:35.914643 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.914587 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:34:35 +0000 UTC" deadline="2028-04-20 14:57:04.167603435 +0000 UTC" Sep 10 17:39:35.914643 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:35.914636 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14109h17m28.252969859s" Sep 10 17:39:36.071918 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.071873 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:36.072372 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:36.072110 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:36.072372 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.072193 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:36.072372 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:36.072324 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:36.085277 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.085205 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9kng8" event={"ID":"c281aa7f-4f94-415c-ad6f-fea23e1a877d","Type":"ContainerStarted","Data":"2e34544c7b6f335b083bf1263e83ba65f9875199206fafb44a21983c2a4e8e22"} Sep 10 17:39:36.088910 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.088873 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" event={"ID":"4de79992-6c23-4f1d-a95b-5c0b3627cdff","Type":"ContainerStarted","Data":"10241ea421765098b007118b90856fc999bd9922ee246a73141e920caf83cbe0"} Sep 10 17:39:36.090553 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.090462 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jttf7" event={"ID":"fe904ee3-e962-4a60-a5ba-65d502d9d68d","Type":"ContainerStarted","Data":"841cd5cc7bdec7f63a640f1734ded3bee2eca41f69a229d3e1e056486bf52b30"} Sep 10 17:39:36.092721 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.092694 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" event={"ID":"79d2eb93-8dc1-4a1b-a8af-e14b088519fa","Type":"ContainerStarted","Data":"47d4960b23e089ff776b0c9525a3af783e3b1945a9b377ffccf045026d46d161"} Sep 10 17:39:36.094448 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.094395 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ht8ws" event={"ID":"d756089e-495a-4d2b-aed2-414349e8ca4e","Type":"ContainerStarted","Data":"f8c72bca4fc7426e2513d430826febf4bd27fc2f932a02eed7a067a47f67c250"} Sep 10 17:39:36.096645 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.096579 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" event={"ID":"ec8eba52-69db-4066-8153-32bdd26a7a66","Type":"ContainerStarted","Data":"92fb8856507b7bc0fe3ed7ac7b83e4eac3df7150a84be20c51942e37a69b7f57"} Sep 10 17:39:36.099568 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.099541 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-282gm" event={"ID":"651a4d52-994d-4698-9b73-4946ab6459db","Type":"ContainerStarted","Data":"789961b8dc648d0dcbefa2ed069c06a25195617468d733d6e54e35ce888514ff"} Sep 10 17:39:36.102735 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.102708 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sfcwg" event={"ID":"448d8b33-6d1d-47d2-96c9-33f04a59e28b","Type":"ContainerStarted","Data":"193dd99d12a6e327fe2d6f4c61e4d5bbe90c635505974dc6e520e1f7f0a8c2e1"} Sep 10 17:39:36.104507 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.104471 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pnk7" event={"ID":"de45abfe-1156-4ea1-8c4e-d09c9fb00720","Type":"ContainerStarted","Data":"51a9b47907ef425bae73426657660e95e6ab0d0d00c1b15145dfa3bb56ef2b6f"} Sep 10 17:39:36.471088 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.471039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:36.471286 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.471164 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:36.471351 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:36.471300 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:36.471518 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:36.471366 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs podName:7e939930-7b98-4f9a-95a8-3a9ec4c72e61 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:38.471345678 +0000 UTC m=+5.986382050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs") pod "network-metrics-daemon-q7vrb" (UID: "7e939930-7b98-4f9a-95a8-3a9ec4c72e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:36.472021 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:36.471771 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:36.472021 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:36.471823 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret podName:cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:38.471807896 +0000 UTC m=+5.986844267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret") pod "global-pull-secret-syncer-jjrq9" (UID: "cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:36.572471 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.572431 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tswh\" (UniqueName: \"kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh\") pod \"network-check-target-xgb5w\" (UID: \"546e4ffc-92e6-41ac-b5bc-04b376d58073\") " pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:36.572642 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:36.572612 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:36.572642 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:36.572637 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:36.572775 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:36.572651 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5tswh for pod openshift-network-diagnostics/network-check-target-xgb5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:36.572775 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:36.572708 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh podName:546e4ffc-92e6-41ac-b5bc-04b376d58073 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:38.572689549 +0000 UTC m=+6.087725921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5tswh" (UniqueName: "kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh") pod "network-check-target-xgb5w" (UID: "546e4ffc-92e6-41ac-b5bc-04b376d58073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:36.662570 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.662522 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:39:36.915688 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.915592 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:34:35 +0000 UTC" deadline="2028-06-23 19:32:02.702951404 +0000 UTC" Sep 10 17:39:36.915688 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:36.915637 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15649h52m25.787319303s" Sep 10 17:39:37.073195 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:37.072580 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:37.073195 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:37.072725 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:38.073045 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:38.072214 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:38.073045 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:38.072366 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:38.073045 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:38.072820 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:38.073045 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:38.072915 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:38.133257 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:38.130252 2570 generic.go:356] "Generic (PLEG): container finished" podID="4c07934797882c1f299c442a974c47d9" containerID="9ad53b9d2a656a61aa5cfba3a33c03fdc69f8c8ec30234d199347cd43ce4a8f1" exitCode=0 Sep 10 17:39:38.133257 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:38.130352 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" event={"ID":"4c07934797882c1f299c442a974c47d9","Type":"ContainerDied","Data":"9ad53b9d2a656a61aa5cfba3a33c03fdc69f8c8ec30234d199347cd43ce4a8f1"} Sep 10 17:39:38.139535 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:38.138026 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-62.ec2.internal" event={"ID":"90b12f471b7c3e45831e3875b9139835","Type":"ContainerStarted","Data":"678e6758538ceb372a930f0cd29182224d9aca83ea76351703263d313714087b"} Sep 10 17:39:38.486789 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:38.486698 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:38.486789 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:38.486757 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:38.487039 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:38.486915 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:38.487039 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:38.486991 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret podName:cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:42.486973129 +0000 UTC m=+10.002009502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret") pod "global-pull-secret-syncer-jjrq9" (UID: "cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:38.487187 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:38.487067 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:38.487535 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:38.487514 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs podName:7e939930-7b98-4f9a-95a8-3a9ec4c72e61 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:42.487493121 +0000 UTC m=+10.002529490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs") pod "network-metrics-daemon-q7vrb" (UID: "7e939930-7b98-4f9a-95a8-3a9ec4c72e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:38.587797 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:38.587757 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tswh\" (UniqueName: \"kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh\") pod \"network-check-target-xgb5w\" (UID: \"546e4ffc-92e6-41ac-b5bc-04b376d58073\") " pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:38.588029 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:38.587953 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:38.588029 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:38.587980 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:38.588029 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:38.587995 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5tswh for pod openshift-network-diagnostics/network-check-target-xgb5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:38.588254 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:38.588075 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh podName:546e4ffc-92e6-41ac-b5bc-04b376d58073 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:42.58803746 +0000 UTC m=+10.103073832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5tswh" (UniqueName: "kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh") pod "network-check-target-xgb5w" (UID: "546e4ffc-92e6-41ac-b5bc-04b376d58073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:39.073148 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:39.071542 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:39.073148 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:39.071684 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:40.072443 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:40.071753 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:40.072443 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:40.071805 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:40.072443 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:40.071948 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:40.072443 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:40.072097 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:41.072258 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:41.072224 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:41.072725 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:41.072352 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:42.072731 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:42.072557 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:42.072731 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:42.072619 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:42.072731 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:42.072709 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:42.073288 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:42.072837 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:42.520103 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:42.520002 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:42.520103 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:42.520072 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:42.520305 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:42.520165 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:42.520305 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:42.520208 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:42.520305 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:42.520243 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs podName:7e939930-7b98-4f9a-95a8-3a9ec4c72e61 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:50.520221418 +0000 UTC m=+18.035257785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs") pod "network-metrics-daemon-q7vrb" (UID: "7e939930-7b98-4f9a-95a8-3a9ec4c72e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:42.520305 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:42.520266 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret podName:cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:50.520256279 +0000 UTC m=+18.035292644 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret") pod "global-pull-secret-syncer-jjrq9" (UID: "cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:42.621129 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:42.621089 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tswh\" (UniqueName: \"kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh\") pod \"network-check-target-xgb5w\" (UID: \"546e4ffc-92e6-41ac-b5bc-04b376d58073\") " pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:42.621346 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:42.621324 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:42.621413 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:42.621354 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:42.621413 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:42.621369 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5tswh for pod openshift-network-diagnostics/network-check-target-xgb5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:42.621535 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:42.621438 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh podName:546e4ffc-92e6-41ac-b5bc-04b376d58073 nodeName:}" failed. No retries permitted until 2026-09-10 17:39:50.621419736 +0000 UTC m=+18.136456103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5tswh" (UniqueName: "kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh") pod "network-check-target-xgb5w" (UID: "546e4ffc-92e6-41ac-b5bc-04b376d58073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:43.076358 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:43.076286 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:43.076829 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:43.076424 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:44.071817 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:44.071777 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:44.071995 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:44.071820 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:44.071995 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:44.071922 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:44.072138 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:44.072083 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:45.072653 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:45.072616 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:45.073046 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:45.072727 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:46.073081 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:46.073029 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:46.073557 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:46.073181 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:46.073557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:46.073223 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:46.073557 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:46.073341 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:47.071997 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:47.071921 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:47.072164 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:47.072051 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:48.071915 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:48.071881 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:48.072388 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:48.071881 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:48.072388 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:48.071995 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:48.072388 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:48.072119 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:49.071898 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:49.071862 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:49.072109 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:49.072018 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:50.072149 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:50.072120 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:50.072575 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:50.072121 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:50.072575 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:50.072234 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:50.072575 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:50.072338 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:50.585398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:50.585358 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:50.585398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:50.585401 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:50.585672 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:50.585523 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:50.585672 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:50.585534 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:50.585672 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:50.585582 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret podName:cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:06.585564127 +0000 UTC m=+34.100600491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret") pod "global-pull-secret-syncer-jjrq9" (UID: "cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:39:50.585672 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:50.585601 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs podName:7e939930-7b98-4f9a-95a8-3a9ec4c72e61 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:06.585592121 +0000 UTC m=+34.100628486 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs") pod "network-metrics-daemon-q7vrb" (UID: "7e939930-7b98-4f9a-95a8-3a9ec4c72e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:39:50.685766 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:50.685685 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tswh\" (UniqueName: \"kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh\") pod \"network-check-target-xgb5w\" (UID: \"546e4ffc-92e6-41ac-b5bc-04b376d58073\") " pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:50.685934 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:50.685841 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:39:50.685934 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:50.685865 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:39:50.685934 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:50.685877 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5tswh for pod openshift-network-diagnostics/network-check-target-xgb5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:50.686103 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:50.685938 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh podName:546e4ffc-92e6-41ac-b5bc-04b376d58073 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:06.685920456 +0000 UTC m=+34.200956825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5tswh" (UniqueName: "kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh") pod "network-check-target-xgb5w" (UID: "546e4ffc-92e6-41ac-b5bc-04b376d58073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:39:51.072121 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:51.071942 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:51.072286 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:51.072157 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:52.072109 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:52.072077 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:52.072287 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:52.072076 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:52.072287 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:52.072220 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:52.072287 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:52.072273 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:53.073147 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:53.073118 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:53.073547 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:53.073218 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:54.071908 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:54.071875 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:54.072069 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:54.071973 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:54.072069 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:54.072057 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:54.072161 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:54.072143 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:55.072380 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.072025 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:55.072979 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:55.072412 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:55.178449 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.178417 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9kng8" event={"ID":"c281aa7f-4f94-415c-ad6f-fea23e1a877d","Type":"ContainerStarted","Data":"52ac298a1a78112e50b5b1e10a4e9476f9bb4cc33be5b45e7e7adfd67adb60f1"} Sep 10 17:39:55.181334 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.181316 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4kn7g_4de79992-6c23-4f1d-a95b-5c0b3627cdff/ovn-acl-logging/0.log" Sep 10 17:39:55.181646 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.181626 2570 generic.go:356] "Generic (PLEG): container finished" podID="4de79992-6c23-4f1d-a95b-5c0b3627cdff" containerID="29105717011e0b11c419367560f9e5e24886993ad523f109e42f29492347d7b7" exitCode=1 Sep 10 17:39:55.181724 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.181703 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" event={"ID":"4de79992-6c23-4f1d-a95b-5c0b3627cdff","Type":"ContainerStarted","Data":"ce92cd738cd5a710180e6c207b13b6968888feafced75a7591950496297768b8"} Sep 10 17:39:55.181794 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.181782 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" event={"ID":"4de79992-6c23-4f1d-a95b-5c0b3627cdff","Type":"ContainerStarted","Data":"d39c6db1f19421ebf45f1eee636112c94bfb338e80762375d340d781e8c48e70"} Sep 10 17:39:55.181854 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.181839 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" event={"ID":"4de79992-6c23-4f1d-a95b-5c0b3627cdff","Type":"ContainerStarted","Data":"104691962ce4dfa18f6344fb6dbeab4494078003cffc5d59ca18fab2c364640a"} Sep 10 17:39:55.181911 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.181886 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" event={"ID":"4de79992-6c23-4f1d-a95b-5c0b3627cdff","Type":"ContainerStarted","Data":"831cb59af69a7d392ebef05ae9fc897f4e5ff905dcfca6bdf1aa4a314a2d44cd"} Sep 10 17:39:55.181966 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.181935 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" event={"ID":"4de79992-6c23-4f1d-a95b-5c0b3627cdff","Type":"ContainerDied","Data":"29105717011e0b11c419367560f9e5e24886993ad523f109e42f29492347d7b7"} Sep 10 17:39:55.182016 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.181986 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" event={"ID":"4de79992-6c23-4f1d-a95b-5c0b3627cdff","Type":"ContainerStarted","Data":"d02885030e6b6a220af4b357cb998ddc95ee7529f6c1865c54631c1c7f2816e2"} Sep 10 17:39:55.183175 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.183156 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jttf7" event={"ID":"fe904ee3-e962-4a60-a5ba-65d502d9d68d","Type":"ContainerStarted","Data":"235e4cedcc624fa01eb2935f42d80e8f0eeae3ca854e1399501f33029e94e24d"} Sep 10 17:39:55.184620 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.184598 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" event={"ID":"79d2eb93-8dc1-4a1b-a8af-e14b088519fa","Type":"ContainerStarted","Data":"f1647aa908bcd440d14dd4a5c28b9ec3f1d58c9fd1f05a28b943000db237d357"} Sep 10 17:39:55.185939 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.185916 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ht8ws" event={"ID":"d756089e-495a-4d2b-aed2-414349e8ca4e","Type":"ContainerStarted","Data":"2cf7c9818eb4860a15d3b9ee7d8eeae36e8f5963b162c117b36bf1ef1a237479"} Sep 10 17:39:55.187307 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.187288 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" event={"ID":"ec8eba52-69db-4066-8153-32bdd26a7a66","Type":"ContainerStarted","Data":"dde3155493568b29e940f9218cc69e7e374babfa33c93f410aed28c75f50f5dd"} Sep 10 17:39:55.189138 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.189116 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" event={"ID":"4c07934797882c1f299c442a974c47d9","Type":"ContainerStarted","Data":"4d25c6a2fe65b435224c84e2961da9fd64211a1a074f7b87ef0baa9d7d8f2802"} Sep 10 17:39:55.190443 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.190402 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-282gm" event={"ID":"651a4d52-994d-4698-9b73-4946ab6459db","Type":"ContainerStarted","Data":"813ab9110ce258410a37cff107f899b92839f3e6e16a85cf6fdc8f5755ac7d43"} Sep 10 17:39:55.191802 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.191783 2570 generic.go:356] "Generic (PLEG): container finished" podID="de45abfe-1156-4ea1-8c4e-d09c9fb00720" containerID="f80c1d66476715fc85fbc32c24aac2f8c9d09d27d4079edddd3a6f3645f155cb" exitCode=0 Sep 10 17:39:55.191885 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.191809 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pnk7" event={"ID":"de45abfe-1156-4ea1-8c4e-d09c9fb00720","Type":"ContainerDied","Data":"f80c1d66476715fc85fbc32c24aac2f8c9d09d27d4079edddd3a6f3645f155cb"} Sep 10 17:39:55.197534 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.197487 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-62.ec2.internal" podStartSLOduration=20.197475632 podStartE2EDuration="20.197475632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:38.183708943 +0000 UTC m=+5.698745335" watchObservedRunningTime="2026-09-10 17:39:55.197475632 +0000 UTC m=+22.712512017" Sep 10 17:39:55.197849 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.197826 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9kng8" podStartSLOduration=2.276922483 podStartE2EDuration="21.197820288s" totalImagesPullingTime="18.920897805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:55.197791896 +0000 UTC m=+22.712828279" watchObservedRunningTime="2026-09-10 17:39:55.197820288 +0000 UTC m=+22.712856673" Sep 10 17:39:55.219350 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.219310 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-62.ec2.internal" podStartSLOduration=20.219298329 podStartE2EDuration="20.219298329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:55.218933577 +0000 UTC m=+22.733969960" watchObservedRunningTime="2026-09-10 17:39:55.219298329 +0000 UTC m=+22.734334712" Sep 10 17:39:55.238768 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.238727 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-282gm" podStartSLOduration=2.278457757 podStartE2EDuration="21.238712837s" totalImagesPullingTime="18.96025508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:55.238630248 +0000 UTC m=+22.753666631" watchObservedRunningTime="2026-09-10 17:39:55.238712837 +0000 UTC m=+22.753749221" Sep 10 17:39:55.275192 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.275140 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ht8ws" podStartSLOduration=2.331665305 podStartE2EDuration="21.275112117s" totalImagesPullingTime="18.943446812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:55.256066276 +0000 UTC m=+22.771102688" watchObservedRunningTime="2026-09-10 17:39:55.275112117 +0000 UTC m=+22.790148502" Sep 10 17:39:55.275334 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.275265 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jttf7" podStartSLOduration=1.831529338 podStartE2EDuration="21.275259853s" totalImagesPullingTime="19.443730515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:55.274626939 +0000 UTC m=+22.789663323" watchObservedRunningTime="2026-09-10 17:39:55.275259853 +0000 UTC m=+22.790296236" Sep 10 17:39:55.300922 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.300865 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tnl5h" podStartSLOduration=2.371039028 podStartE2EDuration="21.300850431s" totalImagesPullingTime="18.929811403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:55.300545544 +0000 UTC m=+22.815581928" watchObservedRunningTime="2026-09-10 17:39:55.300850431 +0000 UTC m=+22.815886824" Sep 10 17:39:55.793902 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:55.793873 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 17:39:56.054811 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:56.054665 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T17:39:55.793895267Z","UUID":"5cbc1b9b-2c19-4195-b5f7-dc364b340839","Handler":null,"Name":"","Endpoint":""} Sep 10 17:39:56.056807 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:56.056781 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 17:39:56.056936 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:56.056821 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 17:39:56.072493 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:56.072466 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:56.072914 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:56.072467 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:56.072914 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:56.072566 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:56.072914 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:56.072632 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:56.196269 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:56.196231 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" event={"ID":"ec8eba52-69db-4066-8153-32bdd26a7a66","Type":"ContainerStarted","Data":"490f8f88b425dfaf0d5e0eab867b91376c310d4e79d5959fb58a40f7586420a9"} Sep 10 17:39:56.197599 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:56.197571 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sfcwg" event={"ID":"448d8b33-6d1d-47d2-96c9-33f04a59e28b","Type":"ContainerStarted","Data":"6c731aa56e9113847ab049c7b10d68921bbadfcbccc3b28b47963b14359146ab"} Sep 10 17:39:56.231929 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:56.231886 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sfcwg" podStartSLOduration=3.260884858 podStartE2EDuration="22.231870828s" totalImagesPullingTime="18.97098597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:56.230840149 +0000 UTC m=+23.745876532" watchObservedRunningTime="2026-09-10 17:39:56.231870828 +0000 UTC m=+23.746907212" Sep 10 17:39:57.072320 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:57.072290 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:57.072468 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:57.072392 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:57.202239 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:57.202167 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4kn7g_4de79992-6c23-4f1d-a95b-5c0b3627cdff/ovn-acl-logging/0.log" Sep 10 17:39:57.202589 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:57.202543 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" event={"ID":"4de79992-6c23-4f1d-a95b-5c0b3627cdff","Type":"ContainerStarted","Data":"cd066f2b644c2ba3efa81bcaa2d99c5acc15ed9b6a8f03a72390b189e62f35c8"} Sep 10 17:39:57.204459 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:57.204431 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" event={"ID":"ec8eba52-69db-4066-8153-32bdd26a7a66","Type":"ContainerStarted","Data":"429ca28b4e94ac154a63041ef9515b1b4705d2bed7c028ee766c743a50d22160"} Sep 10 17:39:58.072427 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:58.072397 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:39:58.072602 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:58.072398 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:39:58.072602 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:58.072495 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:39:58.072602 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:58.072573 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:39:58.429659 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:58.429430 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:39:58.430187 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:58.430169 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:39:58.450397 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:58.450334 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-smtkj" podStartSLOduration=6.793764174 podStartE2EDuration="24.450310134s" totalImagesPullingTime="17.65654596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:39:57.230178462 +0000 UTC m=+24.745214845" watchObservedRunningTime="2026-09-10 17:39:58.450310134 +0000 UTC m=+25.965346497" Sep 10 17:39:59.071979 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:59.071948 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:39:59.072161 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:39:59.072076 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:39:59.214404 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:59.213715 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4kn7g_4de79992-6c23-4f1d-a95b-5c0b3627cdff/ovn-acl-logging/0.log" Sep 10 17:39:59.214404 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:59.214304 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" event={"ID":"4de79992-6c23-4f1d-a95b-5c0b3627cdff","Type":"ContainerStarted","Data":"881d32c997fcc8b17c9372e3f1e605ccbe602e286e285e9a9c1e2c81174874cc"} Sep 10 17:39:59.214507 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:59.214466 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:39:59.214704 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:59.214684 2570 scope.go:117] "RemoveContainer" containerID="29105717011e0b11c419367560f9e5e24886993ad523f109e42f29492347d7b7" Sep 10 17:39:59.215200 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:39:59.215169 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9kng8" Sep 10 17:40:00.072652 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:00.072614 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:40:00.073527 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:00.072659 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:40:00.073527 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:00.072752 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:40:00.073527 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:00.072885 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:40:00.221318 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:00.221287 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4kn7g_4de79992-6c23-4f1d-a95b-5c0b3627cdff/ovn-acl-logging/0.log" Sep 10 17:40:00.221804 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:00.221768 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" event={"ID":"4de79992-6c23-4f1d-a95b-5c0b3627cdff","Type":"ContainerStarted","Data":"3ac96bc39cc1e3db420cd31e89b96c4412f4f7d1af2c6248111e327ce42ad8ae"} Sep 10 17:40:00.222029 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:00.221946 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:40:00.222375 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:00.222250 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:40:00.222375 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:00.222318 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:40:00.239348 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:00.239180 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:40:00.239583 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:00.239566 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:40:00.254284 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:00.254235 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" podStartSLOduration=7.288651932 podStartE2EDuration="26.254217987s" totalImagesPullingTime="18.965566055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:40:00.253504463 +0000 UTC m=+27.768540847" watchObservedRunningTime="2026-09-10 17:40:00.254217987 +0000 UTC m=+27.769254373" Sep 10 17:40:01.072166 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:01.072126 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:40:01.072351 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:01.072273 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:40:01.378878 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:01.378803 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jjrq9"] Sep 10 17:40:01.379331 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:01.378903 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:40:01.379331 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:01.379003 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:40:01.379591 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:01.379572 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xgb5w"] Sep 10 17:40:01.379658 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:01.379649 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:40:01.379734 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:01.379718 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:40:01.397120 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:01.394990 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q7vrb"] Sep 10 17:40:01.397120 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:01.395178 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:40:01.397120 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:01.395333 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:40:02.228847 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:02.228812 2570 generic.go:356] "Generic (PLEG): container finished" podID="de45abfe-1156-4ea1-8c4e-d09c9fb00720" containerID="664f929c8e98c1e7c2a072f3ef4022dcadd534ea29993dae3ed68299e5d0bf65" exitCode=0 Sep 10 17:40:02.229009 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:02.228897 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pnk7" event={"ID":"de45abfe-1156-4ea1-8c4e-d09c9fb00720","Type":"ContainerDied","Data":"664f929c8e98c1e7c2a072f3ef4022dcadd534ea29993dae3ed68299e5d0bf65"} Sep 10 17:40:03.072774 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:03.072744 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:40:03.073330 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:03.072824 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:40:03.073330 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:03.072882 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:40:03.073330 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:03.072910 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:40:03.073330 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:03.073002 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:40:03.073330 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:03.073158 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:40:04.236236 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:04.235989 2570 generic.go:356] "Generic (PLEG): container finished" podID="de45abfe-1156-4ea1-8c4e-d09c9fb00720" containerID="5d3b2113dd29264ec5aa3a0ec7b27d1d30bc6fe6924f5add9cfb3a87b8955c3c" exitCode=0 Sep 10 17:40:04.236236 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:04.236073 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pnk7" event={"ID":"de45abfe-1156-4ea1-8c4e-d09c9fb00720","Type":"ContainerDied","Data":"5d3b2113dd29264ec5aa3a0ec7b27d1d30bc6fe6924f5add9cfb3a87b8955c3c"} Sep 10 17:40:05.072522 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:05.072485 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:40:05.072686 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:05.072485 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:40:05.072686 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:05.072603 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:40:05.072686 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:05.072487 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:40:05.072814 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:05.072664 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:40:05.072814 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:05.072762 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:40:06.242854 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:06.242760 2570 generic.go:356] "Generic (PLEG): container finished" podID="de45abfe-1156-4ea1-8c4e-d09c9fb00720" containerID="c1cd82a862243b615dc884dd9b1cd2ef7f5dab18bd10661fd7b9520ecbc529e6" exitCode=0 Sep 10 17:40:06.242854 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:06.242823 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pnk7" event={"ID":"de45abfe-1156-4ea1-8c4e-d09c9fb00720","Type":"ContainerDied","Data":"c1cd82a862243b615dc884dd9b1cd2ef7f5dab18bd10661fd7b9520ecbc529e6"} Sep 10 17:40:06.601781 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:06.601742 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:40:06.601973 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:06.601790 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:40:06.601973 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:06.601891 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:40:06.601973 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:06.601898 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:40:06.601973 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:06.601956 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret podName:cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:38.601938496 +0000 UTC m=+66.116974862 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret") pod "global-pull-secret-syncer-jjrq9" (UID: "cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:40:06.601973 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:06.601971 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs podName:7e939930-7b98-4f9a-95a8-3a9ec4c72e61 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:38.601965451 +0000 UTC m=+66.117001813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs") pod "network-metrics-daemon-q7vrb" (UID: "7e939930-7b98-4f9a-95a8-3a9ec4c72e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:40:06.702947 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:06.702909 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tswh\" (UniqueName: \"kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh\") pod \"network-check-target-xgb5w\" (UID: \"546e4ffc-92e6-41ac-b5bc-04b376d58073\") " pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:40:06.703150 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:06.703125 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:40:06.703224 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:06.703154 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:40:06.703224 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:06.703169 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5tswh for pod openshift-network-diagnostics/network-check-target-xgb5w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:40:06.703328 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:06.703234 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh podName:546e4ffc-92e6-41ac-b5bc-04b376d58073 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:38.703214917 +0000 UTC m=+66.218251284 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5tswh" (UniqueName: "kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh") pod "network-check-target-xgb5w" (UID: "546e4ffc-92e6-41ac-b5bc-04b376d58073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:40:07.072541 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.072506 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:40:07.072690 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.072506 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:40:07.072690 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:07.072625 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xgb5w" podUID="546e4ffc-92e6-41ac-b5bc-04b376d58073" Sep 10 17:40:07.072805 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.072506 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:40:07.072805 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:07.072731 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7vrb" podUID="7e939930-7b98-4f9a-95a8-3a9ec4c72e61" Sep 10 17:40:07.072805 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:07.072791 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrq9" podUID="cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039" Sep 10 17:40:07.240648 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.240611 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-62.ec2.internal" event="NodeReady" Sep 10 17:40:07.240814 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.240767 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 17:40:07.279644 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.279605 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-595f6ddc88-44sqm"] Sep 10 17:40:07.283884 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.283859 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.286545 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.286352 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 17:40:07.286545 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.286493 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 17:40:07.286545 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.286518 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 17:40:07.286845 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.286829 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g6c28\"" Sep 10 17:40:07.292906 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.292884 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 17:40:07.296000 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.295982 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bzbb4"] Sep 10 17:40:07.299737 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.299720 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-595f6ddc88-44sqm"] Sep 10 17:40:07.299835 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.299803 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bzbb4" Sep 10 17:40:07.300333 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.300312 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2lk44"] Sep 10 17:40:07.302206 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.302183 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7xd5n\"" Sep 10 17:40:07.303068 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.303049 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 17:40:07.303423 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.303331 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 17:40:07.303640 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.303623 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 17:40:07.304155 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.304137 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.307054 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.307011 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bzbb4"] Sep 10 17:40:07.307147 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.307074 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dwwmp\"" Sep 10 17:40:07.307147 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.307143 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 17:40:07.307261 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.307155 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 17:40:07.314425 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.314401 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2lk44"] Sep 10 17:40:07.407947 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.407912 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.407947 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.407950 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9fps\" (UniqueName: \"kubernetes.io/projected/6bcbcb13-44db-4895-9524-6822c3d50baa-kube-api-access-p9fps\") pod \"ingress-canary-bzbb4\" (UID: \"6bcbcb13-44db-4895-9524-6822c3d50baa\") " pod="openshift-ingress-canary/ingress-canary-bzbb4" Sep 10 17:40:07.408192 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408018 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a705cfa-eda8-4a74-aaf7-13d841013cd1-tmp-dir\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.408192 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-trusted-ca\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.408192 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408169 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1248d46-c973-472f-9f75-3da770fae4db-ca-trust-extracted\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.408344 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408200 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.408344 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408272 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-image-registry-private-configuration\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.408344 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408309 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f2nx\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-kube-api-access-6f2nx\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.408495 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408363 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a705cfa-eda8-4a74-aaf7-13d841013cd1-config-volume\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.408495 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408388 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdhfl\" (UniqueName: \"kubernetes.io/projected/7a705cfa-eda8-4a74-aaf7-13d841013cd1-kube-api-access-wdhfl\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.408495 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408419 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-installation-pull-secrets\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.408495 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408451 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-registry-certificates\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.408656 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408493 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-bound-sa-token\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.408656 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.408520 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bcbcb13-44db-4895-9524-6822c3d50baa-cert\") pod \"ingress-canary-bzbb4\" (UID: \"6bcbcb13-44db-4895-9524-6822c3d50baa\") " pod="openshift-ingress-canary/ingress-canary-bzbb4" Sep 10 17:40:07.455468 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.455431 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:07.509691 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509654 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-image-registry-private-configuration\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.509872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509708 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f2nx\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-kube-api-access-6f2nx\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.509872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509743 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a705cfa-eda8-4a74-aaf7-13d841013cd1-config-volume\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.509872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509769 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdhfl\" (UniqueName: \"kubernetes.io/projected/7a705cfa-eda8-4a74-aaf7-13d841013cd1-kube-api-access-wdhfl\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.509872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509797 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-installation-pull-secrets\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.509872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509823 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-registry-certificates\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.509872 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509862 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-bound-sa-token\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.510167 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509886 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bcbcb13-44db-4895-9524-6822c3d50baa-cert\") pod \"ingress-canary-bzbb4\" (UID: \"6bcbcb13-44db-4895-9524-6822c3d50baa\") " pod="openshift-ingress-canary/ingress-canary-bzbb4" Sep 10 17:40:07.510167 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509916 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.510167 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509940 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fps\" (UniqueName: \"kubernetes.io/projected/6bcbcb13-44db-4895-9524-6822c3d50baa-kube-api-access-p9fps\") pod \"ingress-canary-bzbb4\" (UID: \"6bcbcb13-44db-4895-9524-6822c3d50baa\") " pod="openshift-ingress-canary/ingress-canary-bzbb4" Sep 10 17:40:07.510167 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509965 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a705cfa-eda8-4a74-aaf7-13d841013cd1-tmp-dir\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.510167 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.509988 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-trusted-ca\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.510167 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.510062 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1248d46-c973-472f-9f75-3da770fae4db-ca-trust-extracted\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.510167 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.510094 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.510167 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:07.510167 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:40:07.510525 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:07.510182 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595f6ddc88-44sqm: secret "image-registry-tls" not found Sep 10 17:40:07.510525 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:07.510185 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:07.510525 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:07.510237 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls podName:e1248d46-c973-472f-9f75-3da770fae4db nodeName:}" failed. No retries permitted until 2026-09-10 17:40:08.010218138 +0000 UTC m=+35.525254504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls") pod "image-registry-595f6ddc88-44sqm" (UID: "e1248d46-c973-472f-9f75-3da770fae4db") : secret "image-registry-tls" not found Sep 10 17:40:07.510525 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:07.510253 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls podName:7a705cfa-eda8-4a74-aaf7-13d841013cd1 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:08.010244903 +0000 UTC m=+35.525281265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls") pod "dns-default-2lk44" (UID: "7a705cfa-eda8-4a74-aaf7-13d841013cd1") : secret "dns-default-metrics-tls" not found Sep 10 17:40:07.510699 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.510527 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a705cfa-eda8-4a74-aaf7-13d841013cd1-tmp-dir\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.510741 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.510690 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1248d46-c973-472f-9f75-3da770fae4db-ca-trust-extracted\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.510835 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.510808 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a705cfa-eda8-4a74-aaf7-13d841013cd1-config-volume\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.511256 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.511232 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-registry-certificates\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.511908 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.511887 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-trusted-ca\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.514368 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.514342 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-image-registry-private-configuration\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.514448 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.514366 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-installation-pull-secrets\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.514448 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.514432 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bcbcb13-44db-4895-9524-6822c3d50baa-cert\") pod \"ingress-canary-bzbb4\" (UID: \"6bcbcb13-44db-4895-9524-6822c3d50baa\") " pod="openshift-ingress-canary/ingress-canary-bzbb4" Sep 10 17:40:07.522936 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.522904 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-bound-sa-token\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.523128 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.523071 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f2nx\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-kube-api-access-6f2nx\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:07.523830 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.523809 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdhfl\" (UniqueName: \"kubernetes.io/projected/7a705cfa-eda8-4a74-aaf7-13d841013cd1-kube-api-access-wdhfl\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:07.524237 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.524219 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9fps\" (UniqueName: \"kubernetes.io/projected/6bcbcb13-44db-4895-9524-6822c3d50baa-kube-api-access-p9fps\") pod \"ingress-canary-bzbb4\" (UID: \"6bcbcb13-44db-4895-9524-6822c3d50baa\") " pod="openshift-ingress-canary/ingress-canary-bzbb4" Sep 10 17:40:07.584495 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.584453 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:07.611539 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.611503 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bzbb4" Sep 10 17:40:07.905511 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:07.905419 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bzbb4"] Sep 10 17:40:07.909988 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:40:07.909957 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bcbcb13_44db_4895_9524_6822c3d50baa.slice/crio-dd0c123781c3d2bc9d26da89d8cb68af8e03edbc203b3d0544c4eb890bc022f1 WatchSource:0}: Error finding container dd0c123781c3d2bc9d26da89d8cb68af8e03edbc203b3d0544c4eb890bc022f1: Status 404 returned error can't find the container with id dd0c123781c3d2bc9d26da89d8cb68af8e03edbc203b3d0544c4eb890bc022f1 Sep 10 17:40:08.014981 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:08.014943 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:08.015161 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:08.015017 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:08.015161 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:08.015128 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:08.015272 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:08.015209 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls podName:7a705cfa-eda8-4a74-aaf7-13d841013cd1 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:09.015186516 +0000 UTC m=+36.530222895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls") pod "dns-default-2lk44" (UID: "7a705cfa-eda8-4a74-aaf7-13d841013cd1") : secret "dns-default-metrics-tls" not found Sep 10 17:40:08.015272 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:08.015131 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:40:08.015272 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:08.015248 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595f6ddc88-44sqm: secret "image-registry-tls" not found Sep 10 17:40:08.015437 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:08.015308 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls podName:e1248d46-c973-472f-9f75-3da770fae4db nodeName:}" failed. No retries permitted until 2026-09-10 17:40:09.015292334 +0000 UTC m=+36.530328701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls") pod "image-registry-595f6ddc88-44sqm" (UID: "e1248d46-c973-472f-9f75-3da770fae4db") : secret "image-registry-tls" not found Sep 10 17:40:08.250093 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:08.250002 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bzbb4" event={"ID":"6bcbcb13-44db-4895-9524-6822c3d50baa","Type":"ContainerStarted","Data":"dd0c123781c3d2bc9d26da89d8cb68af8e03edbc203b3d0544c4eb890bc022f1"} Sep 10 17:40:09.023050 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.022999 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:09.023745 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:09.023173 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:09.023745 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.023197 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:09.023745 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:09.023245 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls podName:7a705cfa-eda8-4a74-aaf7-13d841013cd1 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:11.023229202 +0000 UTC m=+38.538265569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls") pod "dns-default-2lk44" (UID: "7a705cfa-eda8-4a74-aaf7-13d841013cd1") : secret "dns-default-metrics-tls" not found Sep 10 17:40:09.023745 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:09.023327 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:40:09.023745 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:09.023341 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595f6ddc88-44sqm: secret "image-registry-tls" not found Sep 10 17:40:09.023745 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:09.023392 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls podName:e1248d46-c973-472f-9f75-3da770fae4db nodeName:}" failed. No retries permitted until 2026-09-10 17:40:11.023376262 +0000 UTC m=+38.538412625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls") pod "image-registry-595f6ddc88-44sqm" (UID: "e1248d46-c973-472f-9f75-3da770fae4db") : secret "image-registry-tls" not found Sep 10 17:40:09.072276 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.072144 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:40:09.072276 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.072189 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:40:09.072276 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.072256 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:40:09.075180 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.075154 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 17:40:09.076238 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.076210 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 17:40:09.076334 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.076242 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 17:40:09.076403 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.076374 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d22m9\"" Sep 10 17:40:09.076487 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.076406 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gjm6q\"" Sep 10 17:40:09.076487 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.076453 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 17:40:09.976945 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:09.976899 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:10.042764 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:10.042721 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:11.042714 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:11.042627 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:11.042897 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:11.042718 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:11.042897 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:11.042756 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:40:11.042897 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:11.042773 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595f6ddc88-44sqm: secret "image-registry-tls" not found Sep 10 17:40:11.042897 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:11.042829 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:11.042897 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:11.042838 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls podName:e1248d46-c973-472f-9f75-3da770fae4db nodeName:}" failed. No retries permitted until 2026-09-10 17:40:15.042820395 +0000 UTC m=+42.557856761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls") pod "image-registry-595f6ddc88-44sqm" (UID: "e1248d46-c973-472f-9f75-3da770fae4db") : secret "image-registry-tls" not found Sep 10 17:40:11.042897 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:11.042862 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls podName:7a705cfa-eda8-4a74-aaf7-13d841013cd1 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:15.042852437 +0000 UTC m=+42.557888808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls") pod "dns-default-2lk44" (UID: "7a705cfa-eda8-4a74-aaf7-13d841013cd1") : secret "dns-default-metrics-tls" not found Sep 10 17:40:11.934110 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:11.934063 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:11.996005 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:11.995967 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:12.262983 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:12.262906 2570 generic.go:356] "Generic (PLEG): container finished" podID="de45abfe-1156-4ea1-8c4e-d09c9fb00720" containerID="60d140c3baabed8d711d57b66777d6e32a69144300f23ae02c1c68d090577bb9" exitCode=0 Sep 10 17:40:12.263457 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:12.262994 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pnk7" event={"ID":"de45abfe-1156-4ea1-8c4e-d09c9fb00720","Type":"ContainerDied","Data":"60d140c3baabed8d711d57b66777d6e32a69144300f23ae02c1c68d090577bb9"} Sep 10 17:40:12.264629 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:12.264607 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bzbb4" event={"ID":"6bcbcb13-44db-4895-9524-6822c3d50baa","Type":"ContainerStarted","Data":"ab66ac1630e0b121cdd4b65211f96839330f8ab5b81222454b43110e81207fd5"} Sep 10 17:40:12.302212 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:12.302159 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bzbb4" podStartSLOduration=1.9334280590000001 podStartE2EDuration="5.302138371s" totalImagesPullingTime="3.368710312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:40:12.301837046 +0000 UTC m=+39.816873430" watchObservedRunningTime="2026-09-10 17:40:12.302138371 +0000 UTC m=+39.817174755" Sep 10 17:40:13.270159 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:13.270118 2570 generic.go:356] "Generic (PLEG): container finished" podID="de45abfe-1156-4ea1-8c4e-d09c9fb00720" containerID="781c9ff789d3c24310151506bd4f79017bd75f0b90ac915c0031f43c77442f0c" exitCode=0 Sep 10 17:40:13.270568 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:13.270193 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pnk7" event={"ID":"de45abfe-1156-4ea1-8c4e-d09c9fb00720","Type":"ContainerDied","Data":"781c9ff789d3c24310151506bd4f79017bd75f0b90ac915c0031f43c77442f0c"} Sep 10 17:40:13.452479 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:13.452444 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:13.549438 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:13.549405 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:14.276111 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:14.276074 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pnk7" event={"ID":"de45abfe-1156-4ea1-8c4e-d09c9fb00720","Type":"ContainerStarted","Data":"72a57430d9f9a9e8ab2719910341486e1f4a328302b63e1c9d5b9ce2598dddf9"} Sep 10 17:40:14.302902 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:14.302860 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5pnk7" podStartSLOduration=7.548096032 podStartE2EDuration="40.302844357s" totalImagesPullingTime="32.754748325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:40:14.30132123 +0000 UTC m=+41.816357614" watchObservedRunningTime="2026-09-10 17:40:14.302844357 +0000 UTC m=+41.817880739" Sep 10 17:40:14.444580 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:14.444547 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:14.537589 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:14.537519 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:15.073526 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:15.073483 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:15.073725 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:15.073556 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:15.073725 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:15.073673 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:40:15.073725 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:15.073700 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595f6ddc88-44sqm: secret "image-registry-tls" not found Sep 10 17:40:15.073725 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:15.073673 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:15.073896 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:15.073756 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls podName:e1248d46-c973-472f-9f75-3da770fae4db nodeName:}" failed. No retries permitted until 2026-09-10 17:40:23.073739659 +0000 UTC m=+50.588776026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls") pod "image-registry-595f6ddc88-44sqm" (UID: "e1248d46-c973-472f-9f75-3da770fae4db") : secret "image-registry-tls" not found Sep 10 17:40:15.073896 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:15.073769 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls podName:7a705cfa-eda8-4a74-aaf7-13d841013cd1 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:23.073763332 +0000 UTC m=+50.588799694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls") pod "dns-default-2lk44" (UID: "7a705cfa-eda8-4a74-aaf7-13d841013cd1") : secret "dns-default-metrics-tls" not found Sep 10 17:40:15.350294 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:15.350214 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:15.416300 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:15.416271 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:16.750937 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:16.750902 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:16.816631 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:16.816602 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:17.826479 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:17.826448 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:17.919156 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:17.919127 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" limit=1024 Sep 10 17:40:23.131320 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:23.131286 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:23.131676 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:23.131348 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:23.131676 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:23.131427 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:40:23.131676 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:23.131443 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595f6ddc88-44sqm: secret "image-registry-tls" not found Sep 10 17:40:23.131676 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:23.131489 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls podName:e1248d46-c973-472f-9f75-3da770fae4db nodeName:}" failed. No retries permitted until 2026-09-10 17:40:39.131476312 +0000 UTC m=+66.646512674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls") pod "image-registry-595f6ddc88-44sqm" (UID: "e1248d46-c973-472f-9f75-3da770fae4db") : secret "image-registry-tls" not found Sep 10 17:40:23.131676 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:23.131432 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:23.131676 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:23.131539 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls podName:7a705cfa-eda8-4a74-aaf7-13d841013cd1 nodeName:}" failed. No retries permitted until 2026-09-10 17:40:39.131528952 +0000 UTC m=+66.646565322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls") pod "dns-default-2lk44" (UID: "7a705cfa-eda8-4a74-aaf7-13d841013cd1") : secret "dns-default-metrics-tls" not found Sep 10 17:40:32.238963 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:32.238928 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4kn7g" Sep 10 17:40:38.641675 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.641632 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:40:38.641675 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.641676 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:40:38.644723 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.644701 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 17:40:38.644798 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.644786 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 17:40:38.652383 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:38.652364 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 17:40:38.652445 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:38.652431 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs podName:7e939930-7b98-4f9a-95a8-3a9ec4c72e61 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:42.652413236 +0000 UTC m=+130.167449599 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs") pod "network-metrics-daemon-q7vrb" (UID: "7e939930-7b98-4f9a-95a8-3a9ec4c72e61") : secret "metrics-daemon-secret" not found Sep 10 17:40:38.655483 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.655465 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039-original-pull-secret\") pod \"global-pull-secret-syncer-jjrq9\" (UID: \"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039\") " pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:40:38.742741 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.742704 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tswh\" (UniqueName: \"kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh\") pod \"network-check-target-xgb5w\" (UID: \"546e4ffc-92e6-41ac-b5bc-04b376d58073\") " pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:40:38.745664 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.745638 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 17:40:38.756305 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.756282 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 17:40:38.766815 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.766794 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tswh\" (UniqueName: \"kubernetes.io/projected/546e4ffc-92e6-41ac-b5bc-04b376d58073-kube-api-access-5tswh\") pod \"network-check-target-xgb5w\" (UID: \"546e4ffc-92e6-41ac-b5bc-04b376d58073\") " pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:40:38.785881 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.785855 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrq9" Sep 10 17:40:38.798166 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.798139 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gjm6q\"" Sep 10 17:40:38.805411 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:38.805388 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:40:39.056924 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:39.056897 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jjrq9"] Sep 10 17:40:39.060714 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:40:39.060694 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf63c4c6_56a2_4eb7_b8d8_e9fa6d9ec039.slice/crio-550b79f5866b9856031ec6cdba17da4d2f43ba4521814c74183d8ccb3ce02f2f WatchSource:0}: Error finding container 550b79f5866b9856031ec6cdba17da4d2f43ba4521814c74183d8ccb3ce02f2f: Status 404 returned error can't find the container with id 550b79f5866b9856031ec6cdba17da4d2f43ba4521814c74183d8ccb3ce02f2f Sep 10 17:40:39.083401 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:39.083375 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xgb5w"] Sep 10 17:40:39.086387 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:40:39.086358 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546e4ffc_92e6_41ac_b5bc_04b376d58073.slice/crio-44f81e0b980169d948ab3869ecb1fc68938f567d3a04d419304f5eef4db0fffd WatchSource:0}: Error finding container 44f81e0b980169d948ab3869ecb1fc68938f567d3a04d419304f5eef4db0fffd: Status 404 returned error can't find the container with id 44f81e0b980169d948ab3869ecb1fc68938f567d3a04d419304f5eef4db0fffd Sep 10 17:40:39.145837 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:39.145802 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:40:39.146013 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:39.145869 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:40:39.146013 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:39.145975 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:40:39.146106 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:39.146059 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls podName:7a705cfa-eda8-4a74-aaf7-13d841013cd1 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:11.146024926 +0000 UTC m=+98.661061287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls") pod "dns-default-2lk44" (UID: "7a705cfa-eda8-4a74-aaf7-13d841013cd1") : secret "dns-default-metrics-tls" not found Sep 10 17:40:39.146106 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:39.145982 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:40:39.146106 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:39.146076 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595f6ddc88-44sqm: secret "image-registry-tls" not found Sep 10 17:40:39.146205 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:40:39.146130 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls podName:e1248d46-c973-472f-9f75-3da770fae4db nodeName:}" failed. No retries permitted until 2026-09-10 17:41:11.146114954 +0000 UTC m=+98.661151316 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls") pod "image-registry-595f6ddc88-44sqm" (UID: "e1248d46-c973-472f-9f75-3da770fae4db") : secret "image-registry-tls" not found Sep 10 17:40:39.333145 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:39.333064 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jjrq9" event={"ID":"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039","Type":"ContainerStarted","Data":"550b79f5866b9856031ec6cdba17da4d2f43ba4521814c74183d8ccb3ce02f2f"} Sep 10 17:40:39.334124 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:39.334100 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xgb5w" event={"ID":"546e4ffc-92e6-41ac-b5bc-04b376d58073","Type":"ContainerStarted","Data":"44f81e0b980169d948ab3869ecb1fc68938f567d3a04d419304f5eef4db0fffd"} Sep 10 17:40:44.349610 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:44.349569 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xgb5w" event={"ID":"546e4ffc-92e6-41ac-b5bc-04b376d58073","Type":"ContainerStarted","Data":"4c6a1f66fb2d5b30b5cd9bbf2ff0ed233f321a6186aee0a7cf65825cc7bad558"} Sep 10 17:40:44.350127 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:44.349681 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:40:44.351194 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:44.351165 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jjrq9" event={"ID":"cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039","Type":"ContainerStarted","Data":"3727d0b33250e0c36f282b4a49178a531ea258f59aa6caa6f24496b68e78e7be"} Sep 10 17:40:44.384932 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:44.384882 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jjrq9" podStartSLOduration=65.689231886 podStartE2EDuration="1m10.384866452s" totalImagesPullingTime="4.695634566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:40:44.383973995 +0000 UTC m=+71.899010378" watchObservedRunningTime="2026-09-10 17:40:44.384866452 +0000 UTC m=+71.899902871" Sep 10 17:40:44.385165 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:40:44.385143 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xgb5w" podStartSLOduration=65.718395675 podStartE2EDuration="1m10.385137254s" totalImagesPullingTime="4.666741579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:40:44.36885173 +0000 UTC m=+71.883888116" watchObservedRunningTime="2026-09-10 17:40:44.385137254 +0000 UTC m=+71.900173638" Sep 10 17:41:11.165335 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:11.165301 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:41:11.165745 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:11.165354 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:41:11.165745 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:11.165450 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:41:11.165745 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:11.165456 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:41:11.165745 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:11.165476 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-595f6ddc88-44sqm: secret "image-registry-tls" not found Sep 10 17:41:11.165745 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:11.165510 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls podName:7a705cfa-eda8-4a74-aaf7-13d841013cd1 nodeName:}" failed. No retries permitted until 2026-09-10 17:42:15.165497669 +0000 UTC m=+162.680534031 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls") pod "dns-default-2lk44" (UID: "7a705cfa-eda8-4a74-aaf7-13d841013cd1") : secret "dns-default-metrics-tls" not found Sep 10 17:41:11.165745 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:11.165529 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls podName:e1248d46-c973-472f-9f75-3da770fae4db nodeName:}" failed. No retries permitted until 2026-09-10 17:42:15.165515787 +0000 UTC m=+162.680552154 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls") pod "image-registry-595f6ddc88-44sqm" (UID: "e1248d46-c973-472f-9f75-3da770fae4db") : secret "image-registry-tls" not found Sep 10 17:41:15.355380 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:15.355349 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xgb5w" Sep 10 17:41:21.393337 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.393301 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-vbm6f"] Sep 10 17:41:21.396073 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.396057 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.399404 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.399379 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 10 17:41:21.399506 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.399379 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:41:21.400614 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.400594 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 10 17:41:21.400671 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.400611 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 10 17:41:21.400709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.400692 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fqd9g\"" Sep 10 17:41:21.411299 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.411276 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 10 17:41:21.411865 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.411848 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-vbm6f"] Sep 10 17:41:21.434386 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.434361 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-config\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.434477 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.434401 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-trusted-ca\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.434477 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.434438 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97m6x\" (UniqueName: \"kubernetes.io/projected/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-kube-api-access-97m6x\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.434545 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.434494 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-serving-cert\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.535172 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.535138 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-config\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.535320 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.535184 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-trusted-ca\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.535359 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.535310 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97m6x\" (UniqueName: \"kubernetes.io/projected/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-kube-api-access-97m6x\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.535426 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.535407 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-serving-cert\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.535943 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.535919 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-config\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.536140 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.536120 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-trusted-ca\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.537641 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.537620 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-serving-cert\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.552317 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.552298 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97m6x\" (UniqueName: \"kubernetes.io/projected/39f4aec9-3e3a-49e2-8060-ffeb540d24c9-kube-api-access-97m6x\") pod \"console-operator-85b454874b-vbm6f\" (UID: \"39f4aec9-3e3a-49e2-8060-ffeb540d24c9\") " pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.704744 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.704662 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:21.974860 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:21.974785 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-vbm6f"] Sep 10 17:41:21.978356 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:41:21.978324 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f4aec9_3e3a_49e2_8060_ffeb540d24c9.slice/crio-d8157302996e4d62c7fcb2c5a6c780bd47feb9af44d8d826236a2eada2f71bb2 WatchSource:0}: Error finding container d8157302996e4d62c7fcb2c5a6c780bd47feb9af44d8d826236a2eada2f71bb2: Status 404 returned error can't find the container with id d8157302996e4d62c7fcb2c5a6c780bd47feb9af44d8d826236a2eada2f71bb2 Sep 10 17:41:22.448934 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:22.448887 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" event={"ID":"39f4aec9-3e3a-49e2-8060-ffeb540d24c9","Type":"ContainerStarted","Data":"d8157302996e4d62c7fcb2c5a6c780bd47feb9af44d8d826236a2eada2f71bb2"} Sep 10 17:41:24.455423 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:24.455396 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/0.log" Sep 10 17:41:24.455770 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:24.455433 2570 generic.go:356] "Generic (PLEG): container finished" podID="39f4aec9-3e3a-49e2-8060-ffeb540d24c9" containerID="7a5361ea910fd5bcb17b8e80fe7327527d12fbe306eb14b100edce9b6790568a" exitCode=255 Sep 10 17:41:24.455770 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:24.455469 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" event={"ID":"39f4aec9-3e3a-49e2-8060-ffeb540d24c9","Type":"ContainerDied","Data":"7a5361ea910fd5bcb17b8e80fe7327527d12fbe306eb14b100edce9b6790568a"} Sep 10 17:41:24.455770 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:24.455696 2570 scope.go:117] "RemoveContainer" containerID="7a5361ea910fd5bcb17b8e80fe7327527d12fbe306eb14b100edce9b6790568a" Sep 10 17:41:25.460337 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:25.460311 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/1.log" Sep 10 17:41:25.460779 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:25.460764 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/0.log" Sep 10 17:41:25.460826 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:25.460796 2570 generic.go:356] "Generic (PLEG): container finished" podID="39f4aec9-3e3a-49e2-8060-ffeb540d24c9" containerID="798803f3af1975ac1de682cd621f17d709ed828615ea876a22b588d9f6066b10" exitCode=255 Sep 10 17:41:25.460861 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:25.460828 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" event={"ID":"39f4aec9-3e3a-49e2-8060-ffeb540d24c9","Type":"ContainerDied","Data":"798803f3af1975ac1de682cd621f17d709ed828615ea876a22b588d9f6066b10"} Sep 10 17:41:25.460894 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:25.460887 2570 scope.go:117] "RemoveContainer" containerID="7a5361ea910fd5bcb17b8e80fe7327527d12fbe306eb14b100edce9b6790568a" Sep 10 17:41:25.461093 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:25.461076 2570 scope.go:117] "RemoveContainer" containerID="798803f3af1975ac1de682cd621f17d709ed828615ea876a22b588d9f6066b10" Sep 10 17:41:25.461259 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:25.461240 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-vbm6f_openshift-console-operator(39f4aec9-3e3a-49e2-8060-ffeb540d24c9)\"" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" podUID="39f4aec9-3e3a-49e2-8060-ffeb540d24c9" Sep 10 17:41:26.334650 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.334617 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ts5rm"] Sep 10 17:41:26.337186 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.337168 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.341050 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.341010 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 17:41:26.341214 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.341189 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ktmw7\"" Sep 10 17:41:26.342452 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.342428 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 17:41:26.342452 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.342444 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 17:41:26.342599 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.342429 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 17:41:26.351240 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.351219 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ts5rm"] Sep 10 17:41:26.369477 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.369451 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01226013-012f-4acb-b4db-942a13a42227-data-volume\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.369569 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.369500 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.369569 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.369557 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dlqf\" (UniqueName: \"kubernetes.io/projected/01226013-012f-4acb-b4db-942a13a42227-kube-api-access-8dlqf\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.369637 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.369580 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.369637 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.369608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01226013-012f-4acb-b4db-942a13a42227-crio-socket\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.464886 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.464860 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/1.log" Sep 10 17:41:26.465272 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.465171 2570 scope.go:117] "RemoveContainer" containerID="798803f3af1975ac1de682cd621f17d709ed828615ea876a22b588d9f6066b10" Sep 10 17:41:26.465348 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:26.465329 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-vbm6f_openshift-console-operator(39f4aec9-3e3a-49e2-8060-ffeb540d24c9)\"" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" podUID="39f4aec9-3e3a-49e2-8060-ffeb540d24c9" Sep 10 17:41:26.470421 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.470397 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dlqf\" (UniqueName: \"kubernetes.io/projected/01226013-012f-4acb-b4db-942a13a42227-kube-api-access-8dlqf\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.470583 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.470430 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.470583 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.470449 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01226013-012f-4acb-b4db-942a13a42227-crio-socket\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.470583 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.470521 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01226013-012f-4acb-b4db-942a13a42227-crio-socket\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.470583 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:26.470543 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:41:26.470583 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.470577 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01226013-012f-4acb-b4db-942a13a42227-data-volume\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.470833 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:26.470628 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm podName:01226013-012f-4acb-b4db-942a13a42227 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:26.970611516 +0000 UTC m=+114.485647883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ts5rm" (UID: "01226013-012f-4acb-b4db-942a13a42227") : configmap "kube-rbac-proxy" not found Sep 10 17:41:26.470833 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.470659 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.470833 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:26.470757 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:26.470833 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:26.470791 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls podName:01226013-012f-4acb-b4db-942a13a42227 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:26.970781455 +0000 UTC m=+114.485817817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ts5rm" (UID: "01226013-012f-4acb-b4db-942a13a42227") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:26.470974 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.470846 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01226013-012f-4acb-b4db-942a13a42227-data-volume\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.480717 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.480700 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dlqf\" (UniqueName: \"kubernetes.io/projected/01226013-012f-4acb-b4db-942a13a42227-kube-api-access-8dlqf\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.973430 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.973386 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.973430 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:26.973436 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:26.973680 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:26.973517 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:41:26.973680 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:26.973543 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:26.973680 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:26.973572 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm podName:01226013-012f-4acb-b4db-942a13a42227 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:27.973557215 +0000 UTC m=+115.488593578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ts5rm" (UID: "01226013-012f-4acb-b4db-942a13a42227") : configmap "kube-rbac-proxy" not found Sep 10 17:41:26.973680 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:26.973605 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls podName:01226013-012f-4acb-b4db-942a13a42227 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:27.973592084 +0000 UTC m=+115.488628447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ts5rm" (UID: "01226013-012f-4acb-b4db-942a13a42227") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:27.979645 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:27.979599 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:27.979645 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:27.979663 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:27.980121 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:27.979728 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:41:27.980121 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:27.979756 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:27.980121 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:27.979782 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm podName:01226013-012f-4acb-b4db-942a13a42227 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:29.979768039 +0000 UTC m=+117.494804401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ts5rm" (UID: "01226013-012f-4acb-b4db-942a13a42227") : configmap "kube-rbac-proxy" not found Sep 10 17:41:27.980121 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:27.979807 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls podName:01226013-012f-4acb-b4db-942a13a42227 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:29.979795368 +0000 UTC m=+117.494831734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ts5rm" (UID: "01226013-012f-4acb-b4db-942a13a42227") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:28.890806 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.890783 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-282gm_651a4d52-994d-4698-9b73-4946ab6459db/dns-node-resolver/0.log" Sep 10 17:41:28.931113 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.931082 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-9st4d"] Sep 10 17:41:28.932843 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.932825 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-9st4d" Sep 10 17:41:28.935297 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.935255 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jdgks\"" Sep 10 17:41:28.935491 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.935461 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 10 17:41:28.935597 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.935512 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 10 17:41:28.936410 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.936392 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 10 17:41:28.936492 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.936418 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 10 17:41:28.944000 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.943981 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-9st4d"] Sep 10 17:41:28.986466 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.986436 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e061fc20-0e92-49ff-883d-11008bc396c4-signing-cabundle\") pod \"service-ca-75d99c484-9st4d\" (UID: \"e061fc20-0e92-49ff-883d-11008bc396c4\") " pod="openshift-service-ca/service-ca-75d99c484-9st4d" Sep 10 17:41:28.986839 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.986475 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp2l7\" (UniqueName: \"kubernetes.io/projected/e061fc20-0e92-49ff-883d-11008bc396c4-kube-api-access-pp2l7\") pod \"service-ca-75d99c484-9st4d\" (UID: \"e061fc20-0e92-49ff-883d-11008bc396c4\") " pod="openshift-service-ca/service-ca-75d99c484-9st4d" Sep 10 17:41:28.986839 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:28.986503 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e061fc20-0e92-49ff-883d-11008bc396c4-signing-key\") pod \"service-ca-75d99c484-9st4d\" (UID: \"e061fc20-0e92-49ff-883d-11008bc396c4\") " pod="openshift-service-ca/service-ca-75d99c484-9st4d" Sep 10 17:41:29.087548 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:29.087523 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e061fc20-0e92-49ff-883d-11008bc396c4-signing-cabundle\") pod \"service-ca-75d99c484-9st4d\" (UID: \"e061fc20-0e92-49ff-883d-11008bc396c4\") " pod="openshift-service-ca/service-ca-75d99c484-9st4d" Sep 10 17:41:29.087698 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:29.087559 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp2l7\" (UniqueName: \"kubernetes.io/projected/e061fc20-0e92-49ff-883d-11008bc396c4-kube-api-access-pp2l7\") pod \"service-ca-75d99c484-9st4d\" (UID: \"e061fc20-0e92-49ff-883d-11008bc396c4\") " pod="openshift-service-ca/service-ca-75d99c484-9st4d" Sep 10 17:41:29.087698 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:29.087587 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e061fc20-0e92-49ff-883d-11008bc396c4-signing-key\") pod \"service-ca-75d99c484-9st4d\" (UID: \"e061fc20-0e92-49ff-883d-11008bc396c4\") " pod="openshift-service-ca/service-ca-75d99c484-9st4d" Sep 10 17:41:29.088210 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:29.088191 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e061fc20-0e92-49ff-883d-11008bc396c4-signing-cabundle\") pod \"service-ca-75d99c484-9st4d\" (UID: \"e061fc20-0e92-49ff-883d-11008bc396c4\") " pod="openshift-service-ca/service-ca-75d99c484-9st4d" Sep 10 17:41:29.089888 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:29.089862 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e061fc20-0e92-49ff-883d-11008bc396c4-signing-key\") pod \"service-ca-75d99c484-9st4d\" (UID: \"e061fc20-0e92-49ff-883d-11008bc396c4\") " pod="openshift-service-ca/service-ca-75d99c484-9st4d" Sep 10 17:41:29.095229 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:29.095209 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp2l7\" (UniqueName: \"kubernetes.io/projected/e061fc20-0e92-49ff-883d-11008bc396c4-kube-api-access-pp2l7\") pod \"service-ca-75d99c484-9st4d\" (UID: \"e061fc20-0e92-49ff-883d-11008bc396c4\") " pod="openshift-service-ca/service-ca-75d99c484-9st4d" Sep 10 17:41:29.242349 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:29.242266 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-9st4d" Sep 10 17:41:29.511896 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:29.511809 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-9st4d"] Sep 10 17:41:29.515623 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:41:29.515598 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode061fc20_0e92_49ff_883d_11008bc396c4.slice/crio-179460e9f47c6d85dbf440eae97ecc69f6a8965f3ce1f5fa2b6a6283ee3cc763 WatchSource:0}: Error finding container 179460e9f47c6d85dbf440eae97ecc69f6a8965f3ce1f5fa2b6a6283ee3cc763: Status 404 returned error can't find the container with id 179460e9f47c6d85dbf440eae97ecc69f6a8965f3ce1f5fa2b6a6283ee3cc763 Sep 10 17:41:29.995395 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:29.995355 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:29.995807 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:29.995422 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:29.995807 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:29.995493 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:29.995807 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:29.995546 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:41:29.995807 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:29.995556 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls podName:01226013-012f-4acb-b4db-942a13a42227 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:33.995539693 +0000 UTC m=+121.510576054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ts5rm" (UID: "01226013-012f-4acb-b4db-942a13a42227") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:29.995807 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:29.995598 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm podName:01226013-012f-4acb-b4db-942a13a42227 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:33.995583116 +0000 UTC m=+121.510619478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ts5rm" (UID: "01226013-012f-4acb-b4db-942a13a42227") : configmap "kube-rbac-proxy" not found Sep 10 17:41:30.091018 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:30.090993 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ht8ws_d756089e-495a-4d2b-aed2-414349e8ca4e/node-ca/0.log" Sep 10 17:41:30.475942 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:30.475909 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-9st4d" event={"ID":"e061fc20-0e92-49ff-883d-11008bc396c4","Type":"ContainerStarted","Data":"179460e9f47c6d85dbf440eae97ecc69f6a8965f3ce1f5fa2b6a6283ee3cc763"} Sep 10 17:41:30.690886 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:30.690852 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bzbb4_6bcbcb13-44db-4895-9524-6822c3d50baa/serve-healthcheck-canary/0.log" Sep 10 17:41:31.481086 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:31.480987 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-9st4d" event={"ID":"e061fc20-0e92-49ff-883d-11008bc396c4","Type":"ContainerStarted","Data":"935b78d180ab2953cef858820418e957ffeb8e32d822febfe96ca77285fe9a26"} Sep 10 17:41:31.498677 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:31.498619 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-9st4d" podStartSLOduration=1.80826285 podStartE2EDuration="3.49860195s" totalImagesPullingTime="1.6903391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:31.497822029 +0000 UTC m=+119.012858413" watchObservedRunningTime="2026-09-10 17:41:31.49860195 +0000 UTC m=+119.013638336" Sep 10 17:41:31.705472 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:31.705423 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:31.705618 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:31.705492 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:31.705835 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:31.705821 2570 scope.go:117] "RemoveContainer" containerID="798803f3af1975ac1de682cd621f17d709ed828615ea876a22b588d9f6066b10" Sep 10 17:41:31.706006 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:31.705985 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-vbm6f_openshift-console-operator(39f4aec9-3e3a-49e2-8060-ffeb540d24c9)\"" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" podUID="39f4aec9-3e3a-49e2-8060-ffeb540d24c9" Sep 10 17:41:34.027760 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:34.027713 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:34.028189 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:34.027791 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:34.028189 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:34.027847 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:41:34.028189 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:34.027880 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:34.028189 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:34.027922 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm podName:01226013-012f-4acb-b4db-942a13a42227 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:42.027905035 +0000 UTC m=+129.542941406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ts5rm" (UID: "01226013-012f-4acb-b4db-942a13a42227") : configmap "kube-rbac-proxy" not found Sep 10 17:41:34.028189 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:34.027938 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls podName:01226013-012f-4acb-b4db-942a13a42227 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:42.027930925 +0000 UTC m=+129.542967287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ts5rm" (UID: "01226013-012f-4acb-b4db-942a13a42227") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:42.090795 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:42.090752 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:42.091399 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:42.090852 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:42.091399 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:42.090994 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:41:42.091399 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:42.091083 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls podName:01226013-012f-4acb-b4db-942a13a42227 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:58.091063536 +0000 UTC m=+145.606099899 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ts5rm" (UID: "01226013-012f-4acb-b4db-942a13a42227") : secret "insights-runtime-extractor-tls" not found Sep 10 17:41:42.091399 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:42.091268 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01226013-012f-4acb-b4db-942a13a42227-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:42.694946 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:42.694900 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:41:42.697195 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:42.697175 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e939930-7b98-4f9a-95a8-3a9ec4c72e61-metrics-certs\") pod \"network-metrics-daemon-q7vrb\" (UID: \"7e939930-7b98-4f9a-95a8-3a9ec4c72e61\") " pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:41:42.703826 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:42.703802 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d22m9\"" Sep 10 17:41:42.712051 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:42.712015 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7vrb" Sep 10 17:41:42.982329 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:42.982204 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q7vrb"] Sep 10 17:41:42.985065 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:41:42.985025 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e939930_7b98_4f9a_95a8_3a9ec4c72e61.slice/crio-1b81e7bea009ea98eeca2783a2f6f28374268dccf76859e89fbf0ae46946bd3e WatchSource:0}: Error finding container 1b81e7bea009ea98eeca2783a2f6f28374268dccf76859e89fbf0ae46946bd3e: Status 404 returned error can't find the container with id 1b81e7bea009ea98eeca2783a2f6f28374268dccf76859e89fbf0ae46946bd3e Sep 10 17:41:43.523386 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:43.523347 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7vrb" event={"ID":"7e939930-7b98-4f9a-95a8-3a9ec4c72e61","Type":"ContainerStarted","Data":"1b81e7bea009ea98eeca2783a2f6f28374268dccf76859e89fbf0ae46946bd3e"} Sep 10 17:41:44.528729 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:44.528639 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7vrb" event={"ID":"7e939930-7b98-4f9a-95a8-3a9ec4c72e61","Type":"ContainerStarted","Data":"6b17fd172175815ac51af8664ba384a105e537dae8d02b5c8b2ed78bc5c8029c"} Sep 10 17:41:44.528729 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:44.528689 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7vrb" event={"ID":"7e939930-7b98-4f9a-95a8-3a9ec4c72e61","Type":"ContainerStarted","Data":"950f03b9ca5e4b52788a2387f6f0eec043e1b93162f0d7688a23000f868efbf6"} Sep 10 17:41:44.547232 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:44.547180 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q7vrb" podStartSLOduration=129.441180637 podStartE2EDuration="2m10.547143094s" totalImagesPullingTime="1.105962457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:44.546255386 +0000 UTC m=+132.061291770" watchObservedRunningTime="2026-09-10 17:41:44.547143094 +0000 UTC m=+132.062179479" Sep 10 17:41:45.071983 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:45.071952 2570 scope.go:117] "RemoveContainer" containerID="798803f3af1975ac1de682cd621f17d709ed828615ea876a22b588d9f6066b10" Sep 10 17:41:45.533487 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:45.533411 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/2.log" Sep 10 17:41:45.533877 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:45.533819 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/1.log" Sep 10 17:41:45.533877 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:45.533850 2570 generic.go:356] "Generic (PLEG): container finished" podID="39f4aec9-3e3a-49e2-8060-ffeb540d24c9" containerID="3b57f3532d8654f69a51c40c6993f7f903baafafa02fa40bbe3f05282decd454" exitCode=255 Sep 10 17:41:45.533943 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:45.533925 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" event={"ID":"39f4aec9-3e3a-49e2-8060-ffeb540d24c9","Type":"ContainerDied","Data":"3b57f3532d8654f69a51c40c6993f7f903baafafa02fa40bbe3f05282decd454"} Sep 10 17:41:45.534001 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:45.533986 2570 scope.go:117] "RemoveContainer" containerID="798803f3af1975ac1de682cd621f17d709ed828615ea876a22b588d9f6066b10" Sep 10 17:41:45.534376 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:45.534356 2570 scope.go:117] "RemoveContainer" containerID="3b57f3532d8654f69a51c40c6993f7f903baafafa02fa40bbe3f05282decd454" Sep 10 17:41:45.534526 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:45.534503 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-vbm6f_openshift-console-operator(39f4aec9-3e3a-49e2-8060-ffeb540d24c9)\"" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" podUID="39f4aec9-3e3a-49e2-8060-ffeb540d24c9" Sep 10 17:41:46.538095 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:46.538030 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/2.log" Sep 10 17:41:49.113020 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.112987 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb"] Sep 10 17:41:49.115394 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.115372 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:49.118272 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.118250 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 17:41:49.118376 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.118252 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 17:41:49.119452 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.119433 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 17:41:49.119564 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.119468 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 10 17:41:49.130592 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.130572 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb"] Sep 10 17:41:49.238815 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.238781 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlcfq\" (UniqueName: \"kubernetes.io/projected/6dca271e-824e-45a0-ad0e-035070f2373f-kube-api-access-mlcfq\") pod \"klusterlet-addon-workmgr-7dfb6d479f-xz5sb\" (UID: \"6dca271e-824e-45a0-ad0e-035070f2373f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:49.238980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.238850 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6dca271e-824e-45a0-ad0e-035070f2373f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7dfb6d479f-xz5sb\" (UID: \"6dca271e-824e-45a0-ad0e-035070f2373f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:49.238980 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.238871 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dca271e-824e-45a0-ad0e-035070f2373f-tmp\") pod \"klusterlet-addon-workmgr-7dfb6d479f-xz5sb\" (UID: \"6dca271e-824e-45a0-ad0e-035070f2373f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:49.339466 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.339431 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6dca271e-824e-45a0-ad0e-035070f2373f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7dfb6d479f-xz5sb\" (UID: \"6dca271e-824e-45a0-ad0e-035070f2373f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:49.339466 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.339466 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dca271e-824e-45a0-ad0e-035070f2373f-tmp\") pod \"klusterlet-addon-workmgr-7dfb6d479f-xz5sb\" (UID: \"6dca271e-824e-45a0-ad0e-035070f2373f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:49.339667 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.339593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlcfq\" (UniqueName: \"kubernetes.io/projected/6dca271e-824e-45a0-ad0e-035070f2373f-kube-api-access-mlcfq\") pod \"klusterlet-addon-workmgr-7dfb6d479f-xz5sb\" (UID: \"6dca271e-824e-45a0-ad0e-035070f2373f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:49.339817 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.339802 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dca271e-824e-45a0-ad0e-035070f2373f-tmp\") pod \"klusterlet-addon-workmgr-7dfb6d479f-xz5sb\" (UID: \"6dca271e-824e-45a0-ad0e-035070f2373f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:49.342120 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.342101 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6dca271e-824e-45a0-ad0e-035070f2373f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7dfb6d479f-xz5sb\" (UID: \"6dca271e-824e-45a0-ad0e-035070f2373f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:49.367439 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.367376 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlcfq\" (UniqueName: \"kubernetes.io/projected/6dca271e-824e-45a0-ad0e-035070f2373f-kube-api-access-mlcfq\") pod \"klusterlet-addon-workmgr-7dfb6d479f-xz5sb\" (UID: \"6dca271e-824e-45a0-ad0e-035070f2373f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:49.424158 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.424127 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:49.693851 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:49.693780 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb"] Sep 10 17:41:49.696355 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:41:49.696326 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dca271e_824e_45a0_ad0e_035070f2373f.slice/crio-3aa5b5355b4fa733929f9c28883e90b100422516cc241f51c9c30e3d38295d71 WatchSource:0}: Error finding container 3aa5b5355b4fa733929f9c28883e90b100422516cc241f51c9c30e3d38295d71: Status 404 returned error can't find the container with id 3aa5b5355b4fa733929f9c28883e90b100422516cc241f51c9c30e3d38295d71 Sep 10 17:41:50.552337 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:50.552303 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" event={"ID":"6dca271e-824e-45a0-ad0e-035070f2373f","Type":"ContainerStarted","Data":"3aa5b5355b4fa733929f9c28883e90b100422516cc241f51c9c30e3d38295d71"} Sep 10 17:41:51.705314 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:51.705273 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:51.705742 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:51.705348 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:41:51.705742 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:51.705700 2570 scope.go:117] "RemoveContainer" containerID="3b57f3532d8654f69a51c40c6993f7f903baafafa02fa40bbe3f05282decd454" Sep 10 17:41:51.705914 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:51.705889 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-vbm6f_openshift-console-operator(39f4aec9-3e3a-49e2-8060-ffeb540d24c9)\"" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" podUID="39f4aec9-3e3a-49e2-8060-ffeb540d24c9" Sep 10 17:41:53.567273 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:53.567227 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" event={"ID":"6dca271e-824e-45a0-ad0e-035070f2373f","Type":"ContainerStarted","Data":"837b45b1ed62efe0b44acd39dbd1d5e62d7c30ce1a24d4f9ec99b165793db9a4"} Sep 10 17:41:53.567726 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:53.567462 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:53.568927 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:53.568905 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" Sep 10 17:41:53.585862 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:53.585801 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dfb6d479f-xz5sb" podStartSLOduration=0.824053508 podStartE2EDuration="4.585783358s" totalImagesPullingTime="3.76172985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:53.585705967 +0000 UTC m=+141.100742354" watchObservedRunningTime="2026-09-10 17:41:53.585783358 +0000 UTC m=+141.100819740" Sep 10 17:41:56.048777 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:56.048741 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr"] Sep 10 17:41:56.051942 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:56.051924 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" Sep 10 17:41:56.054849 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:56.054831 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8hqd4\"" Sep 10 17:41:56.054908 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:56.054866 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 17:41:56.063321 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:56.063299 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr"] Sep 10 17:41:56.194789 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:56.194743 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/284e2a70-4da4-428f-94d6-ead0afc04025-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-hrrpr\" (UID: \"284e2a70-4da4-428f-94d6-ead0afc04025\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" Sep 10 17:41:56.296124 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:56.296090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/284e2a70-4da4-428f-94d6-ead0afc04025-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-hrrpr\" (UID: \"284e2a70-4da4-428f-94d6-ead0afc04025\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" Sep 10 17:41:56.296273 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:56.296231 2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 10 17:41:56.296318 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:56.296292 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/284e2a70-4da4-428f-94d6-ead0afc04025-tls-certificates podName:284e2a70-4da4-428f-94d6-ead0afc04025 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:56.796276931 +0000 UTC m=+144.311313293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/284e2a70-4da4-428f-94d6-ead0afc04025-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-hrrpr" (UID: "284e2a70-4da4-428f-94d6-ead0afc04025") : secret "prometheus-operator-admission-webhook-tls" not found Sep 10 17:41:56.799151 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:56.799110 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/284e2a70-4da4-428f-94d6-ead0afc04025-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-hrrpr\" (UID: \"284e2a70-4da4-428f-94d6-ead0afc04025\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" Sep 10 17:41:56.799341 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:56.799248 2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 10 17:41:56.799341 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:41:56.799317 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/284e2a70-4da4-428f-94d6-ead0afc04025-tls-certificates podName:284e2a70-4da4-428f-94d6-ead0afc04025 nodeName:}" failed. No retries permitted until 2026-09-10 17:41:57.799299612 +0000 UTC m=+145.314335988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/284e2a70-4da4-428f-94d6-ead0afc04025-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-hrrpr" (UID: "284e2a70-4da4-428f-94d6-ead0afc04025") : secret "prometheus-operator-admission-webhook-tls" not found Sep 10 17:41:57.807803 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:57.807758 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/284e2a70-4da4-428f-94d6-ead0afc04025-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-hrrpr\" (UID: \"284e2a70-4da4-428f-94d6-ead0afc04025\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" Sep 10 17:41:57.810179 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:57.810156 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/284e2a70-4da4-428f-94d6-ead0afc04025-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-hrrpr\" (UID: \"284e2a70-4da4-428f-94d6-ead0afc04025\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" Sep 10 17:41:57.860461 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:57.860419 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" Sep 10 17:41:58.110285 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:58.110204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:58.112619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:58.112590 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01226013-012f-4acb-b4db-942a13a42227-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ts5rm\" (UID: \"01226013-012f-4acb-b4db-942a13a42227\") " pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:58.130982 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:58.130953 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr"] Sep 10 17:41:58.133536 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:41:58.133510 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284e2a70_4da4_428f_94d6_ead0afc04025.slice/crio-b0eaaff9bc81998ac2293a4f169a0269b188d16fa6fcc3959d454e6c649b3b71 WatchSource:0}: Error finding container b0eaaff9bc81998ac2293a4f169a0269b188d16fa6fcc3959d454e6c649b3b71: Status 404 returned error can't find the container with id b0eaaff9bc81998ac2293a4f169a0269b188d16fa6fcc3959d454e6c649b3b71 Sep 10 17:41:58.148918 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:58.148892 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ktmw7\"" Sep 10 17:41:58.157296 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:58.157279 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ts5rm" Sep 10 17:41:58.424960 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:58.424878 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ts5rm"] Sep 10 17:41:58.427947 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:41:58.427921 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01226013_012f_4acb_b4db_942a13a42227.slice/crio-a502ac9150fd3486c082e9d2d2ed22843f44d4a22c7bd1ed230f6d3cd7224258 WatchSource:0}: Error finding container a502ac9150fd3486c082e9d2d2ed22843f44d4a22c7bd1ed230f6d3cd7224258: Status 404 returned error can't find the container with id a502ac9150fd3486c082e9d2d2ed22843f44d4a22c7bd1ed230f6d3cd7224258 Sep 10 17:41:58.584189 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:58.584150 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" event={"ID":"284e2a70-4da4-428f-94d6-ead0afc04025","Type":"ContainerStarted","Data":"b0eaaff9bc81998ac2293a4f169a0269b188d16fa6fcc3959d454e6c649b3b71"} Sep 10 17:41:58.585597 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:58.585572 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ts5rm" event={"ID":"01226013-012f-4acb-b4db-942a13a42227","Type":"ContainerStarted","Data":"eb74339a47d9a0cb10478e8d0a21eb423396d2d3da421fd8f518e278f203ec89"} Sep 10 17:41:58.585708 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:58.585616 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ts5rm" event={"ID":"01226013-012f-4acb-b4db-942a13a42227","Type":"ContainerStarted","Data":"a502ac9150fd3486c082e9d2d2ed22843f44d4a22c7bd1ed230f6d3cd7224258"} Sep 10 17:41:59.592554 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:59.592516 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ts5rm" event={"ID":"01226013-012f-4acb-b4db-942a13a42227","Type":"ContainerStarted","Data":"bdb853771d970f5261fea8b15e62b3adfc6f95c924d964fe8fae0159e1ce7d6c"} Sep 10 17:41:59.594013 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:59.593990 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" event={"ID":"284e2a70-4da4-428f-94d6-ead0afc04025","Type":"ContainerStarted","Data":"9d045f5a3ef735b1f4faf0a6f33eb852a27340a0c42eb40424241a4be42657f8"} Sep 10 17:41:59.594283 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:59.594260 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" Sep 10 17:41:59.598642 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:59.598620 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" Sep 10 17:41:59.611486 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:41:59.611443 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-hrrpr" podStartSLOduration=2.228082345 podStartE2EDuration="3.611430411s" totalImagesPullingTime="1.383348066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:41:59.610331039 +0000 UTC m=+147.125367423" watchObservedRunningTime="2026-09-10 17:41:59.611430411 +0000 UTC m=+147.126466838" Sep 10 17:42:00.134303 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.134264 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-8p5wq"] Sep 10 17:42:00.137460 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.137437 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.140438 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.140414 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 17:42:00.140554 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.140539 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 17:42:00.140618 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.140539 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 17:42:00.141623 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.141603 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m6gjw\"" Sep 10 17:42:00.141859 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.141830 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 17:42:00.141975 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.141912 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 17:42:00.156165 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.156137 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-8p5wq"] Sep 10 17:42:00.225264 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.224970 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.225264 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.225061 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.225264 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.225110 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7qhs\" (UniqueName: \"kubernetes.io/projected/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-kube-api-access-x7qhs\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.225264 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.225213 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.326160 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.326122 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7qhs\" (UniqueName: \"kubernetes.io/projected/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-kube-api-access-x7qhs\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.326350 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.326221 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.326350 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.326256 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.326350 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.326297 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.326509 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:42:00.326399 2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 10 17:42:00.326509 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:42:00.326478 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-prometheus-operator-tls podName:40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27 nodeName:}" failed. No retries permitted until 2026-09-10 17:42:00.826456948 +0000 UTC m=+148.341493315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-8p5wq" (UID: "40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27") : secret "prometheus-operator-tls" not found Sep 10 17:42:00.327055 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.327021 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.328775 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.328756 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.335861 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.335838 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7qhs\" (UniqueName: \"kubernetes.io/projected/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-kube-api-access-x7qhs\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.831357 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.831317 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:00.833689 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:00.833664 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-8p5wq\" (UID: \"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:01.048097 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:01.048069 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" Sep 10 17:42:01.316826 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:01.316746 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-8p5wq"] Sep 10 17:42:01.319685 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:42:01.319658 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40fbfcfa_d19b_4a4d_9a74_9a4636fe9f27.slice/crio-4dc82c05fe78161bc18160eff3d289eae737529a3c44f8160d43baef6faf7924 WatchSource:0}: Error finding container 4dc82c05fe78161bc18160eff3d289eae737529a3c44f8160d43baef6faf7924: Status 404 returned error can't find the container with id 4dc82c05fe78161bc18160eff3d289eae737529a3c44f8160d43baef6faf7924 Sep 10 17:42:01.605624 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:01.605528 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ts5rm" event={"ID":"01226013-012f-4acb-b4db-942a13a42227","Type":"ContainerStarted","Data":"e7747de01848ac1f2d490cc5d6d0097a28c58d0496290fea32b7d09a16de2915"} Sep 10 17:42:01.606621 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:01.606595 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" event={"ID":"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27","Type":"ContainerStarted","Data":"4dc82c05fe78161bc18160eff3d289eae737529a3c44f8160d43baef6faf7924"} Sep 10 17:42:01.627229 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:01.627184 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ts5rm" podStartSLOduration=33.510289235 podStartE2EDuration="35.62717194s" totalImagesPullingTime="2.116882705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:41:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:01.626947563 +0000 UTC m=+149.141983947" watchObservedRunningTime="2026-09-10 17:42:01.62717194 +0000 UTC m=+149.142208325" Sep 10 17:42:03.616527 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:03.616495 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" event={"ID":"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27","Type":"ContainerStarted","Data":"86ee1b18383d3ec345ebb0623d27ef4670702afe08755c704e06aa7c00c402b6"} Sep 10 17:42:03.616898 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:03.616550 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" event={"ID":"40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27","Type":"ContainerStarted","Data":"0419904252a3c2f134ed910d29ccbd3e7b21bf66b1990c54386a05e2aad2a08f"} Sep 10 17:42:03.635778 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:03.635726 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-8p5wq" podStartSLOduration=2.07700767 podStartE2EDuration="3.635707457s" totalImagesPullingTime="1.558699787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:03.634837444 +0000 UTC m=+151.149873829" watchObservedRunningTime="2026-09-10 17:42:03.635707457 +0000 UTC m=+151.150743838" Sep 10 17:42:05.072555 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.072517 2570 scope.go:117] "RemoveContainer" containerID="3b57f3532d8654f69a51c40c6993f7f903baafafa02fa40bbe3f05282decd454" Sep 10 17:42:05.073018 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:42:05.072716 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-vbm6f_openshift-console-operator(39f4aec9-3e3a-49e2-8060-ffeb540d24c9)\"" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" podUID="39f4aec9-3e3a-49e2-8060-ffeb540d24c9" Sep 10 17:42:05.508243 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.508160 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs"] Sep 10 17:42:05.514220 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.514200 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.517618 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.517588 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 10 17:42:05.517836 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.517813 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q5c9l\"" Sep 10 17:42:05.517935 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.517899 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 10 17:42:05.524877 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.524857 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs"] Sep 10 17:42:05.534975 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.534952 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-47pfd"] Sep 10 17:42:05.538884 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.538866 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.541550 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.541516 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 17:42:05.541689 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.541517 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 17:42:05.541780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.541637 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 17:42:05.541881 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.541866 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nplqf\"" Sep 10 17:42:05.663782 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.663752 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/145e6792-a859-479b-bc58-7854beb96a71-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.663947 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.663802 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-textfile\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.663947 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.663831 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9j95\" (UniqueName: \"kubernetes.io/projected/3744b8ba-3e7d-4860-b13c-500a2bfd1267-kube-api-access-d9j95\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.663947 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.663872 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-tls\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.663947 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.663890 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3744b8ba-3e7d-4860-b13c-500a2bfd1267-metrics-client-ca\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.663947 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.663914 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3744b8ba-3e7d-4860-b13c-500a2bfd1267-sys\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.664143 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.663948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrn79\" (UniqueName: \"kubernetes.io/projected/145e6792-a859-479b-bc58-7854beb96a71-kube-api-access-zrn79\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.664143 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.663965 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-wtmp\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.664143 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.663981 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/145e6792-a859-479b-bc58-7854beb96a71-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.664143 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.664009 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-accelerators-collector-config\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.664143 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.664055 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/145e6792-a859-479b-bc58-7854beb96a71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.664143 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.664114 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3744b8ba-3e7d-4860-b13c-500a2bfd1267-root\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.664315 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.664151 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.765180 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765094 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/145e6792-a859-479b-bc58-7854beb96a71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.765180 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765140 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3744b8ba-3e7d-4860-b13c-500a2bfd1267-root\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.765180 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765156 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.765180 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765179 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/145e6792-a859-479b-bc58-7854beb96a71-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.765502 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765226 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3744b8ba-3e7d-4860-b13c-500a2bfd1267-root\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.765502 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765366 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-textfile\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.765502 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765392 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9j95\" (UniqueName: \"kubernetes.io/projected/3744b8ba-3e7d-4860-b13c-500a2bfd1267-kube-api-access-d9j95\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.765502 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765434 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-tls\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.765502 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765459 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3744b8ba-3e7d-4860-b13c-500a2bfd1267-metrics-client-ca\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.765502 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765487 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3744b8ba-3e7d-4860-b13c-500a2bfd1267-sys\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.765788 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765515 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrn79\" (UniqueName: \"kubernetes.io/projected/145e6792-a859-479b-bc58-7854beb96a71-kube-api-access-zrn79\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.765788 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765543 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-wtmp\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.765788 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765569 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/145e6792-a859-479b-bc58-7854beb96a71-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.765788 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765618 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-accelerators-collector-config\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.765788 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765688 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-textfile\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.766056 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.765988 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3744b8ba-3e7d-4860-b13c-500a2bfd1267-sys\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.766899 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.766176 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-wtmp\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.766899 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.766837 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-accelerators-collector-config\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.766899 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.766859 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/145e6792-a859-479b-bc58-7854beb96a71-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.766899 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.766870 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3744b8ba-3e7d-4860-b13c-500a2bfd1267-metrics-client-ca\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.767847 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.767829 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.768068 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.768049 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/145e6792-a859-479b-bc58-7854beb96a71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.768460 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.768441 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/145e6792-a859-479b-bc58-7854beb96a71-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.768875 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.768857 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3744b8ba-3e7d-4860-b13c-500a2bfd1267-node-exporter-tls\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.773726 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.773696 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrn79\" (UniqueName: \"kubernetes.io/projected/145e6792-a859-479b-bc58-7854beb96a71-kube-api-access-zrn79\") pod \"openshift-state-metrics-657fd6c54-kkjjs\" (UID: \"145e6792-a859-479b-bc58-7854beb96a71\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.773971 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.773950 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9j95\" (UniqueName: \"kubernetes.io/projected/3744b8ba-3e7d-4860-b13c-500a2bfd1267-kube-api-access-d9j95\") pod \"node-exporter-47pfd\" (UID: \"3744b8ba-3e7d-4860-b13c-500a2bfd1267\") " pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.824445 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.824404 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" Sep 10 17:42:05.849488 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:05.849462 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-47pfd" Sep 10 17:42:05.861113 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:42:05.861067 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3744b8ba_3e7d_4860_b13c_500a2bfd1267.slice/crio-519f170b2eba934c83852b2b9b46cdd2676b41a7d4ba794ce295db72fee20343 WatchSource:0}: Error finding container 519f170b2eba934c83852b2b9b46cdd2676b41a7d4ba794ce295db72fee20343: Status 404 returned error can't find the container with id 519f170b2eba934c83852b2b9b46cdd2676b41a7d4ba794ce295db72fee20343 Sep 10 17:42:06.096782 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.096752 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs"] Sep 10 17:42:06.099660 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:42:06.099637 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145e6792_a859_479b_bc58_7854beb96a71.slice/crio-f83408958a017ae29169ed2b70042bc53e0699ed8e012f672eda7387a6e664c8 WatchSource:0}: Error finding container f83408958a017ae29169ed2b70042bc53e0699ed8e012f672eda7387a6e664c8: Status 404 returned error can't find the container with id f83408958a017ae29169ed2b70042bc53e0699ed8e012f672eda7387a6e664c8 Sep 10 17:42:06.571828 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.571796 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 17:42:06.575848 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.575825 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.578413 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.578389 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 17:42:06.578551 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.578528 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 17:42:06.578616 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.578533 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 17:42:06.578616 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.578584 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 17:42:06.578763 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.578727 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 17:42:06.579137 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.579117 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 17:42:06.579220 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.579143 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 17:42:06.579355 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.579342 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4ggxc\"" Sep 10 17:42:06.579722 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.579704 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 17:42:06.585188 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.585170 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 17:42:06.592968 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.592949 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 17:42:06.628674 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.628638 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" event={"ID":"145e6792-a859-479b-bc58-7854beb96a71","Type":"ContainerStarted","Data":"b12bef89ee882e9038c075b778b62de5cf5969ee1a9b1ddf0cb0c1c30ea52e91"} Sep 10 17:42:06.628833 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.628697 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" event={"ID":"145e6792-a859-479b-bc58-7854beb96a71","Type":"ContainerStarted","Data":"b931ef041000ffbab53c2c8c0ec8dc121d03d157df575963fb3ca49162962820"} Sep 10 17:42:06.628833 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.628723 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" event={"ID":"145e6792-a859-479b-bc58-7854beb96a71","Type":"ContainerStarted","Data":"f83408958a017ae29169ed2b70042bc53e0699ed8e012f672eda7387a6e664c8"} Sep 10 17:42:06.629845 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.629821 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47pfd" event={"ID":"3744b8ba-3e7d-4860-b13c-500a2bfd1267","Type":"ContainerStarted","Data":"519f170b2eba934c83852b2b9b46cdd2676b41a7d4ba794ce295db72fee20343"} Sep 10 17:42:06.671398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671360 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671580 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671485 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671580 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671525 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671580 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671554 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671747 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671613 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-web-config\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671747 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671646 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671747 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671689 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671747 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671718 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-out\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671937 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671771 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmq9j\" (UniqueName: \"kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-kube-api-access-nmq9j\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671937 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671798 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671937 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671872 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671937 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671909 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.671937 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.671928 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773107 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.772956 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773107 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773002 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773331 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773029 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773400 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773356 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-web-config\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773453 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773397 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773453 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773426 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773549 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773459 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-out\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773549 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773499 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmq9j\" (UniqueName: \"kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-kube-api-access-nmq9j\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773549 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773539 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773687 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773605 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773687 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773667 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773700 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.773780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.773733 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.775239 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.775210 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.775960 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.775932 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.776600 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.776573 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.776747 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:42:06.776712 2570 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 10 17:42:06.776834 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:42:06.776782 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-main-tls podName:3cc07658-f2d3-4ca2-8a22-6523fe11813f nodeName:}" failed. No retries permitted until 2026-09-10 17:42:07.276761218 +0000 UTC m=+154.791797582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f") : secret "alertmanager-main-tls" not found Sep 10 17:42:06.777285 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.777260 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.777972 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.777944 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.779126 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.779075 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.779455 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.779408 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-out\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.782543 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.782502 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.782629 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.782571 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.783080 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.783021 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-web-config\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.784472 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.784379 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:06.785010 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:06.784985 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmq9j\" (UniqueName: \"kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-kube-api-access-nmq9j\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:07.278103 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:07.278075 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:07.280536 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:07.280514 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:07.487841 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:07.487807 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:42:07.637914 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:07.637877 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" event={"ID":"145e6792-a859-479b-bc58-7854beb96a71","Type":"ContainerStarted","Data":"e07eced1958b0cd940710c3f34dc8d89fd4f263577c963110dc4844550f42364"} Sep 10 17:42:07.639529 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:07.639500 2570 generic.go:356] "Generic (PLEG): container finished" podID="3744b8ba-3e7d-4860-b13c-500a2bfd1267" containerID="97c28e979cf692469e5e3b0b3e16bf6b0fb9f95965dde1c88c451cca9658a58f" exitCode=0 Sep 10 17:42:07.639647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:07.639552 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47pfd" event={"ID":"3744b8ba-3e7d-4860-b13c-500a2bfd1267","Type":"ContainerDied","Data":"97c28e979cf692469e5e3b0b3e16bf6b0fb9f95965dde1c88c451cca9658a58f"} Sep 10 17:42:07.655902 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:07.655858 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-kkjjs" podStartSLOduration=1.5915607029999999 podStartE2EDuration="2.655844181s" totalImagesPullingTime="1.064283478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:07.65516453 +0000 UTC m=+155.170200914" watchObservedRunningTime="2026-09-10 17:42:07.655844181 +0000 UTC m=+155.170880564" Sep 10 17:42:07.769139 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:07.769104 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 17:42:08.598786 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.598752 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk"] Sep 10 17:42:08.602664 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.602640 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.606015 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.605994 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 17:42:08.606775 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.606475 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 17:42:08.606775 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.606546 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 17:42:08.606775 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.606682 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 17:42:08.609549 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.609528 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l6qx8\"" Sep 10 17:42:08.611475 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.611455 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7a13jo1b9rtrf\"" Sep 10 17:42:08.611583 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.611546 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 17:42:08.624932 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.624909 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk"] Sep 10 17:42:08.646474 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.646442 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47pfd" event={"ID":"3744b8ba-3e7d-4860-b13c-500a2bfd1267","Type":"ContainerStarted","Data":"dd6120e74beda6a5ae0165c6ac7e939002d85fa0847c2ff755518b4af229bbd3"} Sep 10 17:42:08.646591 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.646512 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47pfd" event={"ID":"3744b8ba-3e7d-4860-b13c-500a2bfd1267","Type":"ContainerStarted","Data":"8c0422b6119ad95439c792994d7264405f096330d71d9f4b449ed0c2f53566c9"} Sep 10 17:42:08.647988 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.647963 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerStarted","Data":"dbebe6e6a4366ba867250d3cfb7493dd748dfeb6265b4bc59fe123f4ac1f784d"} Sep 10 17:42:08.685874 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.685807 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-47pfd" podStartSLOduration=2.211377816 podStartE2EDuration="3.685784339s" totalImagesPullingTime="1.410757998s" totalInitContainerRuntime="63.648525ms" isStatefulPod=true podCreationTimestamp="2026-09-10 17:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:08.685785791 +0000 UTC m=+156.200822178" watchObservedRunningTime="2026-09-10 17:42:08.685784339 +0000 UTC m=+156.200820724" Sep 10 17:42:08.689101 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.689061 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-tls\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.689225 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.689154 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.689225 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.689182 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-grpc-tls\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.689225 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.689212 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.689377 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.689263 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.689423 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.689371 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06460cf2-b39d-4bf8-9f40-1a0f900bc978-metrics-client-ca\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.689464 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.689417 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.689504 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.689467 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmf2k\" (UniqueName: \"kubernetes.io/projected/06460cf2-b39d-4bf8-9f40-1a0f900bc978-kube-api-access-zmf2k\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.790231 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.790190 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmf2k\" (UniqueName: \"kubernetes.io/projected/06460cf2-b39d-4bf8-9f40-1a0f900bc978-kube-api-access-zmf2k\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.790694 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.790530 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-tls\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.790694 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.790644 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.790694 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.790671 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-grpc-tls\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.790935 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.790724 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.790935 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.790755 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.790935 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.790838 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06460cf2-b39d-4bf8-9f40-1a0f900bc978-metrics-client-ca\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.790935 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.790875 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.791788 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.791609 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06460cf2-b39d-4bf8-9f40-1a0f900bc978-metrics-client-ca\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.793878 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.793826 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.793959 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.793927 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-tls\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.794591 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.794566 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.795428 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.795383 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.795903 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.795876 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.796005 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.795978 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06460cf2-b39d-4bf8-9f40-1a0f900bc978-secret-grpc-tls\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.799634 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.799592 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmf2k\" (UniqueName: \"kubernetes.io/projected/06460cf2-b39d-4bf8-9f40-1a0f900bc978-kube-api-access-zmf2k\") pod \"thanos-querier-57c9c9cbfd-wtrtk\" (UID: \"06460cf2-b39d-4bf8-9f40-1a0f900bc978\") " pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:08.914328 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:08.914246 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:09.210886 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:09.210807 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk"] Sep 10 17:42:09.215243 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:42:09.215212 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06460cf2_b39d_4bf8_9f40_1a0f900bc978.slice/crio-1b7935208940b8cbd67994a8c724cb4405b9d6bf091f616780eb7213be798461 WatchSource:0}: Error finding container 1b7935208940b8cbd67994a8c724cb4405b9d6bf091f616780eb7213be798461: Status 404 returned error can't find the container with id 1b7935208940b8cbd67994a8c724cb4405b9d6bf091f616780eb7213be798461 Sep 10 17:42:09.654725 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:09.654688 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" event={"ID":"06460cf2-b39d-4bf8-9f40-1a0f900bc978","Type":"ContainerStarted","Data":"1b7935208940b8cbd67994a8c724cb4405b9d6bf091f616780eb7213be798461"} Sep 10 17:42:09.656187 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:09.656159 2570 generic.go:356] "Generic (PLEG): container finished" podID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerID="b11f065074d14ec0c2396146f0b10959bf1ced21552ca45395c43077a6e609a0" exitCode=0 Sep 10 17:42:09.656299 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:09.656245 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerDied","Data":"b11f065074d14ec0c2396146f0b10959bf1ced21552ca45395c43077a6e609a0"} Sep 10 17:42:10.295418 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:42:10.295338 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" podUID="e1248d46-c973-472f-9f75-3da770fae4db" Sep 10 17:42:10.318496 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:42:10.318421 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2lk44" podUID="7a705cfa-eda8-4a74-aaf7-13d841013cd1" Sep 10 17:42:10.659701 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:10.659673 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2lk44" Sep 10 17:42:10.660079 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:10.659705 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:42:11.756297 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.754992 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:42:11.762692 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.760749 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.763895 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.763877 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 17:42:11.763974 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.763876 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kdhvf\"" Sep 10 17:42:11.764056 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.763994 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 17:42:11.764056 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.764046 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 17:42:11.764302 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.764286 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 17:42:11.766181 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.766161 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 17:42:11.766268 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.766247 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 17:42:11.766376 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.766357 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 17:42:11.766478 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.766458 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 17:42:11.766607 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.766580 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 17:42:11.766711 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.766650 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 17:42:11.766863 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.766845 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 17:42:11.766920 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.766856 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 17:42:11.766920 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.766876 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 17:42:11.766920 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.766898 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 17:42:11.773684 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.773647 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bnmj4i3ckusio\"" Sep 10 17:42:11.778537 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.778350 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 17:42:11.786750 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.786716 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:42:11.920734 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.920706 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.920851 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.920750 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.920851 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.920791 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.920851 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.920833 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921000 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.920860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921000 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.920905 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921000 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.920947 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6lp8\" (UniqueName: \"kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-kube-api-access-p6lp8\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921000 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.920990 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921010 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921072 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921102 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921148 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921175 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-config\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921205 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921530 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921237 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921530 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921263 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921530 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921286 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921530 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921308 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921530 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921357 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:11.921530 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:11.921381 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023009 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.022963 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023182 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023020 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023182 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023066 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023182 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023095 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023351 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023351 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023312 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023351 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023338 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023563 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023380 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023563 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023410 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023563 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023448 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023563 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023477 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023563 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023506 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023563 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023538 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023846 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023574 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6lp8\" (UniqueName: \"kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-kube-api-access-p6lp8\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023846 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023620 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023846 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023652 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023846 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023684 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023846 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023706 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023846 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023752 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.023846 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.023796 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-config\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.024199 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.024078 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.027816 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.024585 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.027816 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.025164 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.027816 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.026798 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.027816 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.026846 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.027816 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.026990 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.027816 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.027239 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.027816 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.027499 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.027816 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.027553 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.028364 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.028350 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.029349 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.029188 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.029349 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.029212 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.029349 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.029274 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.029910 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.029864 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.030178 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.030117 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.030178 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.030165 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-config\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.030433 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.030413 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.030880 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.030859 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.031061 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.031025 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.036448 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.036418 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6lp8\" (UniqueName: \"kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-kube-api-access-p6lp8\") pod \"prometheus-k8s-0\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.104839 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.104634 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:12.398406 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.398375 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:42:12.401902 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:42:12.401874 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53d4b01b_d6fc_4011_9f5a_4187428314a6.slice/crio-c540783d1f97386fecaa2dcef445a3b51c3cd67302de3350ce42da5ddc053d51 WatchSource:0}: Error finding container c540783d1f97386fecaa2dcef445a3b51c3cd67302de3350ce42da5ddc053d51: Status 404 returned error can't find the container with id c540783d1f97386fecaa2dcef445a3b51c3cd67302de3350ce42da5ddc053d51 Sep 10 17:42:12.673387 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.673289 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerStarted","Data":"04ac64d53986f28c7366646d26cd4f965a4fe1131b5d9beb82e4f84361375f46"} Sep 10 17:42:12.673387 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.673375 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerStarted","Data":"0e5350a270dee626f73a29817b5a9e58ba156266fc7ad915d22c8e5618515516"} Sep 10 17:42:12.673593 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.673419 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerStarted","Data":"fbe1137cc22457184cd85dbd31b65b84203af49e99acfe33284cf4615f19f84c"} Sep 10 17:42:12.673593 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.673467 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerStarted","Data":"d2e96e4e36364986b67470b5676da228aefaf7220bb90117c4cd72d41c81647e"} Sep 10 17:42:12.673593 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.673509 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerStarted","Data":"4cbaac737ca65fb6e4df2c1ff054c6f03a09565094db22f47a0a1fef6cb182d5"} Sep 10 17:42:12.675368 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.675338 2570 generic.go:356] "Generic (PLEG): container finished" podID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerID="428d59c71966d424f933a76f69b6c8bc1a9b314ac6c02895374d5087bcc1bc37" exitCode=0 Sep 10 17:42:12.675523 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.675427 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerDied","Data":"428d59c71966d424f933a76f69b6c8bc1a9b314ac6c02895374d5087bcc1bc37"} Sep 10 17:42:12.675523 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.675503 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerStarted","Data":"c540783d1f97386fecaa2dcef445a3b51c3cd67302de3350ce42da5ddc053d51"} Sep 10 17:42:12.678562 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.678532 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" event={"ID":"06460cf2-b39d-4bf8-9f40-1a0f900bc978","Type":"ContainerStarted","Data":"2bb0397708effb475efd31437e5e027ca2efe2aa28e0e0f11bdf0051ece3eb46"} Sep 10 17:42:12.678646 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.678612 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" event={"ID":"06460cf2-b39d-4bf8-9f40-1a0f900bc978","Type":"ContainerStarted","Data":"f416533e72c803be0c6ca8254fad241bc1ff03933128d7dfcc1754fc4f178ec5"} Sep 10 17:42:12.678699 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:12.678659 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" event={"ID":"06460cf2-b39d-4bf8-9f40-1a0f900bc978","Type":"ContainerStarted","Data":"7d1c9005508e34f534107e7a1b638ba8664701c39d5d7529b5127c5a3829bcf3"} Sep 10 17:42:13.685390 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:13.685353 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" event={"ID":"06460cf2-b39d-4bf8-9f40-1a0f900bc978","Type":"ContainerStarted","Data":"25ea8b183f3ef2360d26c7ef9e06a66792e50a9db22c6cc0a06fd63024141136"} Sep 10 17:42:13.685866 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:13.685426 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" event={"ID":"06460cf2-b39d-4bf8-9f40-1a0f900bc978","Type":"ContainerStarted","Data":"982b5e0c108a79a4cd61f606ff8b405a8efd1570cb8bf1fce39a76c6473c13ca"} Sep 10 17:42:13.685866 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:13.685469 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:13.685866 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:13.685500 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" event={"ID":"06460cf2-b39d-4bf8-9f40-1a0f900bc978","Type":"ContainerStarted","Data":"a08aeae430bdcd892be44658071001d4a823ef0e5552ca007f875332b7394b35"} Sep 10 17:42:13.688455 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:13.688430 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerStarted","Data":"206dee4e0cfb9212204666b1a2cd13cab40a595a8b1f00dfeee479d081005cbf"} Sep 10 17:42:13.714472 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:13.714429 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" podStartSLOduration=2.282235996 podStartE2EDuration="5.714413839s" totalImagesPullingTime="3.432177843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:13.711441193 +0000 UTC m=+161.226477593" watchObservedRunningTime="2026-09-10 17:42:13.714413839 +0000 UTC m=+161.229450257" Sep 10 17:42:13.742732 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:13.742682 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.677798456 podStartE2EDuration="7.742666091s" totalImagesPullingTime="4.05019304s" totalInitContainerRuntime="14.674595ms" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:13.740226952 +0000 UTC m=+161.255263338" watchObservedRunningTime="2026-09-10 17:42:13.742666091 +0000 UTC m=+161.257702474" Sep 10 17:42:15.253617 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:15.253576 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:42:15.254065 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:15.253642 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:42:15.256186 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:15.256161 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a705cfa-eda8-4a74-aaf7-13d841013cd1-metrics-tls\") pod \"dns-default-2lk44\" (UID: \"7a705cfa-eda8-4a74-aaf7-13d841013cd1\") " pod="openshift-dns/dns-default-2lk44" Sep 10 17:42:15.256303 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:15.256208 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"image-registry-595f6ddc88-44sqm\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:42:15.464372 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:15.464341 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dwwmp\"" Sep 10 17:42:15.464372 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:15.464341 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g6c28\"" Sep 10 17:42:15.470819 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:15.470797 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2lk44" Sep 10 17:42:15.470947 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:15.470889 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:42:16.705845 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:16.705810 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerStarted","Data":"9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27"} Sep 10 17:42:16.781281 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:16.781169 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2lk44"] Sep 10 17:42:16.785243 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:42:16.785210 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a705cfa_eda8_4a74_aaf7_13d841013cd1.slice/crio-63647fd17844b36fb63bc16070fa9def04c6e20ee8d3584deeb6411d2d69259e WatchSource:0}: Error finding container 63647fd17844b36fb63bc16070fa9def04c6e20ee8d3584deeb6411d2d69259e: Status 404 returned error can't find the container with id 63647fd17844b36fb63bc16070fa9def04c6e20ee8d3584deeb6411d2d69259e Sep 10 17:42:16.795334 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:16.792943 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-595f6ddc88-44sqm"] Sep 10 17:42:17.714949 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:17.714909 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerStarted","Data":"97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582"} Sep 10 17:42:17.715426 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:17.714996 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerStarted","Data":"96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4"} Sep 10 17:42:17.715426 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:17.715066 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerStarted","Data":"278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16"} Sep 10 17:42:17.715426 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:17.715108 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerStarted","Data":"a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0"} Sep 10 17:42:17.715426 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:17.715149 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerStarted","Data":"559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca"} Sep 10 17:42:17.717558 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:17.717524 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2lk44" event={"ID":"7a705cfa-eda8-4a74-aaf7-13d841013cd1","Type":"ContainerStarted","Data":"63647fd17844b36fb63bc16070fa9def04c6e20ee8d3584deeb6411d2d69259e"} Sep 10 17:42:17.719497 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:17.719468 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" event={"ID":"e1248d46-c973-472f-9f75-3da770fae4db","Type":"ContainerStarted","Data":"3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc"} Sep 10 17:42:17.719624 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:17.719513 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" event={"ID":"e1248d46-c973-472f-9f75-3da770fae4db","Type":"ContainerStarted","Data":"f5c05ba5714d2702128c453ebfa38a749ca8c964192f918a7c8eb3a8fa575d6f"} Sep 10 17:42:17.719624 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:17.719542 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:42:17.751819 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:17.751747 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.847696447 podStartE2EDuration="6.751725657s" totalImagesPullingTime="3.885210856s" totalInitContainerRuntime="18.818354ms" isStatefulPod=false podCreationTimestamp="2026-09-10 17:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:17.749371239 +0000 UTC m=+165.264407628" watchObservedRunningTime="2026-09-10 17:42:17.751725657 +0000 UTC m=+165.266762042" Sep 10 17:42:17.776956 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:17.776898 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" podStartSLOduration=163.776880682 podStartE2EDuration="2m43.776880682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:17.775841045 +0000 UTC m=+165.290877442" watchObservedRunningTime="2026-09-10 17:42:17.776880682 +0000 UTC m=+165.291917066" Sep 10 17:42:18.725027 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:18.724999 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2lk44" event={"ID":"7a705cfa-eda8-4a74-aaf7-13d841013cd1","Type":"ContainerStarted","Data":"d49473b9339b2d12e7d41321da8923fe4ebdc82ebb65ebe3fe557352eff8b7fd"} Sep 10 17:42:19.072230 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:19.072198 2570 scope.go:117] "RemoveContainer" containerID="3b57f3532d8654f69a51c40c6993f7f903baafafa02fa40bbe3f05282decd454" Sep 10 17:42:19.698945 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:19.698908 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-57c9c9cbfd-wtrtk" Sep 10 17:42:19.732088 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:19.732056 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2lk44" event={"ID":"7a705cfa-eda8-4a74-aaf7-13d841013cd1","Type":"ContainerStarted","Data":"edfd5c5f82950f3be0f9c4cf42fb77ffee057bc4c827761028e15bd4eb9a079e"} Sep 10 17:42:19.732503 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:19.732198 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2lk44" Sep 10 17:42:19.734368 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:19.734349 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/2.log" Sep 10 17:42:19.734469 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:19.734398 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" event={"ID":"39f4aec9-3e3a-49e2-8060-ffeb540d24c9","Type":"ContainerStarted","Data":"b59368ac0843e0ef5f99027dc1b04c4cbf410224643b82060085ff83af05c9e2"} Sep 10 17:42:19.734650 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:19.734627 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:42:19.751331 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:19.751274 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2lk44" podStartSLOduration=130.993382144 podStartE2EDuration="2m12.751260859s" totalImagesPullingTime="1.757878715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:19.749464616 +0000 UTC m=+167.264501010" watchObservedRunningTime="2026-09-10 17:42:19.751260859 +0000 UTC m=+167.266297243" Sep 10 17:42:19.770607 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:19.770559 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" podStartSLOduration=56.796727403 podStartE2EDuration="58.77054392s" totalImagesPullingTime="1.973816517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:42:19.768876737 +0000 UTC m=+167.283913127" watchObservedRunningTime="2026-09-10 17:42:19.77054392 +0000 UTC m=+167.285580304" Sep 10 17:42:20.591094 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:20.591064 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-vbm6f" Sep 10 17:42:22.105772 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:22.105729 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:42:29.741228 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:29.741157 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2lk44" Sep 10 17:42:35.476955 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:35.476907 2570 patch_prober.go:28] interesting pod/image-registry-595f6ddc88-44sqm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 17:42:35.477353 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:35.476980 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" podUID="e1248d46-c973-472f-9f75-3da770fae4db" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 17:42:38.730097 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:38.730064 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:42:39.555694 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:39.555659 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-595f6ddc88-44sqm"] Sep 10 17:42:56.581122 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:42:56.581092 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bzbb4_6bcbcb13-44db-4895-9524-6822c3d50baa/serve-healthcheck-canary/0.log" Sep 10 17:43:04.575147 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:04.575101 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" podUID="e1248d46-c973-472f-9f75-3da770fae4db" containerName="registry" containerID="cri-o://3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc" gracePeriod=30 Sep 10 17:43:05.810962 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.810940 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:43:05.889894 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.889857 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-installation-pull-secrets\") pod \"e1248d46-c973-472f-9f75-3da770fae4db\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " Sep 10 17:43:05.890091 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.889898 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-trusted-ca\") pod \"e1248d46-c973-472f-9f75-3da770fae4db\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " Sep 10 17:43:05.890091 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.890075 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") pod \"e1248d46-c973-472f-9f75-3da770fae4db\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " Sep 10 17:43:05.890220 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.890127 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-image-registry-private-configuration\") pod \"e1248d46-c973-472f-9f75-3da770fae4db\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " Sep 10 17:43:05.890220 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.890153 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-bound-sa-token\") pod \"e1248d46-c973-472f-9f75-3da770fae4db\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " Sep 10 17:43:05.890220 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.890184 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1248d46-c973-472f-9f75-3da770fae4db-ca-trust-extracted\") pod \"e1248d46-c973-472f-9f75-3da770fae4db\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " Sep 10 17:43:05.890220 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.890209 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-registry-certificates\") pod \"e1248d46-c973-472f-9f75-3da770fae4db\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " Sep 10 17:43:05.890459 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.890431 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e1248d46-c973-472f-9f75-3da770fae4db" (UID: "e1248d46-c973-472f-9f75-3da770fae4db"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:43:05.890552 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.890524 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-trusted-ca\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:05.890800 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.890671 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e1248d46-c973-472f-9f75-3da770fae4db" (UID: "e1248d46-c973-472f-9f75-3da770fae4db"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:43:05.892815 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.892765 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e1248d46-c973-472f-9f75-3da770fae4db" (UID: "e1248d46-c973-472f-9f75-3da770fae4db"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:05.892943 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.892837 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e1248d46-c973-472f-9f75-3da770fae4db" (UID: "e1248d46-c973-472f-9f75-3da770fae4db"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:43:05.892943 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.892881 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e1248d46-c973-472f-9f75-3da770fae4db" (UID: "e1248d46-c973-472f-9f75-3da770fae4db"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:05.893163 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.893137 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e1248d46-c973-472f-9f75-3da770fae4db" (UID: "e1248d46-c973-472f-9f75-3da770fae4db"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:43:05.898944 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.898919 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1248d46-c973-472f-9f75-3da770fae4db-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e1248d46-c973-472f-9f75-3da770fae4db" (UID: "e1248d46-c973-472f-9f75-3da770fae4db"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:43:05.922968 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.922938 2570 generic.go:356] "Generic (PLEG): container finished" podID="e1248d46-c973-472f-9f75-3da770fae4db" containerID="3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc" exitCode=0 Sep 10 17:43:05.923120 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.922981 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" Sep 10 17:43:05.923120 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.923018 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" event={"ID":"e1248d46-c973-472f-9f75-3da770fae4db","Type":"ContainerDied","Data":"3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc"} Sep 10 17:43:05.923120 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.923085 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595f6ddc88-44sqm" event={"ID":"e1248d46-c973-472f-9f75-3da770fae4db","Type":"ContainerDied","Data":"f5c05ba5714d2702128c453ebfa38a749ca8c964192f918a7c8eb3a8fa575d6f"} Sep 10 17:43:05.923120 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.923112 2570 scope.go:117] "RemoveContainer" containerID="3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc" Sep 10 17:43:05.930944 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.930928 2570 scope.go:117] "RemoveContainer" containerID="3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc" Sep 10 17:43:05.931230 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:43:05.931210 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc\": container with ID starting with 3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc not found: ID does not exist" containerID="3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc" Sep 10 17:43:05.931277 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.931239 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc"} err="failed to get container status \"3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc\": rpc error: code = NotFound desc = could not find container \"3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc\": container with ID starting with 3d7968441ea114ca39c97195829cfa6d526ae4ec728c1eca55d92896b54d52dc not found: ID does not exist" Sep 10 17:43:05.991588 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.991556 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f2nx\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-kube-api-access-6f2nx\") pod \"e1248d46-c973-472f-9f75-3da770fae4db\" (UID: \"e1248d46-c973-472f-9f75-3da770fae4db\") " Sep 10 17:43:05.991734 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.991723 2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-registry-tls\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:05.991774 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.991736 2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-image-registry-private-configuration\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:05.991774 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.991747 2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-bound-sa-token\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:05.991774 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.991756 2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1248d46-c973-472f-9f75-3da770fae4db-ca-trust-extracted\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:05.991774 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.991764 2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1248d46-c973-472f-9f75-3da770fae4db-registry-certificates\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:05.991774 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.991773 2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1248d46-c973-472f-9f75-3da770fae4db-installation-pull-secrets\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:05.993606 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:05.993582 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-kube-api-access-6f2nx" (OuterVolumeSpecName: "kube-api-access-6f2nx") pod "e1248d46-c973-472f-9f75-3da770fae4db" (UID: "e1248d46-c973-472f-9f75-3da770fae4db"). InnerVolumeSpecName "kube-api-access-6f2nx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:43:06.092276 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:06.092237 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f2nx\" (UniqueName: \"kubernetes.io/projected/e1248d46-c973-472f-9f75-3da770fae4db-kube-api-access-6f2nx\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:06.245088 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:06.245058 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-595f6ddc88-44sqm"] Sep 10 17:43:06.250370 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:06.250346 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-595f6ddc88-44sqm"] Sep 10 17:43:07.082258 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:07.082225 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1248d46-c973-472f-9f75-3da770fae4db" path="/var/lib/kubelet/pods/e1248d46-c973-472f-9f75-3da770fae4db/volumes" Sep 10 17:43:12.105315 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:12.105281 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:12.124315 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:12.124284 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:12.967998 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:12.967970 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:25.830186 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:25.830138 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 17:43:25.830650 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:25.830496 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="alertmanager" containerID="cri-o://4cbaac737ca65fb6e4df2c1ff054c6f03a09565094db22f47a0a1fef6cb182d5" gracePeriod=120 Sep 10 17:43:25.831832 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:25.830798 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy" containerID="cri-o://0e5350a270dee626f73a29817b5a9e58ba156266fc7ad915d22c8e5618515516" gracePeriod=120 Sep 10 17:43:25.831832 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:25.830875 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy-web" containerID="cri-o://fbe1137cc22457184cd85dbd31b65b84203af49e99acfe33284cf4615f19f84c" gracePeriod=120 Sep 10 17:43:25.831832 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:25.830979 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="prom-label-proxy" containerID="cri-o://206dee4e0cfb9212204666b1a2cd13cab40a595a8b1f00dfeee479d081005cbf" gracePeriod=120 Sep 10 17:43:25.831832 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:25.830997 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="config-reloader" containerID="cri-o://d2e96e4e36364986b67470b5676da228aefaf7220bb90117c4cd72d41c81647e" gracePeriod=120 Sep 10 17:43:25.831832 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:25.831110 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy-metric" containerID="cri-o://04ac64d53986f28c7366646d26cd4f965a4fe1131b5d9beb82e4f84361375f46" gracePeriod=120 Sep 10 17:43:26.008023 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:26.007987 2570 generic.go:356] "Generic (PLEG): container finished" podID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerID="206dee4e0cfb9212204666b1a2cd13cab40a595a8b1f00dfeee479d081005cbf" exitCode=0 Sep 10 17:43:26.008023 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:26.008012 2570 generic.go:356] "Generic (PLEG): container finished" podID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerID="0e5350a270dee626f73a29817b5a9e58ba156266fc7ad915d22c8e5618515516" exitCode=0 Sep 10 17:43:26.008023 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:26.008019 2570 generic.go:356] "Generic (PLEG): container finished" podID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerID="d2e96e4e36364986b67470b5676da228aefaf7220bb90117c4cd72d41c81647e" exitCode=0 Sep 10 17:43:26.008023 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:26.008025 2570 generic.go:356] "Generic (PLEG): container finished" podID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerID="4cbaac737ca65fb6e4df2c1ff054c6f03a09565094db22f47a0a1fef6cb182d5" exitCode=0 Sep 10 17:43:26.008336 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:26.008064 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerDied","Data":"206dee4e0cfb9212204666b1a2cd13cab40a595a8b1f00dfeee479d081005cbf"} Sep 10 17:43:26.008336 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:26.008148 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerDied","Data":"0e5350a270dee626f73a29817b5a9e58ba156266fc7ad915d22c8e5618515516"} Sep 10 17:43:26.008336 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:26.008188 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerDied","Data":"d2e96e4e36364986b67470b5676da228aefaf7220bb90117c4cd72d41c81647e"} Sep 10 17:43:26.008336 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:26.008223 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerDied","Data":"4cbaac737ca65fb6e4df2c1ff054c6f03a09565094db22f47a0a1fef6cb182d5"} Sep 10 17:43:27.016917 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.016887 2570 generic.go:356] "Generic (PLEG): container finished" podID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerID="04ac64d53986f28c7366646d26cd4f965a4fe1131b5d9beb82e4f84361375f46" exitCode=0 Sep 10 17:43:27.016917 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.016912 2570 generic.go:356] "Generic (PLEG): container finished" podID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerID="fbe1137cc22457184cd85dbd31b65b84203af49e99acfe33284cf4615f19f84c" exitCode=0 Sep 10 17:43:27.017308 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.016956 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerDied","Data":"04ac64d53986f28c7366646d26cd4f965a4fe1131b5d9beb82e4f84361375f46"} Sep 10 17:43:27.017308 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.017019 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerDied","Data":"fbe1137cc22457184cd85dbd31b65b84203af49e99acfe33284cf4615f19f84c"} Sep 10 17:43:27.084507 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.084486 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:27.167790 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.167711 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-tls-assets\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.167790 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.167747 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.167790 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.167773 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-web\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.168067 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.167801 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.168067 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.167825 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-volume\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.168067 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.167883 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmq9j\" (UniqueName: \"kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-kube-api-access-nmq9j\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.168067 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.167907 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-main-db\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.168067 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.167941 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-cluster-tls-config\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.168067 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.167967 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-web-config\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.168067 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.167990 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-trusted-ca-bundle\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.168398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.168077 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-out\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.168398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.168106 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-main-tls\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.168398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.168140 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-metrics-client-ca\") pod \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\" (UID: \"3cc07658-f2d3-4ca2-8a22-6523fe11813f\") " Sep 10 17:43:27.168871 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.168839 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:43:27.170629 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.170598 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:27.171494 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.170873 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:27.171494 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.171017 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:43:27.171494 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.171189 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:43:27.171494 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.171208 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:43:27.171494 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.171306 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:27.171809 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.171732 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-volume" (OuterVolumeSpecName: "config-volume") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:27.172242 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.172216 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:27.172351 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.172320 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-out" (OuterVolumeSpecName: "config-out") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:43:27.173226 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.173202 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-kube-api-access-nmq9j" (OuterVolumeSpecName: "kube-api-access-nmq9j") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "kube-api-access-nmq9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:43:27.176495 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.176424 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:27.181462 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.181440 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-web-config" (OuterVolumeSpecName: "web-config") pod "3cc07658-f2d3-4ca2-8a22-6523fe11813f" (UID: "3cc07658-f2d3-4ca2-8a22-6523fe11813f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:27.269490 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269455 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-tls-assets\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269490 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269483 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269490 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269493 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269502 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269511 2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-volume\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269520 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmq9j\" (UniqueName: \"kubernetes.io/projected/3cc07658-f2d3-4ca2-8a22-6523fe11813f-kube-api-access-nmq9j\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269528 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-main-db\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269535 2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-cluster-tls-config\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269543 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-web-config\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269551 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269558 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cc07658-f2d3-4ca2-8a22-6523fe11813f-config-out\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269566 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cc07658-f2d3-4ca2-8a22-6523fe11813f-secret-alertmanager-main-tls\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:27.269709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:27.269574 2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cc07658-f2d3-4ca2-8a22-6523fe11813f-metrics-client-ca\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:28.024576 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.024537 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cc07658-f2d3-4ca2-8a22-6523fe11813f","Type":"ContainerDied","Data":"dbebe6e6a4366ba867250d3cfb7493dd748dfeb6265b4bc59fe123f4ac1f784d"} Sep 10 17:43:28.025089 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.024584 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.025089 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.024650 2570 scope.go:117] "RemoveContainer" containerID="206dee4e0cfb9212204666b1a2cd13cab40a595a8b1f00dfeee479d081005cbf" Sep 10 17:43:28.033202 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.033184 2570 scope.go:117] "RemoveContainer" containerID="04ac64d53986f28c7366646d26cd4f965a4fe1131b5d9beb82e4f84361375f46" Sep 10 17:43:28.040199 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.040181 2570 scope.go:117] "RemoveContainer" containerID="0e5350a270dee626f73a29817b5a9e58ba156266fc7ad915d22c8e5618515516" Sep 10 17:43:28.046563 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.046546 2570 scope.go:117] "RemoveContainer" containerID="fbe1137cc22457184cd85dbd31b65b84203af49e99acfe33284cf4615f19f84c" Sep 10 17:43:28.050601 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.050571 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 17:43:28.054784 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.054535 2570 scope.go:117] "RemoveContainer" containerID="d2e96e4e36364986b67470b5676da228aefaf7220bb90117c4cd72d41c81647e" Sep 10 17:43:28.054991 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.054972 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 17:43:28.062077 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.062055 2570 scope.go:117] "RemoveContainer" containerID="4cbaac737ca65fb6e4df2c1ff054c6f03a09565094db22f47a0a1fef6cb182d5" Sep 10 17:43:28.069148 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.069126 2570 scope.go:117] "RemoveContainer" containerID="b11f065074d14ec0c2396146f0b10959bf1ced21552ca45395c43077a6e609a0" Sep 10 17:43:28.085134 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085111 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 17:43:28.085427 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085414 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy-metric" Sep 10 17:43:28.085472 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085429 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy-metric" Sep 10 17:43:28.085472 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085440 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="config-reloader" Sep 10 17:43:28.085472 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085446 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="config-reloader" Sep 10 17:43:28.085472 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085455 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy-web" Sep 10 17:43:28.085472 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085464 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy-web" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085477 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1248d46-c973-472f-9f75-3da770fae4db" containerName="registry" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085483 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1248d46-c973-472f-9f75-3da770fae4db" containerName="registry" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085492 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085497 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085503 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="prom-label-proxy" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085509 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="prom-label-proxy" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085516 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="init-config-reloader" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085521 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="init-config-reloader" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085531 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="alertmanager" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085537 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="alertmanager" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085593 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085602 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1248d46-c973-472f-9f75-3da770fae4db" containerName="registry" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085608 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="config-reloader" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085614 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy-metric" Sep 10 17:43:28.085619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085623 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="alertmanager" Sep 10 17:43:28.086029 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085631 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="prom-label-proxy" Sep 10 17:43:28.086029 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.085638 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" containerName="kube-rbac-proxy-web" Sep 10 17:43:28.091046 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.091019 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.093616 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.093597 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 17:43:28.093705 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.093598 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 17:43:28.093828 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.093808 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 17:43:28.093977 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.093916 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 17:43:28.093977 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.093942 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 17:43:28.094125 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.094055 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 17:43:28.094125 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.094087 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 17:43:28.094125 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.094116 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 17:43:28.094270 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.094148 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4ggxc\"" Sep 10 17:43:28.099963 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.099945 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 17:43:28.107428 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.107408 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 17:43:28.176234 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176138 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176234 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176193 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176234 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176226 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176531 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176261 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176531 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176315 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176531 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176404 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f326620f-806f-4f42-b1df-5eb7b0ff2487-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176531 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176443 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f326620f-806f-4f42-b1df-5eb7b0ff2487-config-out\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176531 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176478 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5d5b\" (UniqueName: \"kubernetes.io/projected/f326620f-806f-4f42-b1df-5eb7b0ff2487-kube-api-access-j5d5b\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176531 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176510 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f326620f-806f-4f42-b1df-5eb7b0ff2487-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176827 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176587 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-web-config\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176827 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176649 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f326620f-806f-4f42-b1df-5eb7b0ff2487-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176827 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176686 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-config-volume\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.176827 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.176718 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f326620f-806f-4f42-b1df-5eb7b0ff2487-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277185 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277143 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277185 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277188 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277442 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277210 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277442 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277239 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277442 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277267 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277442 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277299 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f326620f-806f-4f42-b1df-5eb7b0ff2487-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277442 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277327 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f326620f-806f-4f42-b1df-5eb7b0ff2487-config-out\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277740 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277451 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5d5b\" (UniqueName: \"kubernetes.io/projected/f326620f-806f-4f42-b1df-5eb7b0ff2487-kube-api-access-j5d5b\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277740 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277482 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f326620f-806f-4f42-b1df-5eb7b0ff2487-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277740 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277520 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-web-config\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277740 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277559 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f326620f-806f-4f42-b1df-5eb7b0ff2487-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277740 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277587 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-config-volume\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.277740 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.277622 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f326620f-806f-4f42-b1df-5eb7b0ff2487-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.278637 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.278349 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f326620f-806f-4f42-b1df-5eb7b0ff2487-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.279429 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.279401 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f326620f-806f-4f42-b1df-5eb7b0ff2487-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.280132 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.280107 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f326620f-806f-4f42-b1df-5eb7b0ff2487-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.280374 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.280324 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-web-config\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.280374 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.280365 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.280520 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.280436 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.280574 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.280550 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f326620f-806f-4f42-b1df-5eb7b0ff2487-config-out\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.280747 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.280729 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.281319 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.281299 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-config-volume\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.281518 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.281486 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.281792 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.281773 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f326620f-806f-4f42-b1df-5eb7b0ff2487-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.281936 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.281916 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f326620f-806f-4f42-b1df-5eb7b0ff2487-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.288433 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.288408 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5d5b\" (UniqueName: \"kubernetes.io/projected/f326620f-806f-4f42-b1df-5eb7b0ff2487-kube-api-access-j5d5b\") pod \"alertmanager-main-0\" (UID: \"f326620f-806f-4f42-b1df-5eb7b0ff2487\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.400764 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.400705 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 17:43:28.682730 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:28.682701 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 17:43:28.685167 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:43:28.685137 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf326620f_806f_4f42_b1df_5eb7b0ff2487.slice/crio-56de7e57b499fb667dcbc2ac275eea647aa23798d03a345759a432ba58492e26 WatchSource:0}: Error finding container 56de7e57b499fb667dcbc2ac275eea647aa23798d03a345759a432ba58492e26: Status 404 returned error can't find the container with id 56de7e57b499fb667dcbc2ac275eea647aa23798d03a345759a432ba58492e26 Sep 10 17:43:29.030286 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:29.030194 2570 generic.go:356] "Generic (PLEG): container finished" podID="f326620f-806f-4f42-b1df-5eb7b0ff2487" containerID="b8187eafc03f946498073714d02118ca997046e4a1c9238ed94a96f1dc52ee01" exitCode=0 Sep 10 17:43:29.030703 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:29.030280 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f326620f-806f-4f42-b1df-5eb7b0ff2487","Type":"ContainerDied","Data":"b8187eafc03f946498073714d02118ca997046e4a1c9238ed94a96f1dc52ee01"} Sep 10 17:43:29.030703 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:29.030357 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f326620f-806f-4f42-b1df-5eb7b0ff2487","Type":"ContainerStarted","Data":"56de7e57b499fb667dcbc2ac275eea647aa23798d03a345759a432ba58492e26"} Sep 10 17:43:29.079220 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:29.079191 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cc07658-f2d3-4ca2-8a22-6523fe11813f" path="/var/lib/kubelet/pods/3cc07658-f2d3-4ca2-8a22-6523fe11813f/volumes" Sep 10 17:43:30.040051 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.040008 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f326620f-806f-4f42-b1df-5eb7b0ff2487","Type":"ContainerStarted","Data":"52bff7dc2d5d1970e0b81b52ab12ccdbf195e8c66c91e07be06cb4f63422f844"} Sep 10 17:43:30.040489 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.040126 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f326620f-806f-4f42-b1df-5eb7b0ff2487","Type":"ContainerStarted","Data":"f04c9f1f964cb1596f09e4731466b876c0dae105e46a8b6bccdd89abda08bad2"} Sep 10 17:43:30.040489 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.040156 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f326620f-806f-4f42-b1df-5eb7b0ff2487","Type":"ContainerStarted","Data":"da520e18fc69299030ff4d4757f28d52e5a1a2758c42fd8042f4485e7187ff8f"} Sep 10 17:43:30.040489 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.040179 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f326620f-806f-4f42-b1df-5eb7b0ff2487","Type":"ContainerStarted","Data":"2b33dc9c4c7010c55a988245c229f07e749791786c1b34d171e2b97ea805faad"} Sep 10 17:43:30.040489 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.040201 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f326620f-806f-4f42-b1df-5eb7b0ff2487","Type":"ContainerStarted","Data":"23e6a0ab2dca15f0ec51f2081abcd27d3a7e50367725eaa911ecec7cbbc41119"} Sep 10 17:43:30.040489 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.040222 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f326620f-806f-4f42-b1df-5eb7b0ff2487","Type":"ContainerStarted","Data":"63880f5d55fbefe779a3a954890fcbec01eedb3d268a9a2b8d5bf949a700afb7"} Sep 10 17:43:30.092886 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.092828 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.078174847 podStartE2EDuration="2.092811776s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.636929ms" isStatefulPod=false podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:30.085124141 +0000 UTC m=+237.600160525" watchObservedRunningTime="2026-09-10 17:43:30.092811776 +0000 UTC m=+237.607848201" Sep 10 17:43:30.229853 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.229815 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:43:30.232110 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.230510 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582" gracePeriod=600 Sep 10 17:43:30.232110 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.231119 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy-web" containerID="cri-o://278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16" gracePeriod=600 Sep 10 17:43:30.232110 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.231254 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy" containerID="cri-o://96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4" gracePeriod=600 Sep 10 17:43:30.232110 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.231360 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="thanos-sidecar" containerID="cri-o://a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0" gracePeriod=600 Sep 10 17:43:30.232110 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.231456 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="config-reloader" containerID="cri-o://559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca" gracePeriod=600 Sep 10 17:43:30.232110 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:30.231625 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="prometheus" containerID="cri-o://9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27" gracePeriod=600 Sep 10 17:43:31.048112 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.048079 2570 generic.go:356] "Generic (PLEG): container finished" podID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerID="97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582" exitCode=0 Sep 10 17:43:31.048112 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.048105 2570 generic.go:356] "Generic (PLEG): container finished" podID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerID="96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4" exitCode=0 Sep 10 17:43:31.048112 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.048113 2570 generic.go:356] "Generic (PLEG): container finished" podID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerID="a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0" exitCode=0 Sep 10 17:43:31.048112 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.048121 2570 generic.go:356] "Generic (PLEG): container finished" podID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerID="559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca" exitCode=0 Sep 10 17:43:31.048694 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.048128 2570 generic.go:356] "Generic (PLEG): container finished" podID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerID="9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27" exitCode=0 Sep 10 17:43:31.048694 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.048147 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerDied","Data":"97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582"} Sep 10 17:43:31.048694 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.048215 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerDied","Data":"96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4"} Sep 10 17:43:31.048694 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.048242 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerDied","Data":"a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0"} Sep 10 17:43:31.048694 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.048266 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerDied","Data":"559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca"} Sep 10 17:43:31.048694 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.048290 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerDied","Data":"9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27"} Sep 10 17:43:31.482140 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.482116 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:31.607062 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.606965 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-metrics-client-ca\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.607062 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.606998 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-2\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.607062 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607022 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-0\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.607262 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607074 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-db\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.607262 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607236 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-tls\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.607350 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607283 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-1\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.607350 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607317 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-thanos-prometheus-http-client-file\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.607433 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607357 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-config\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.607433 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607376 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:43:31.607433 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607388 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.607433 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607424 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-web-config\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607449 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-tls-assets\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607479 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6lp8\" (UniqueName: \"kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-kube-api-access-p6lp8\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607512 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-serving-certs-ca-bundle\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607526 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607540 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-grpc-tls\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607565 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-kubelet-serving-ca-bundle\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607601 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-config-out\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607623 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-kube-rbac-proxy\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607638 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607648 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607704 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-trusted-ca-bundle\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.608026 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.607771 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-metrics-client-certs\") pod \"53d4b01b-d6fc-4011-9f5a-4187428314a6\" (UID: \"53d4b01b-d6fc-4011-9f5a-4187428314a6\") " Sep 10 17:43:31.608695 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.608077 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.608695 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.608097 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-metrics-client-ca\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.608695 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.608111 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.610562 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.609099 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:43:31.610562 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.609207 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:43:31.610562 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.609346 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:43:31.610562 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.610140 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:43:31.610562 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.610448 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:31.610562 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.610515 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:43:31.610947 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.610575 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:43:31.611135 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.611101 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:31.611275 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.611247 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:31.611816 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.611718 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:31.611816 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.611758 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-config" (OuterVolumeSpecName: "config") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:31.612052 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.611833 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:31.612188 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.612160 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:31.612385 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.612351 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:31.612500 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.612400 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-config-out" (OuterVolumeSpecName: "config-out") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:43:31.613089 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.613070 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-kube-api-access-p6lp8" (OuterVolumeSpecName: "kube-api-access-p6lp8") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "kube-api-access-p6lp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:43:31.622743 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.622719 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-web-config" (OuterVolumeSpecName: "web-config") pod "53d4b01b-d6fc-4011-9f5a-4187428314a6" (UID: "53d4b01b-d6fc-4011-9f5a-4187428314a6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:43:31.708596 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708562 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-config-out\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708596 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708594 2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-kube-rbac-proxy\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708612 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708627 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708642 2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-metrics-client-certs\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708656 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708670 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/53d4b01b-d6fc-4011-9f5a-4187428314a6-prometheus-k8s-db\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708683 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708697 2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708710 2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-config\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708723 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708737 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-web-config\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708749 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-tls-assets\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708760 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6lp8\" (UniqueName: \"kubernetes.io/projected/53d4b01b-d6fc-4011-9f5a-4187428314a6-kube-api-access-p6lp8\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708772 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.708780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708785 2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53d4b01b-d6fc-4011-9f5a-4187428314a6-secret-grpc-tls\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:31.709248 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:31.708798 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d4b01b-d6fc-4011-9f5a-4187428314a6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-62.ec2.internal\" DevicePath \"\"" Sep 10 17:43:32.055664 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.055624 2570 generic.go:356] "Generic (PLEG): container finished" podID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerID="278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16" exitCode=0 Sep 10 17:43:32.056007 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.055699 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerDied","Data":"278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16"} Sep 10 17:43:32.056007 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.055715 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.056007 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.055765 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"53d4b01b-d6fc-4011-9f5a-4187428314a6","Type":"ContainerDied","Data":"c540783d1f97386fecaa2dcef445a3b51c3cd67302de3350ce42da5ddc053d51"} Sep 10 17:43:32.056007 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.055798 2570 scope.go:117] "RemoveContainer" containerID="97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582" Sep 10 17:43:32.064397 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.064373 2570 scope.go:117] "RemoveContainer" containerID="96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4" Sep 10 17:43:32.072532 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.072506 2570 scope.go:117] "RemoveContainer" containerID="278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16" Sep 10 17:43:32.080685 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.080668 2570 scope.go:117] "RemoveContainer" containerID="a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0" Sep 10 17:43:32.082485 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.082455 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:43:32.087438 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.087415 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:43:32.088815 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.088794 2570 scope.go:117] "RemoveContainer" containerID="559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca" Sep 10 17:43:32.095629 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.095613 2570 scope.go:117] "RemoveContainer" containerID="9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27" Sep 10 17:43:32.102840 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.102818 2570 scope.go:117] "RemoveContainer" containerID="428d59c71966d424f933a76f69b6c8bc1a9b314ac6c02895374d5087bcc1bc37" Sep 10 17:43:32.109631 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.109614 2570 scope.go:117] "RemoveContainer" containerID="97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582" Sep 10 17:43:32.109893 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:43:32.109875 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582\": container with ID starting with 97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582 not found: ID does not exist" containerID="97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582" Sep 10 17:43:32.109945 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.109902 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582"} err="failed to get container status \"97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582\": rpc error: code = NotFound desc = could not find container \"97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582\": container with ID starting with 97264a38b26c0d8ccd3a46d3d28daf33ae2e10b66fd555b50d06dd99446da582 not found: ID does not exist" Sep 10 17:43:32.109945 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.109921 2570 scope.go:117] "RemoveContainer" containerID="96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4" Sep 10 17:43:32.110225 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:43:32.110206 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4\": container with ID starting with 96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4 not found: ID does not exist" containerID="96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4" Sep 10 17:43:32.110296 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.110234 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4"} err="failed to get container status \"96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4\": rpc error: code = NotFound desc = could not find container \"96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4\": container with ID starting with 96996ab620cd7973e0b9ccb947dcd39399e510b12992cdcae54c6ae4abb494d4 not found: ID does not exist" Sep 10 17:43:32.110296 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.110257 2570 scope.go:117] "RemoveContainer" containerID="278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16" Sep 10 17:43:32.110502 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:43:32.110487 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16\": container with ID starting with 278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16 not found: ID does not exist" containerID="278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16" Sep 10 17:43:32.110556 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.110509 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16"} err="failed to get container status \"278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16\": rpc error: code = NotFound desc = could not find container \"278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16\": container with ID starting with 278c66b7026b85a2644d8538bb612b83d70c798de3cfd19cddf5f10fbcfc5a16 not found: ID does not exist" Sep 10 17:43:32.110556 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.110530 2570 scope.go:117] "RemoveContainer" containerID="a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0" Sep 10 17:43:32.110764 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:43:32.110749 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0\": container with ID starting with a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0 not found: ID does not exist" containerID="a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0" Sep 10 17:43:32.110807 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.110767 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0"} err="failed to get container status \"a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0\": rpc error: code = NotFound desc = could not find container \"a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0\": container with ID starting with a9840871b64a867a1bac58ae80883a84fb24d1d7d9812aa31dae132acef746e0 not found: ID does not exist" Sep 10 17:43:32.110807 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.110780 2570 scope.go:117] "RemoveContainer" containerID="559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca" Sep 10 17:43:32.110980 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:43:32.110963 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca\": container with ID starting with 559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca not found: ID does not exist" containerID="559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca" Sep 10 17:43:32.111100 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.110980 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca"} err="failed to get container status \"559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca\": rpc error: code = NotFound desc = could not find container \"559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca\": container with ID starting with 559e6ad8960ea7de97109fdd4835bfb01868200134721e099b313144b253a7ca not found: ID does not exist" Sep 10 17:43:32.111100 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.110991 2570 scope.go:117] "RemoveContainer" containerID="9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27" Sep 10 17:43:32.111219 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:43:32.111197 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27\": container with ID starting with 9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27 not found: ID does not exist" containerID="9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27" Sep 10 17:43:32.111253 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.111226 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27"} err="failed to get container status \"9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27\": rpc error: code = NotFound desc = could not find container \"9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27\": container with ID starting with 9e26e1828bfa82b29b1b4d9115ff1804cd9052c0dc3a168f5c7ee88a7e0f0c27 not found: ID does not exist" Sep 10 17:43:32.111253 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.111240 2570 scope.go:117] "RemoveContainer" containerID="428d59c71966d424f933a76f69b6c8bc1a9b314ac6c02895374d5087bcc1bc37" Sep 10 17:43:32.111495 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:43:32.111478 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"428d59c71966d424f933a76f69b6c8bc1a9b314ac6c02895374d5087bcc1bc37\": container with ID starting with 428d59c71966d424f933a76f69b6c8bc1a9b314ac6c02895374d5087bcc1bc37 not found: ID does not exist" containerID="428d59c71966d424f933a76f69b6c8bc1a9b314ac6c02895374d5087bcc1bc37" Sep 10 17:43:32.111554 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.111499 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"428d59c71966d424f933a76f69b6c8bc1a9b314ac6c02895374d5087bcc1bc37"} err="failed to get container status \"428d59c71966d424f933a76f69b6c8bc1a9b314ac6c02895374d5087bcc1bc37\": rpc error: code = NotFound desc = could not find container \"428d59c71966d424f933a76f69b6c8bc1a9b314ac6c02895374d5087bcc1bc37\": container with ID starting with 428d59c71966d424f933a76f69b6c8bc1a9b314ac6c02895374d5087bcc1bc37 not found: ID does not exist" Sep 10 17:43:32.117942 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.117905 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:43:32.118929 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.118892 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy" Sep 10 17:43:32.119093 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.119080 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy" Sep 10 17:43:32.119226 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.119214 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="thanos-sidecar" Sep 10 17:43:32.119332 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.119321 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="thanos-sidecar" Sep 10 17:43:32.119455 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.119427 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy-thanos" Sep 10 17:43:32.119557 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.119546 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy-thanos" Sep 10 17:43:32.119667 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.119655 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="init-config-reloader" Sep 10 17:43:32.119782 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.119771 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="init-config-reloader" Sep 10 17:43:32.119888 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.119876 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy-web" Sep 10 17:43:32.119982 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.119972 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy-web" Sep 10 17:43:32.120133 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.120107 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="prometheus" Sep 10 17:43:32.120224 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.120214 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="prometheus" Sep 10 17:43:32.120337 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.120327 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="config-reloader" Sep 10 17:43:32.120426 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.120416 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="config-reloader" Sep 10 17:43:32.120700 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.120684 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy-web" Sep 10 17:43:32.120853 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.120824 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="prometheus" Sep 10 17:43:32.121000 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.120967 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy-thanos" Sep 10 17:43:32.121145 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.121095 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="kube-rbac-proxy" Sep 10 17:43:32.121202 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.121150 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="config-reloader" Sep 10 17:43:32.121202 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.121177 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" containerName="thanos-sidecar" Sep 10 17:43:32.127507 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.127489 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.130219 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.130199 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 17:43:32.130328 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.130205 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 17:43:32.130491 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.130475 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 17:43:32.130683 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.130669 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 17:43:32.130764 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.130680 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bnmj4i3ckusio\"" Sep 10 17:43:32.130816 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.130803 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 17:43:32.130943 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.130923 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 17:43:32.131005 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.130949 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 17:43:32.131005 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.130985 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 17:43:32.131143 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.131012 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 17:43:32.131213 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.131199 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 17:43:32.131273 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.131257 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 17:43:32.131386 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.131371 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kdhvf\"" Sep 10 17:43:32.131569 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.131554 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 17:43:32.131617 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.131556 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 17:43:32.134665 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.134634 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 17:43:32.138166 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.138146 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:43:32.138803 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.138781 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 17:43:32.213166 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213086 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5wxr\" (UniqueName: \"kubernetes.io/projected/ad00564a-6ce2-4e38-ad0a-92030a0135a7-kube-api-access-d5wxr\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213166 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213120 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213166 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213142 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213166 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213156 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213276 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213309 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-config\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213328 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad00564a-6ce2-4e38-ad0a-92030a0135a7-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213380 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213398 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213396 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213419 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213433 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213452 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213475 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213520 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad00564a-6ce2-4e38-ad0a-92030a0135a7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213541 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213559 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213574 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213619 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213591 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.213870 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.213626 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.314633 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314601 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad00564a-6ce2-4e38-ad0a-92030a0135a7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.314633 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314636 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.314825 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314653 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.314825 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314670 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.314825 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314687 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.314825 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314786 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.314825 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314815 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wxr\" (UniqueName: \"kubernetes.io/projected/ad00564a-6ce2-4e38-ad0a-92030a0135a7-kube-api-access-d5wxr\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315086 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314841 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315086 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314865 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315086 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314889 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315086 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314929 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315086 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314962 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315086 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.314996 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-config\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315086 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.315017 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad00564a-6ce2-4e38-ad0a-92030a0135a7-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315086 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.315084 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315465 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.315111 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315465 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.315144 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315465 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.315167 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315465 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.315198 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315465 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.315222 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315465 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.315433 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315755 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.315528 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315755 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.315651 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.315874 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.315808 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.316105 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.316082 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.317849 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.317734 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.318331 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.318002 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.318331 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.318179 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.318494 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.318383 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.318593 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.318548 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.318874 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.318834 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.319124 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.319107 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad00564a-6ce2-4e38-ad0a-92030a0135a7-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.319239 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.319175 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.319653 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.319631 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad00564a-6ce2-4e38-ad0a-92030a0135a7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.320484 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.320465 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad00564a-6ce2-4e38-ad0a-92030a0135a7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.320570 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.320510 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.320696 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.320673 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.320825 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.320807 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-config\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.320902 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.320881 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad00564a-6ce2-4e38-ad0a-92030a0135a7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.323971 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.323949 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5wxr\" (UniqueName: \"kubernetes.io/projected/ad00564a-6ce2-4e38-ad0a-92030a0135a7-kube-api-access-d5wxr\") pod \"prometheus-k8s-0\" (UID: \"ad00564a-6ce2-4e38-ad0a-92030a0135a7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.437296 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.437258 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:43:32.720329 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:32.720290 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:43:32.723441 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:43:32.723415 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad00564a_6ce2_4e38_ad0a_92030a0135a7.slice/crio-26a7dfcdae1492d22b7fd5872e6a95dd74e679c2c66e1560e5172f63b65d3c8a WatchSource:0}: Error finding container 26a7dfcdae1492d22b7fd5872e6a95dd74e679c2c66e1560e5172f63b65d3c8a: Status 404 returned error can't find the container with id 26a7dfcdae1492d22b7fd5872e6a95dd74e679c2c66e1560e5172f63b65d3c8a Sep 10 17:43:33.061530 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:33.061494 2570 generic.go:356] "Generic (PLEG): container finished" podID="ad00564a-6ce2-4e38-ad0a-92030a0135a7" containerID="56d7b479be10162f67de99f79d77c1668db6e94bacb29a61c7fd2b931c111d96" exitCode=0 Sep 10 17:43:33.061925 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:33.061580 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad00564a-6ce2-4e38-ad0a-92030a0135a7","Type":"ContainerDied","Data":"56d7b479be10162f67de99f79d77c1668db6e94bacb29a61c7fd2b931c111d96"} Sep 10 17:43:33.061925 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:33.061651 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad00564a-6ce2-4e38-ad0a-92030a0135a7","Type":"ContainerStarted","Data":"26a7dfcdae1492d22b7fd5872e6a95dd74e679c2c66e1560e5172f63b65d3c8a"} Sep 10 17:43:33.076776 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:33.076752 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53d4b01b-d6fc-4011-9f5a-4187428314a6" path="/var/lib/kubelet/pods/53d4b01b-d6fc-4011-9f5a-4187428314a6/volumes" Sep 10 17:43:34.068390 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:34.068351 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad00564a-6ce2-4e38-ad0a-92030a0135a7","Type":"ContainerStarted","Data":"339efd0ebcc048fd77b9d61d8ce12834166969e6f4b4482201d5cf5897e4e54e"} Sep 10 17:43:34.068758 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:34.068464 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad00564a-6ce2-4e38-ad0a-92030a0135a7","Type":"ContainerStarted","Data":"7981308a0d138eb0c026442d858199e7e16f625b1312d678ed6d827deb648336"} Sep 10 17:43:34.068758 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:34.068509 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad00564a-6ce2-4e38-ad0a-92030a0135a7","Type":"ContainerStarted","Data":"e1ebc64c3e2325432f0debad94c51278d98b5d570c6dab246576dbafb95f6299"} Sep 10 17:43:34.068758 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:34.068547 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad00564a-6ce2-4e38-ad0a-92030a0135a7","Type":"ContainerStarted","Data":"5e49d66a0341bda07f3214414d07d07d291395ea3405d10bc69f340d0abaa10d"} Sep 10 17:43:34.068758 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:34.068581 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad00564a-6ce2-4e38-ad0a-92030a0135a7","Type":"ContainerStarted","Data":"f97b471fabd0909a8c6cedab9e9d197a04df8c2ca0527ac669e28a8d9dab7e54"} Sep 10 17:43:34.068758 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:34.068616 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad00564a-6ce2-4e38-ad0a-92030a0135a7","Type":"ContainerStarted","Data":"286eb61e0c3f8df959b3f6f38e512b668e0c4d20deb0866a58a71868517fd622"} Sep 10 17:43:34.103665 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:34.103611 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.085512612 podStartE2EDuration="2.103596144s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.083532ms" isStatefulPod=false podCreationTimestamp="2026-09-10 17:43:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:34.103025446 +0000 UTC m=+241.618061834" watchObservedRunningTime="2026-09-10 17:43:34.103596144 +0000 UTC m=+241.618632528" Sep 10 17:43:37.438386 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:43:37.438330 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:44:32.438028 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:44:32.437987 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:44:32.453518 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:44:32.453490 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:44:32.853027 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:44:32.852998 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/2.log" Sep 10 17:44:32.856364 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:44:32.856340 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4kn7g_4de79992-6c23-4f1d-a95b-5c0b3627cdff/ovn-acl-logging/0.log" Sep 10 17:44:32.858492 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:44:32.858450 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/2.log" Sep 10 17:44:32.862527 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:44:32.862497 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4kn7g_4de79992-6c23-4f1d-a95b-5c0b3627cdff/ovn-acl-logging/0.log" Sep 10 17:44:32.864318 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:44:32.864297 2570 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 17:44:33.306226 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:44:33.306199 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:46:21.009145 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.009112 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-t2q2c"] Sep 10 17:46:21.012430 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.012413 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-t2q2c" Sep 10 17:46:21.015125 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.015102 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 17:46:21.016194 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.016173 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 17:46:21.016270 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.016175 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v2b4z\"" Sep 10 17:46:21.019741 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.019716 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-t2q2c"] Sep 10 17:46:21.034369 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.034344 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e38f19c-4e2c-4b71-a65a-97b03b638412-bound-sa-token\") pod \"cert-manager-55b4d954d5-t2q2c\" (UID: \"6e38f19c-4e2c-4b71-a65a-97b03b638412\") " pod="cert-manager/cert-manager-55b4d954d5-t2q2c" Sep 10 17:46:21.034485 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.034395 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc72g\" (UniqueName: \"kubernetes.io/projected/6e38f19c-4e2c-4b71-a65a-97b03b638412-kube-api-access-dc72g\") pod \"cert-manager-55b4d954d5-t2q2c\" (UID: \"6e38f19c-4e2c-4b71-a65a-97b03b638412\") " pod="cert-manager/cert-manager-55b4d954d5-t2q2c" Sep 10 17:46:21.135276 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.135234 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e38f19c-4e2c-4b71-a65a-97b03b638412-bound-sa-token\") pod \"cert-manager-55b4d954d5-t2q2c\" (UID: \"6e38f19c-4e2c-4b71-a65a-97b03b638412\") " pod="cert-manager/cert-manager-55b4d954d5-t2q2c" Sep 10 17:46:21.135469 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.135412 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc72g\" (UniqueName: \"kubernetes.io/projected/6e38f19c-4e2c-4b71-a65a-97b03b638412-kube-api-access-dc72g\") pod \"cert-manager-55b4d954d5-t2q2c\" (UID: \"6e38f19c-4e2c-4b71-a65a-97b03b638412\") " pod="cert-manager/cert-manager-55b4d954d5-t2q2c" Sep 10 17:46:21.143760 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.143736 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e38f19c-4e2c-4b71-a65a-97b03b638412-bound-sa-token\") pod \"cert-manager-55b4d954d5-t2q2c\" (UID: \"6e38f19c-4e2c-4b71-a65a-97b03b638412\") " pod="cert-manager/cert-manager-55b4d954d5-t2q2c" Sep 10 17:46:21.143880 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.143810 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc72g\" (UniqueName: \"kubernetes.io/projected/6e38f19c-4e2c-4b71-a65a-97b03b638412-kube-api-access-dc72g\") pod \"cert-manager-55b4d954d5-t2q2c\" (UID: \"6e38f19c-4e2c-4b71-a65a-97b03b638412\") " pod="cert-manager/cert-manager-55b4d954d5-t2q2c" Sep 10 17:46:21.336166 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.336133 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-t2q2c" Sep 10 17:46:21.605392 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.605365 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-t2q2c"] Sep 10 17:46:21.607809 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:46:21.607775 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e38f19c_4e2c_4b71_a65a_97b03b638412.slice/crio-b8cb035b1d97c4fcf7740889f873be61c8d31817a141b2d402bef442a331df1a WatchSource:0}: Error finding container b8cb035b1d97c4fcf7740889f873be61c8d31817a141b2d402bef442a331df1a: Status 404 returned error can't find the container with id b8cb035b1d97c4fcf7740889f873be61c8d31817a141b2d402bef442a331df1a Sep 10 17:46:21.610156 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.610137 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:46:21.701372 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:21.701330 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-t2q2c" event={"ID":"6e38f19c-4e2c-4b71-a65a-97b03b638412","Type":"ContainerStarted","Data":"b8cb035b1d97c4fcf7740889f873be61c8d31817a141b2d402bef442a331df1a"} Sep 10 17:46:22.670599 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.670542 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn"] Sep 10 17:46:22.674297 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.674269 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn" Sep 10 17:46:22.677305 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.677137 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 17:46:22.678111 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.678063 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2fpc4\"" Sep 10 17:46:22.678213 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.678113 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:46:22.683055 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.682986 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn"] Sep 10 17:46:22.745288 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.745253 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cmnfn\" (UID: \"fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn" Sep 10 17:46:22.745475 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.745389 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lq95\" (UniqueName: \"kubernetes.io/projected/fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1-kube-api-access-5lq95\") pod \"openshift-lws-operator-fd8ccff4c-cmnfn\" (UID: \"fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn" Sep 10 17:46:22.845907 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.845866 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lq95\" (UniqueName: \"kubernetes.io/projected/fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1-kube-api-access-5lq95\") pod \"openshift-lws-operator-fd8ccff4c-cmnfn\" (UID: \"fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn" Sep 10 17:46:22.846104 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.845935 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cmnfn\" (UID: \"fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn" Sep 10 17:46:22.846358 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.846327 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cmnfn\" (UID: \"fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn" Sep 10 17:46:22.855877 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.855846 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lq95\" (UniqueName: \"kubernetes.io/projected/fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1-kube-api-access-5lq95\") pod \"openshift-lws-operator-fd8ccff4c-cmnfn\" (UID: \"fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn" Sep 10 17:46:22.987425 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:22.987343 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn" Sep 10 17:46:24.663447 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:24.663371 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn"] Sep 10 17:46:24.666492 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:46:24.666466 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdc90d89_9e9b_497a_bac2_7ba1c6ffdec1.slice/crio-dbbb692961ebd5d998a5319d0dbf2d36f67ce24f0b8f0867191ebe42d5a9ff6b WatchSource:0}: Error finding container dbbb692961ebd5d998a5319d0dbf2d36f67ce24f0b8f0867191ebe42d5a9ff6b: Status 404 returned error can't find the container with id dbbb692961ebd5d998a5319d0dbf2d36f67ce24f0b8f0867191ebe42d5a9ff6b Sep 10 17:46:24.716352 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:24.716318 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn" event={"ID":"fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1","Type":"ContainerStarted","Data":"dbbb692961ebd5d998a5319d0dbf2d36f67ce24f0b8f0867191ebe42d5a9ff6b"} Sep 10 17:46:24.717972 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:24.717943 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-t2q2c" event={"ID":"6e38f19c-4e2c-4b71-a65a-97b03b638412","Type":"ContainerStarted","Data":"288076de58f323ab2784f5430b158c1d8625de8ebe8a606c4a3660fde35f652c"} Sep 10 17:46:24.736709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:24.736662 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-t2q2c" podStartSLOduration=1.886490795 podStartE2EDuration="4.736647112s" totalImagesPullingTime="2.850156317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:24.734716553 +0000 UTC m=+412.249752937" watchObservedRunningTime="2026-09-10 17:46:24.736647112 +0000 UTC m=+412.251683496" Sep 10 17:46:27.734371 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:27.734335 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn" event={"ID":"fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1","Type":"ContainerStarted","Data":"a936d243e85f1b807273cf414d4e8842db876b8d255b78e36681bce0d3950dd1"} Sep 10 17:46:27.754616 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:27.754565 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmnfn" podStartSLOduration=3.544795328 podStartE2EDuration="5.754550402s" totalImagesPullingTime="2.209755074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:27.753594864 +0000 UTC m=+415.268631250" watchObservedRunningTime="2026-09-10 17:46:27.754550402 +0000 UTC m=+415.269586786" Sep 10 17:46:47.653602 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.653569 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q"] Sep 10 17:46:47.728301 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.728264 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q"] Sep 10 17:46:47.728462 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.728384 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.734572 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.734545 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 17:46:47.735107 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.734545 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qkbhg\"" Sep 10 17:46:47.735183 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.734588 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 17:46:47.735183 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.734605 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 17:46:47.735183 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.734669 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 17:46:47.857425 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.857382 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hw5r\" (UniqueName: \"kubernetes.io/projected/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-kube-api-access-2hw5r\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.857425 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.857429 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.857688 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.857580 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-tmp\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.857688 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.857614 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.857688 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.857645 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-manifests\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.958131 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.958018 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.958278 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.958142 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-tmp\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.958278 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.958169 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.958278 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.958191 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-manifests\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.958278 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.958220 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hw5r\" (UniqueName: \"kubernetes.io/projected/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-kube-api-access-2hw5r\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.958679 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.958647 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-manifests\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.960780 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.960756 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.960879 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.960862 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-tmp\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.961215 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.961193 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:47.971942 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:47.971905 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hw5r\" (UniqueName: \"kubernetes.io/projected/cd4a9ffb-266a-405e-a92c-883e1f7e32ad-kube-api-access-2hw5r\") pod \"opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q\" (UID: \"cd4a9ffb-266a-405e-a92c-883e1f7e32ad\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:48.038755 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:48.038716 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:48.353456 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:48.353428 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q"] Sep 10 17:46:48.354906 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:46:48.354880 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4a9ffb_266a_405e_a92c_883e1f7e32ad.slice/crio-86b798f6183719788ac556b3e90ec8d3b2bd2829f3b43184abb8139f2e9ba758 WatchSource:0}: Error finding container 86b798f6183719788ac556b3e90ec8d3b2bd2829f3b43184abb8139f2e9ba758: Status 404 returned error can't find the container with id 86b798f6183719788ac556b3e90ec8d3b2bd2829f3b43184abb8139f2e9ba758 Sep 10 17:46:48.818559 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:48.818523 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" event={"ID":"cd4a9ffb-266a-405e-a92c-883e1f7e32ad","Type":"ContainerStarted","Data":"86b798f6183719788ac556b3e90ec8d3b2bd2829f3b43184abb8139f2e9ba758"} Sep 10 17:46:51.838081 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:51.838025 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" event={"ID":"cd4a9ffb-266a-405e-a92c-883e1f7e32ad","Type":"ContainerStarted","Data":"f07bda4694f006fe879a7b8217d31484dfdaaf1dfdc519d33f19f36853ee0cc4"} Sep 10 17:46:52.843830 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:52.843792 2570 generic.go:356] "Generic (PLEG): container finished" podID="cd4a9ffb-266a-405e-a92c-883e1f7e32ad" containerID="f07bda4694f006fe879a7b8217d31484dfdaaf1dfdc519d33f19f36853ee0cc4" exitCode=0 Sep 10 17:46:52.844261 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:52.843877 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" event={"ID":"cd4a9ffb-266a-405e-a92c-883e1f7e32ad","Type":"ContainerDied","Data":"f07bda4694f006fe879a7b8217d31484dfdaaf1dfdc519d33f19f36853ee0cc4"} Sep 10 17:46:53.850267 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:53.850227 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" event={"ID":"cd4a9ffb-266a-405e-a92c-883e1f7e32ad","Type":"ContainerStarted","Data":"fdeac170abb73ac5d0297122a403fff32e6985616000c47144a293a3e5265dea"} Sep 10 17:46:53.850743 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:53.850312 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:46:53.875202 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:46:53.875139 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" podStartSLOduration=2.627177885 podStartE2EDuration="6.875119793s" totalImagesPullingTime="3.184283566s" totalInitContainerRuntime="1.063658342s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:46:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:46:53.873354839 +0000 UTC m=+441.388391223" watchObservedRunningTime="2026-09-10 17:46:53.875119793 +0000 UTC m=+441.390156182" Sep 10 17:47:04.857871 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:04.857835 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q" Sep 10 17:47:15.695313 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.695275 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t"] Sep 10 17:47:15.702487 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.702464 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.706257 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.706232 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 17:47:15.707158 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.707138 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 17:47:15.707273 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.707158 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 17:47:15.707499 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.707483 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b42sc\"" Sep 10 17:47:15.723422 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.723395 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t"] Sep 10 17:47:15.799876 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.799843 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d996a21a-a12f-4010-939c-28ffb2386e7a-cert\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.799876 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.799880 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtqth\" (UniqueName: \"kubernetes.io/projected/d996a21a-a12f-4010-939c-28ffb2386e7a-kube-api-access-qtqth\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.800120 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.799907 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d996a21a-a12f-4010-939c-28ffb2386e7a-metrics-cert\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.800120 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.800020 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d996a21a-a12f-4010-939c-28ffb2386e7a-manager-config\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.900465 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.900427 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d996a21a-a12f-4010-939c-28ffb2386e7a-manager-config\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.900595 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.900498 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d996a21a-a12f-4010-939c-28ffb2386e7a-cert\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.900595 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.900516 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtqth\" (UniqueName: \"kubernetes.io/projected/d996a21a-a12f-4010-939c-28ffb2386e7a-kube-api-access-qtqth\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.900595 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.900535 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d996a21a-a12f-4010-939c-28ffb2386e7a-metrics-cert\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.901123 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.901094 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d996a21a-a12f-4010-939c-28ffb2386e7a-manager-config\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.903028 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.903003 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d996a21a-a12f-4010-939c-28ffb2386e7a-cert\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.903144 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.903090 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d996a21a-a12f-4010-939c-28ffb2386e7a-metrics-cert\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:15.909838 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:15.909815 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtqth\" (UniqueName: \"kubernetes.io/projected/d996a21a-a12f-4010-939c-28ffb2386e7a-kube-api-access-qtqth\") pod \"lws-controller-manager-6b786784bd-t4g9t\" (UID: \"d996a21a-a12f-4010-939c-28ffb2386e7a\") " pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:16.012157 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:16.012058 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:16.283918 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:16.283854 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t"] Sep 10 17:47:16.286730 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:47:16.286695 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd996a21a_a12f_4010_939c_28ffb2386e7a.slice/crio-fd0e5911eb7c526d4bf279e8ea2d2b3377baa9f98db9f2bd88eb535ee7af3865 WatchSource:0}: Error finding container fd0e5911eb7c526d4bf279e8ea2d2b3377baa9f98db9f2bd88eb535ee7af3865: Status 404 returned error can't find the container with id fd0e5911eb7c526d4bf279e8ea2d2b3377baa9f98db9f2bd88eb535ee7af3865 Sep 10 17:47:16.955636 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:16.955600 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" event={"ID":"d996a21a-a12f-4010-939c-28ffb2386e7a","Type":"ContainerStarted","Data":"fd0e5911eb7c526d4bf279e8ea2d2b3377baa9f98db9f2bd88eb535ee7af3865"} Sep 10 17:47:17.603278 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:17.603188 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vxckw"] Sep 10 17:47:17.607117 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:17.607090 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:47:17.613316 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:47:17.613277 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"odh-model-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-143-62.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-62.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret" Sep 10 17:47:17.617197 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:47:17.615859 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"odh-model-controller-7998c67dc4-vxckw\" is forbidden: User \"system:node:ip-10-0-143-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-62.ec2.internal' and this object" podUID="e207153e-93f8-49a2-8bce-8250f58e9de7" pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:47:17.617197 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:17.615942 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxwcp\" (UniqueName: \"kubernetes.io/projected/e207153e-93f8-49a2-8bce-8250f58e9de7-kube-api-access-pxwcp\") pod \"odh-model-controller-7998c67dc4-vxckw\" (UID: \"e207153e-93f8-49a2-8bce-8250f58e9de7\") " pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:47:17.617197 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:17.615999 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e207153e-93f8-49a2-8bce-8250f58e9de7-cert\") pod \"odh-model-controller-7998c67dc4-vxckw\" (UID: \"e207153e-93f8-49a2-8bce-8250f58e9de7\") " pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:47:17.618221 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:47:17.618194 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"odh-model-controller-dockercfg-2wpnl\" is forbidden: User \"system:node:ip-10-0-143-62.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-62.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2wpnl\"" type="*v1.Secret" Sep 10 17:47:17.628823 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:17.628797 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vxckw"] Sep 10 17:47:17.717108 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:17.717071 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxwcp\" (UniqueName: \"kubernetes.io/projected/e207153e-93f8-49a2-8bce-8250f58e9de7-kube-api-access-pxwcp\") pod \"odh-model-controller-7998c67dc4-vxckw\" (UID: \"e207153e-93f8-49a2-8bce-8250f58e9de7\") " pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:47:17.717322 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:17.717138 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e207153e-93f8-49a2-8bce-8250f58e9de7-cert\") pod \"odh-model-controller-7998c67dc4-vxckw\" (UID: \"e207153e-93f8-49a2-8bce-8250f58e9de7\") " pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:47:17.726303 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:17.726270 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxwcp\" (UniqueName: \"kubernetes.io/projected/e207153e-93f8-49a2-8bce-8250f58e9de7-kube-api-access-pxwcp\") pod \"odh-model-controller-7998c67dc4-vxckw\" (UID: \"e207153e-93f8-49a2-8bce-8250f58e9de7\") " pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:47:18.163565 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.163533 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2l6k4"] Sep 10 17:47:18.166819 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.166799 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" Sep 10 17:47:18.171168 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.171148 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 10 17:47:18.179320 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.179259 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2l6k4"] Sep 10 17:47:18.221444 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.221417 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc535eb8-a215-4131-9f0c-256243e5b56e-tls-certs\") pod \"model-serving-api-54d89bd5fc-2l6k4\" (UID: \"cc535eb8-a215-4131-9f0c-256243e5b56e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" Sep 10 17:47:18.221542 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.221484 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxh2h\" (UniqueName: \"kubernetes.io/projected/cc535eb8-a215-4131-9f0c-256243e5b56e-kube-api-access-nxh2h\") pod \"model-serving-api-54d89bd5fc-2l6k4\" (UID: \"cc535eb8-a215-4131-9f0c-256243e5b56e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" Sep 10 17:47:18.322485 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.322450 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc535eb8-a215-4131-9f0c-256243e5b56e-tls-certs\") pod \"model-serving-api-54d89bd5fc-2l6k4\" (UID: \"cc535eb8-a215-4131-9f0c-256243e5b56e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" Sep 10 17:47:18.322617 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.322497 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxh2h\" (UniqueName: \"kubernetes.io/projected/cc535eb8-a215-4131-9f0c-256243e5b56e-kube-api-access-nxh2h\") pod \"model-serving-api-54d89bd5fc-2l6k4\" (UID: \"cc535eb8-a215-4131-9f0c-256243e5b56e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" Sep 10 17:47:18.324838 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.324813 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc535eb8-a215-4131-9f0c-256243e5b56e-tls-certs\") pod \"model-serving-api-54d89bd5fc-2l6k4\" (UID: \"cc535eb8-a215-4131-9f0c-256243e5b56e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" Sep 10 17:47:18.331592 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.331567 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxh2h\" (UniqueName: \"kubernetes.io/projected/cc535eb8-a215-4131-9f0c-256243e5b56e-kube-api-access-nxh2h\") pod \"model-serving-api-54d89bd5fc-2l6k4\" (UID: \"cc535eb8-a215-4131-9f0c-256243e5b56e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" Sep 10 17:47:18.476939 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.476839 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" Sep 10 17:47:18.717429 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:47:18.717400 2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: failed to sync secret cache: timed out waiting for the condition Sep 10 17:47:18.717570 ip-10-0-143-62 kubenswrapper[2570]: E0910 17:47:18.717475 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e207153e-93f8-49a2-8bce-8250f58e9de7-cert podName:e207153e-93f8-49a2-8bce-8250f58e9de7 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:19.217459421 +0000 UTC m=+466.732495783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e207153e-93f8-49a2-8bce-8250f58e9de7-cert") pod "odh-model-controller-7998c67dc4-vxckw" (UID: "e207153e-93f8-49a2-8bce-8250f58e9de7") : failed to sync secret cache: timed out waiting for the condition Sep 10 17:47:18.752506 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.752399 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2l6k4"] Sep 10 17:47:18.755071 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:47:18.755029 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc535eb8_a215_4131_9f0c_256243e5b56e.slice/crio-5188b1ea5493a000012afc904456943ae2eb36c88011a0cafde0070db9df1e19 WatchSource:0}: Error finding container 5188b1ea5493a000012afc904456943ae2eb36c88011a0cafde0070db9df1e19: Status 404 returned error can't find the container with id 5188b1ea5493a000012afc904456943ae2eb36c88011a0cafde0070db9df1e19 Sep 10 17:47:18.967898 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.967860 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" event={"ID":"cc535eb8-a215-4131-9f0c-256243e5b56e","Type":"ContainerStarted","Data":"5188b1ea5493a000012afc904456943ae2eb36c88011a0cafde0070db9df1e19"} Sep 10 17:47:18.969381 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.969356 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" event={"ID":"d996a21a-a12f-4010-939c-28ffb2386e7a","Type":"ContainerStarted","Data":"447619a9a087e7a9005cb0ae8f55b656dce3e297d624c3f195114009a040d78c"} Sep 10 17:47:18.969502 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.969491 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:18.991941 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:18.991895 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" podStartSLOduration=2.082586973 podStartE2EDuration="3.991880316s" totalImagesPullingTime="1.909293343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:18.99081305 +0000 UTC m=+466.505849434" watchObservedRunningTime="2026-09-10 17:47:18.991880316 +0000 UTC m=+466.506916704" Sep 10 17:47:19.038263 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:19.038191 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2wpnl\"" Sep 10 17:47:19.156949 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:19.156921 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 10 17:47:19.232549 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:19.232518 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e207153e-93f8-49a2-8bce-8250f58e9de7-cert\") pod \"odh-model-controller-7998c67dc4-vxckw\" (UID: \"e207153e-93f8-49a2-8bce-8250f58e9de7\") " pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:47:19.235407 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:19.235373 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e207153e-93f8-49a2-8bce-8250f58e9de7-cert\") pod \"odh-model-controller-7998c67dc4-vxckw\" (UID: \"e207153e-93f8-49a2-8bce-8250f58e9de7\") " pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:47:19.422991 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:19.422710 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:47:19.719991 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:19.719964 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vxckw"] Sep 10 17:47:19.721990 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:47:19.721961 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode207153e_93f8_49a2_8bce_8250f58e9de7.slice/crio-ac79732353e6a65fc3f568bec7a8d027400d404f2440fda5413f76bb3957f120 WatchSource:0}: Error finding container ac79732353e6a65fc3f568bec7a8d027400d404f2440fda5413f76bb3957f120: Status 404 returned error can't find the container with id ac79732353e6a65fc3f568bec7a8d027400d404f2440fda5413f76bb3957f120 Sep 10 17:47:19.976013 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:19.975920 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" event={"ID":"e207153e-93f8-49a2-8bce-8250f58e9de7","Type":"ContainerStarted","Data":"ac79732353e6a65fc3f568bec7a8d027400d404f2440fda5413f76bb3957f120"} Sep 10 17:47:21.989287 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:21.989250 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" event={"ID":"cc535eb8-a215-4131-9f0c-256243e5b56e","Type":"ContainerStarted","Data":"0ef65cb4d3627588d22b31c11ab6150de9e480152d0f8ed299969877bf4db3c9"} Sep 10 17:47:21.989762 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:21.989376 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" Sep 10 17:47:22.006837 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:22.006779 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" podStartSLOduration=1.7003923269999999 podStartE2EDuration="4.006759436s" totalImagesPullingTime="2.306367109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:22.00575009 +0000 UTC m=+469.520786476" watchObservedRunningTime="2026-09-10 17:47:22.006759436 +0000 UTC m=+469.521795820" Sep 10 17:47:24.001646 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.001605 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" event={"ID":"e207153e-93f8-49a2-8bce-8250f58e9de7","Type":"ContainerStarted","Data":"118c7b22114581a9b942fe92b2da2fcf09e60caa4a427a522053e277336f7b8d"} Sep 10 17:47:24.002028 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.001739 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:47:24.020068 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.020001 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" podStartSLOduration=3.4969089110000002 podStartE2EDuration="7.019984934s" totalImagesPullingTime="3.523076023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:24.018228533 +0000 UTC m=+471.533264916" watchObservedRunningTime="2026-09-10 17:47:24.019984934 +0000 UTC m=+471.535021317" Sep 10 17:47:24.296269 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.296191 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6"] Sep 10 17:47:24.299210 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.299194 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.302595 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.302563 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 17:47:24.302702 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.302634 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7r2dp\"" Sep 10 17:47:24.303171 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.303150 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 17:47:24.303466 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.303448 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 17:47:24.303525 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.303455 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 17:47:24.303574 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.303533 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 17:47:24.303740 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.303724 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 17:47:24.314056 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.314003 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6"] Sep 10 17:47:24.377586 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.377554 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.377754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.377595 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.377754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.377618 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.377754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.377641 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9cd4efff-650f-401c-8aa3-ef538beaf8ef-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.377754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.377675 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.377754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.377707 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxz2k\" (UniqueName: \"kubernetes.io/projected/9cd4efff-650f-401c-8aa3-ef538beaf8ef-kube-api-access-pxz2k\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.377754 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.377727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd4efff-650f-401c-8aa3-ef538beaf8ef-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.479154 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.479100 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.479154 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.479163 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.479383 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.479189 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.479383 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.479215 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9cd4efff-650f-401c-8aa3-ef538beaf8ef-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.479383 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.479234 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.479514 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.479401 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxz2k\" (UniqueName: \"kubernetes.io/projected/9cd4efff-650f-401c-8aa3-ef538beaf8ef-kube-api-access-pxz2k\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.479514 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.479453 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd4efff-650f-401c-8aa3-ef538beaf8ef-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.480129 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.480105 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.481608 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.481587 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cd4efff-650f-401c-8aa3-ef538beaf8ef-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.481735 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.481716 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9cd4efff-650f-401c-8aa3-ef538beaf8ef-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.481992 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.481973 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.482073 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.482018 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.499384 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.499355 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxz2k\" (UniqueName: \"kubernetes.io/projected/9cd4efff-650f-401c-8aa3-ef538beaf8ef-kube-api-access-pxz2k\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.500196 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.500178 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cd4efff-650f-401c-8aa3-ef538beaf8ef-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9kdv6\" (UID: \"9cd4efff-650f-401c-8aa3-ef538beaf8ef\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.608665 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.608625 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:24.888299 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:24.888219 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6"] Sep 10 17:47:24.890959 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:47:24.890926 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd4efff_650f_401c_8aa3_ef538beaf8ef.slice/crio-3c09fd4011a98956414e94f9d463a1adf3c388560607c9471d88338673bfefc2 WatchSource:0}: Error finding container 3c09fd4011a98956414e94f9d463a1adf3c388560607c9471d88338673bfefc2: Status 404 returned error can't find the container with id 3c09fd4011a98956414e94f9d463a1adf3c388560607c9471d88338673bfefc2 Sep 10 17:47:25.007332 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:25.007294 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" event={"ID":"9cd4efff-650f-401c-8aa3-ef538beaf8ef","Type":"ContainerStarted","Data":"3c09fd4011a98956414e94f9d463a1adf3c388560607c9471d88338673bfefc2"} Sep 10 17:47:27.057665 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:27.057620 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:47:27.057977 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:27.057695 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:47:28.023532 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:28.023497 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" event={"ID":"9cd4efff-650f-401c-8aa3-ef538beaf8ef","Type":"ContainerStarted","Data":"4cbd3139411174c8806a7b82e1024d2c9ba476d6b800b6b960402668929f348d"} Sep 10 17:47:28.023703 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:28.023661 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:28.025505 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:28.025480 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" Sep 10 17:47:28.047082 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:28.047016 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9kdv6" podStartSLOduration=1.882945402 podStartE2EDuration="4.047002504s" totalImagesPullingTime="2.164057102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:28.045789292 +0000 UTC m=+475.560825673" watchObservedRunningTime="2026-09-10 17:47:28.047002504 +0000 UTC m=+475.562038888" Sep 10 17:47:29.978417 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:29.978384 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6b786784bd-t4g9t" Sep 10 17:47:32.998322 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:32.998287 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-2l6k4" Sep 10 17:47:35.009728 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:47:35.009698 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-vxckw" Sep 10 17:49:32.885639 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:32.885601 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/2.log" Sep 10 17:49:32.888802 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:32.888779 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4kn7g_4de79992-6c23-4f1d-a95b-5c0b3627cdff/ovn-acl-logging/0.log" Sep 10 17:49:32.893112 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:32.893093 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/2.log" Sep 10 17:49:32.896244 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:32.896229 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4kn7g_4de79992-6c23-4f1d-a95b-5c0b3627cdff/ovn-acl-logging/0.log" Sep 10 17:49:58.111936 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.111863 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:49:58.115119 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.115100 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" Sep 10 17:49:58.117556 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.117538 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 17:49:58.118553 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.118532 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fmjnf\"" Sep 10 17:49:58.118668 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.118585 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 17:49:58.118668 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.118585 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 17:49:58.123571 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.123544 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:49:58.137269 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.137246 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:49:58.236836 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.236797 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2dd44766-e96c-4ad1-bb48-6c9e78e727c0-config-file\") pod \"limitador-limitador-84994f7ffc-p4txx\" (UID: \"2dd44766-e96c-4ad1-bb48-6c9e78e727c0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" Sep 10 17:49:58.237000 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.236946 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd8tc\" (UniqueName: \"kubernetes.io/projected/2dd44766-e96c-4ad1-bb48-6c9e78e727c0-kube-api-access-bd8tc\") pod \"limitador-limitador-84994f7ffc-p4txx\" (UID: \"2dd44766-e96c-4ad1-bb48-6c9e78e727c0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" Sep 10 17:49:58.338217 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.338180 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd8tc\" (UniqueName: \"kubernetes.io/projected/2dd44766-e96c-4ad1-bb48-6c9e78e727c0-kube-api-access-bd8tc\") pod \"limitador-limitador-84994f7ffc-p4txx\" (UID: \"2dd44766-e96c-4ad1-bb48-6c9e78e727c0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" Sep 10 17:49:58.338399 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.338233 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2dd44766-e96c-4ad1-bb48-6c9e78e727c0-config-file\") pod \"limitador-limitador-84994f7ffc-p4txx\" (UID: \"2dd44766-e96c-4ad1-bb48-6c9e78e727c0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" Sep 10 17:49:58.338855 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.338835 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2dd44766-e96c-4ad1-bb48-6c9e78e727c0-config-file\") pod \"limitador-limitador-84994f7ffc-p4txx\" (UID: \"2dd44766-e96c-4ad1-bb48-6c9e78e727c0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" Sep 10 17:49:58.349740 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.349716 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd8tc\" (UniqueName: \"kubernetes.io/projected/2dd44766-e96c-4ad1-bb48-6c9e78e727c0-kube-api-access-bd8tc\") pod \"limitador-limitador-84994f7ffc-p4txx\" (UID: \"2dd44766-e96c-4ad1-bb48-6c9e78e727c0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" Sep 10 17:49:58.425575 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.425488 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" Sep 10 17:49:58.701006 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.700973 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:49:58.703543 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:49:58.703515 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd44766_e96c_4ad1_bb48_6c9e78e727c0.slice/crio-f36317735f444b196d512f646e911d1e694c789c1624b6d1fd2759e7d960faa0 WatchSource:0}: Error finding container f36317735f444b196d512f646e911d1e694c789c1624b6d1fd2759e7d960faa0: Status 404 returned error can't find the container with id f36317735f444b196d512f646e911d1e694c789c1624b6d1fd2759e7d960faa0 Sep 10 17:49:58.740853 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:49:58.740815 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" event={"ID":"2dd44766-e96c-4ad1-bb48-6c9e78e727c0","Type":"ContainerStarted","Data":"f36317735f444b196d512f646e911d1e694c789c1624b6d1fd2759e7d960faa0"} Sep 10 17:50:01.758933 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:50:01.758890 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" event={"ID":"2dd44766-e96c-4ad1-bb48-6c9e78e727c0","Type":"ContainerStarted","Data":"f5730fb1789a454642c58b986d79b484842f5ac2f7b423c133b7eb9fe831d656"} Sep 10 17:50:01.759387 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:50:01.758954 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" Sep 10 17:50:01.777152 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:50:01.777094 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" podStartSLOduration=1.6640016659999999 podStartE2EDuration="3.77707485s" totalImagesPullingTime="2.113073184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:49:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:50:01.77587387 +0000 UTC m=+629.290910255" watchObservedRunningTime="2026-09-10 17:50:01.77707485 +0000 UTC m=+629.292111234" Sep 10 17:50:12.765349 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:50:12.765314 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-p4txx" Sep 10 17:51:10.803871 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.803840 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k9gks"] Sep 10 17:51:10.806309 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.806290 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" Sep 10 17:51:10.809265 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.809246 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 17:51:10.809381 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.809247 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-n785n\"" Sep 10 17:51:10.817677 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.817651 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k9gks"] Sep 10 17:51:10.835468 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.835440 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:51:10.876062 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.875994 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pttp4\" (UniqueName: \"kubernetes.io/projected/44e963bf-60a6-4b3c-a21d-1c1bacfdbd12-kube-api-access-pttp4\") pod \"payload-processing-5b54b7fbb7-k9gks\" (UID: \"44e963bf-60a6-4b3c-a21d-1c1bacfdbd12\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" Sep 10 17:51:10.876252 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.876152 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e963bf-60a6-4b3c-a21d-1c1bacfdbd12-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k9gks\" (UID: \"44e963bf-60a6-4b3c-a21d-1c1bacfdbd12\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" Sep 10 17:51:10.977628 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.977545 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pttp4\" (UniqueName: \"kubernetes.io/projected/44e963bf-60a6-4b3c-a21d-1c1bacfdbd12-kube-api-access-pttp4\") pod \"payload-processing-5b54b7fbb7-k9gks\" (UID: \"44e963bf-60a6-4b3c-a21d-1c1bacfdbd12\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" Sep 10 17:51:10.977628 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.977610 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e963bf-60a6-4b3c-a21d-1c1bacfdbd12-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k9gks\" (UID: \"44e963bf-60a6-4b3c-a21d-1c1bacfdbd12\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" Sep 10 17:51:10.978293 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.978272 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e963bf-60a6-4b3c-a21d-1c1bacfdbd12-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k9gks\" (UID: \"44e963bf-60a6-4b3c-a21d-1c1bacfdbd12\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" Sep 10 17:51:10.986183 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:10.986161 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pttp4\" (UniqueName: \"kubernetes.io/projected/44e963bf-60a6-4b3c-a21d-1c1bacfdbd12-kube-api-access-pttp4\") pod \"payload-processing-5b54b7fbb7-k9gks\" (UID: \"44e963bf-60a6-4b3c-a21d-1c1bacfdbd12\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" Sep 10 17:51:11.118180 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:11.118144 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" Sep 10 17:51:11.387334 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:11.387309 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k9gks"] Sep 10 17:51:11.389615 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:51:11.389589 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e963bf_60a6_4b3c_a21d_1c1bacfdbd12.slice/crio-87360123daa3ad447ebb2442ee348f822e77c268c33165cdf3a0a8b215c8387a WatchSource:0}: Error finding container 87360123daa3ad447ebb2442ee348f822e77c268c33165cdf3a0a8b215c8387a: Status 404 returned error can't find the container with id 87360123daa3ad447ebb2442ee348f822e77c268c33165cdf3a0a8b215c8387a Sep 10 17:51:12.076983 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:12.076937 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" event={"ID":"44e963bf-60a6-4b3c-a21d-1c1bacfdbd12","Type":"ContainerStarted","Data":"87360123daa3ad447ebb2442ee348f822e77c268c33165cdf3a0a8b215c8387a"} Sep 10 17:51:13.082934 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:13.082900 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" event={"ID":"44e963bf-60a6-4b3c-a21d-1c1bacfdbd12","Type":"ContainerStarted","Data":"d7438311ea974d98b1c9fde054dae8fe09734f5095287ed730ba9ae30750319a"} Sep 10 17:51:13.083369 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:13.082977 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" Sep 10 17:51:24.089735 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:24.089702 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" Sep 10 17:51:24.108245 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:24.108186 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-k9gks" podStartSLOduration=12.527168161 podStartE2EDuration="14.108167088s" totalImagesPullingTime="1.580998927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:51:13.099320384 +0000 UTC m=+700.614356770" watchObservedRunningTime="2026-09-10 17:51:24.108167088 +0000 UTC m=+711.623203473" Sep 10 17:51:29.809889 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:29.809803 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:51:35.320492 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:35.320458 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:51:46.309499 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:46.309458 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:51:54.617672 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:51:54.617631 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:52:06.227195 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.227159 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp"] Sep 10 17:52:06.230791 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.230773 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.233360 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.233336 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g6mxf\"" Sep 10 17:52:06.233360 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.233351 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 17:52:06.233542 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.233420 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 17:52:06.234611 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.234595 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 10 17:52:06.240180 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.240158 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp"] Sep 10 17:52:06.264159 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.264124 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.264295 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.264173 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc421f18-9426-4949-b8ec-492fa6491848-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.264295 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.264223 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.264295 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.264269 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89nmh\" (UniqueName: \"kubernetes.io/projected/bc421f18-9426-4949-b8ec-492fa6491848-kube-api-access-89nmh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.264459 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.264333 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.264459 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.264386 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.364803 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.364770 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc421f18-9426-4949-b8ec-492fa6491848-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.364803 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.364811 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.365094 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.364945 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89nmh\" (UniqueName: \"kubernetes.io/projected/bc421f18-9426-4949-b8ec-492fa6491848-kube-api-access-89nmh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.365094 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.365006 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.365094 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.365084 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.365262 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.365138 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.365448 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.365430 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.365508 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.365466 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.365562 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.365515 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.367114 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.367086 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc421f18-9426-4949-b8ec-492fa6491848-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.367468 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.367450 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc421f18-9426-4949-b8ec-492fa6491848-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.373386 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.373364 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89nmh\" (UniqueName: \"kubernetes.io/projected/bc421f18-9426-4949-b8ec-492fa6491848-kube-api-access-89nmh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp\" (UID: \"bc421f18-9426-4949-b8ec-492fa6491848\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.542956 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.542875 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:06.816415 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.816389 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp"] Sep 10 17:52:06.819166 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:52:06.819127 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc421f18_9426_4949_b8ec_492fa6491848.slice/crio-17046c431927a9710af402e0a5087a50fe523b5fe509c9ee87cf6e6402f3300e WatchSource:0}: Error finding container 17046c431927a9710af402e0a5087a50fe523b5fe509c9ee87cf6e6402f3300e: Status 404 returned error can't find the container with id 17046c431927a9710af402e0a5087a50fe523b5fe509c9ee87cf6e6402f3300e Sep 10 17:52:06.820416 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:06.820398 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:52:07.334971 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:07.334931 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" event={"ID":"bc421f18-9426-4949-b8ec-492fa6491848","Type":"ContainerStarted","Data":"17046c431927a9710af402e0a5087a50fe523b5fe509c9ee87cf6e6402f3300e"} Sep 10 17:52:07.816718 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:07.816681 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:52:08.341425 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:08.341391 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" event={"ID":"bc421f18-9426-4949-b8ec-492fa6491848","Type":"ContainerStarted","Data":"da0ae9f9b151271ac5f920891524dad66b50a435df150449da4008b5a701b30e"} Sep 10 17:52:08.366248 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:08.366201 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" podStartSLOduration=1.367889992 podStartE2EDuration="2.366184732s" totalImagesPullingTime="998.29474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:52:08.364684235 +0000 UTC m=+755.879720619" watchObservedRunningTime="2026-09-10 17:52:08.366184732 +0000 UTC m=+755.881221106" Sep 10 17:52:15.716370 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:15.716333 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:52:16.543572 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:16.543536 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:16.543787 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:16.543606 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:16.555878 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:16.555856 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:17.395384 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:17.395350 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp" Sep 10 17:52:25.614219 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:52:25.614180 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-p4txx"] Sep 10 17:54:32.917313 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:54:32.917219 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/2.log" Sep 10 17:54:32.921281 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:54:32.921255 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4kn7g_4de79992-6c23-4f1d-a95b-5c0b3627cdff/ovn-acl-logging/0.log" Sep 10 17:54:32.921797 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:54:32.921777 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/2.log" Sep 10 17:54:32.924930 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:54:32.924912 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4kn7g_4de79992-6c23-4f1d-a95b-5c0b3627cdff/ovn-acl-logging/0.log" Sep 10 17:56:31.521654 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:31.521622 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2l6k4_cc535eb8-a215-4131-9f0c-256243e5b56e/server/0.log" Sep 10 17:56:31.646593 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:31.646565 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vxckw_e207153e-93f8-49a2-8bce-8250f58e9de7/manager/0.log" Sep 10 17:56:31.902570 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:31.902544 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q_cd4a9ffb-266a-405e-a92c-883e1f7e32ad/copy-manifests/0.log" Sep 10 17:56:31.910576 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:31.910532 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q_cd4a9ffb-266a-405e-a92c-883e1f7e32ad/manager/0.log" Sep 10 17:56:33.933297 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:33.933265 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-p4txx_2dd44766-e96c-4ad1-bb48-6c9e78e727c0/limitador/0.log" Sep 10 17:56:34.573203 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:34.573164 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9kdv6_9cd4efff-650f-401c-8aa3-ef538beaf8ef/discovery/0.log" Sep 10 17:56:35.180479 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:35.180449 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k9gks_44e963bf-60a6-4b3c-a21d-1c1bacfdbd12/payload-processing/0.log" Sep 10 17:56:36.129954 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:36.129916 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdc2fp_bc421f18-9426-4949-b8ec-492fa6491848/main/0.log" Sep 10 17:56:45.008647 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:45.008611 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jjrq9_cf63c4c6-56a2-4eb7-b8d8-e9fa6d9ec039/global-pull-secret-syncer/0.log" Sep 10 17:56:45.169435 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:45.169407 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9kng8_c281aa7f-4f94-415c-ad6f-fea23e1a877d/konnectivity-agent/0.log" Sep 10 17:56:45.270788 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:45.270700 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-62.ec2.internal_90b12f471b7c3e45831e3875b9139835/haproxy/0.log" Sep 10 17:56:49.872216 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:49.872180 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-p4txx_2dd44766-e96c-4ad1-bb48-6c9e78e727c0/limitador/0.log" Sep 10 17:56:51.368712 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.368655 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f326620f-806f-4f42-b1df-5eb7b0ff2487/alertmanager/0.log" Sep 10 17:56:51.395752 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.395726 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f326620f-806f-4f42-b1df-5eb7b0ff2487/config-reloader/0.log" Sep 10 17:56:51.418383 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.418356 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f326620f-806f-4f42-b1df-5eb7b0ff2487/kube-rbac-proxy-web/0.log" Sep 10 17:56:51.443558 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.443537 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f326620f-806f-4f42-b1df-5eb7b0ff2487/kube-rbac-proxy/0.log" Sep 10 17:56:51.471970 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.471927 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f326620f-806f-4f42-b1df-5eb7b0ff2487/kube-rbac-proxy-metric/0.log" Sep 10 17:56:51.495910 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.495887 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f326620f-806f-4f42-b1df-5eb7b0ff2487/prom-label-proxy/0.log" Sep 10 17:56:51.518110 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.518089 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f326620f-806f-4f42-b1df-5eb7b0ff2487/init-config-reloader/0.log" Sep 10 17:56:51.713488 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.713403 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47pfd_3744b8ba-3e7d-4860-b13c-500a2bfd1267/node-exporter/0.log" Sep 10 17:56:51.735943 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.735920 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47pfd_3744b8ba-3e7d-4860-b13c-500a2bfd1267/kube-rbac-proxy/0.log" Sep 10 17:56:51.759123 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.759098 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47pfd_3744b8ba-3e7d-4860-b13c-500a2bfd1267/init-textfile/0.log" Sep 10 17:56:51.947442 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.947419 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-kkjjs_145e6792-a859-479b-bc58-7854beb96a71/kube-rbac-proxy-main/0.log" Sep 10 17:56:51.969996 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.969923 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-kkjjs_145e6792-a859-479b-bc58-7854beb96a71/kube-rbac-proxy-self/0.log" Sep 10 17:56:51.997238 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:51.997208 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-kkjjs_145e6792-a859-479b-bc58-7854beb96a71/openshift-state-metrics/0.log" Sep 10 17:56:52.032920 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.032891 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad00564a-6ce2-4e38-ad0a-92030a0135a7/prometheus/0.log" Sep 10 17:56:52.055465 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.055441 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad00564a-6ce2-4e38-ad0a-92030a0135a7/config-reloader/0.log" Sep 10 17:56:52.078476 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.078442 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad00564a-6ce2-4e38-ad0a-92030a0135a7/thanos-sidecar/0.log" Sep 10 17:56:52.103159 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.103131 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad00564a-6ce2-4e38-ad0a-92030a0135a7/kube-rbac-proxy-web/0.log" Sep 10 17:56:52.129534 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.129507 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad00564a-6ce2-4e38-ad0a-92030a0135a7/kube-rbac-proxy/0.log" Sep 10 17:56:52.168928 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.168904 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad00564a-6ce2-4e38-ad0a-92030a0135a7/kube-rbac-proxy-thanos/0.log" Sep 10 17:56:52.205056 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.205007 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad00564a-6ce2-4e38-ad0a-92030a0135a7/init-config-reloader/0.log" Sep 10 17:56:52.272438 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.272355 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-8p5wq_40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27/prometheus-operator/0.log" Sep 10 17:56:52.296166 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.296139 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-8p5wq_40fbfcfa-d19b-4a4d-9a74-9a4636fe9f27/kube-rbac-proxy/0.log" Sep 10 17:56:52.323194 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.323161 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-hrrpr_284e2a70-4da4-428f-94d6-ead0afc04025/prometheus-operator-admission-webhook/0.log" Sep 10 17:56:52.487881 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.487833 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c9c9cbfd-wtrtk_06460cf2-b39d-4bf8-9f40-1a0f900bc978/thanos-query/0.log" Sep 10 17:56:52.517907 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.517884 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c9c9cbfd-wtrtk_06460cf2-b39d-4bf8-9f40-1a0f900bc978/kube-rbac-proxy-web/0.log" Sep 10 17:56:52.545999 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.545932 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c9c9cbfd-wtrtk_06460cf2-b39d-4bf8-9f40-1a0f900bc978/kube-rbac-proxy/0.log" Sep 10 17:56:52.581371 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.581342 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c9c9cbfd-wtrtk_06460cf2-b39d-4bf8-9f40-1a0f900bc978/prom-label-proxy/0.log" Sep 10 17:56:52.612231 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.612206 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c9c9cbfd-wtrtk_06460cf2-b39d-4bf8-9f40-1a0f900bc978/kube-rbac-proxy-rules/0.log" Sep 10 17:56:52.637951 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:52.637924 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c9c9cbfd-wtrtk_06460cf2-b39d-4bf8-9f40-1a0f900bc978/kube-rbac-proxy-metrics/0.log" Sep 10 17:56:54.775387 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.775360 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/2.log" Sep 10 17:56:54.777536 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.777510 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz"] Sep 10 17:56:54.780321 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.780299 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:54.783090 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.783064 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qq7nd\"/\"default-dockercfg-9s2j2\"" Sep 10 17:56:54.783195 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.783163 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qq7nd\"/\"openshift-service-ca.crt\"" Sep 10 17:56:54.790709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.784502 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qq7nd\"/\"kube-root-ca.crt\"" Sep 10 17:56:54.790709 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.785121 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vbm6f_39f4aec9-3e3a-49e2-8060-ffeb540d24c9/console-operator/3.log" Sep 10 17:56:54.795172 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.795149 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz"] Sep 10 17:56:54.943650 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.943615 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-sys\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:54.943650 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.943651 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x665w\" (UniqueName: \"kubernetes.io/projected/203cd779-1423-4c79-9543-086df16e544a-kube-api-access-x665w\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:54.943857 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.943678 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-lib-modules\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:54.943857 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.943714 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-podres\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:54.943857 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:54.943760 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-proc\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.044833 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.044752 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-sys\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.044833 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.044791 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x665w\" (UniqueName: \"kubernetes.io/projected/203cd779-1423-4c79-9543-086df16e544a-kube-api-access-x665w\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.044833 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.044817 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-lib-modules\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.045139 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.044839 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-podres\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.045139 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.044878 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-proc\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.045139 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.044950 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-podres\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.045139 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.044967 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-lib-modules\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.045139 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.044877 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-sys\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.045139 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.044973 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/203cd779-1423-4c79-9543-086df16e544a-proc\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.070795 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.070762 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x665w\" (UniqueName: \"kubernetes.io/projected/203cd779-1423-4c79-9543-086df16e544a-kube-api-access-x665w\") pod \"perf-node-gather-daemonset-sgzwz\" (UID: \"203cd779-1423-4c79-9543-086df16e544a\") " pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.097833 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.097807 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.372794 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.372766 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz"] Sep 10 17:56:55.375386 ip-10-0-143-62 kubenswrapper[2570]: W0910 17:56:55.375360 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod203cd779_1423_4c79_9543_086df16e544a.slice/crio-9538a120a972ecaff998e4d18d185a9324a602bf6e3191c80cbe8f9d3104766e WatchSource:0}: Error finding container 9538a120a972ecaff998e4d18d185a9324a602bf6e3191c80cbe8f9d3104766e: Status 404 returned error can't find the container with id 9538a120a972ecaff998e4d18d185a9324a602bf6e3191c80cbe8f9d3104766e Sep 10 17:56:55.678449 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.678363 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" event={"ID":"203cd779-1423-4c79-9543-086df16e544a","Type":"ContainerStarted","Data":"c1a162a90f9e0f6e958c8a222a59d926e2d29624aaa9c962f0b3d76261b65acc"} Sep 10 17:56:55.678449 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.678415 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" event={"ID":"203cd779-1423-4c79-9543-086df16e544a","Type":"ContainerStarted","Data":"9538a120a972ecaff998e4d18d185a9324a602bf6e3191c80cbe8f9d3104766e"} Sep 10 17:56:55.678449 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.678443 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:56:55.703978 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:55.703916 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" podStartSLOduration=1.703894504 podStartE2EDuration="1.703894504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:56:55.702799146 +0000 UTC m=+1043.217835532" watchObservedRunningTime="2026-09-10 17:56:55.703894504 +0000 UTC m=+1043.218930890" Sep 10 17:56:57.309338 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:57.309306 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2lk44_7a705cfa-eda8-4a74-aaf7-13d841013cd1/dns/0.log" Sep 10 17:56:57.334447 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:57.334423 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2lk44_7a705cfa-eda8-4a74-aaf7-13d841013cd1/kube-rbac-proxy/0.log" Sep 10 17:56:57.460919 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:57.460893 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-282gm_651a4d52-994d-4698-9b73-4946ab6459db/dns-node-resolver/0.log" Sep 10 17:56:58.108843 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:58.108798 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ht8ws_d756089e-495a-4d2b-aed2-414349e8ca4e/node-ca/0.log" Sep 10 17:56:59.212680 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:59.212645 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9kdv6_9cd4efff-650f-401c-8aa3-ef538beaf8ef/discovery/0.log" Sep 10 17:56:59.390813 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:56:59.390779 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k9gks_44e963bf-60a6-4b3c-a21d-1c1bacfdbd12/payload-processing/0.log" Sep 10 17:57:00.049744 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:00.049716 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bzbb4_6bcbcb13-44db-4895-9524-6822c3d50baa/serve-healthcheck-canary/0.log" Sep 10 17:57:00.714699 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:00.714646 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ts5rm_01226013-012f-4acb-b4db-942a13a42227/kube-rbac-proxy/0.log" Sep 10 17:57:00.743025 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:00.742993 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ts5rm_01226013-012f-4acb-b4db-942a13a42227/exporter/0.log" Sep 10 17:57:00.770516 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:00.770487 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ts5rm_01226013-012f-4acb-b4db-942a13a42227/extractor/0.log" Sep 10 17:57:01.693150 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:01.693120 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qq7nd/perf-node-gather-daemonset-sgzwz" Sep 10 17:57:03.112354 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:03.112326 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2l6k4_cc535eb8-a215-4131-9f0c-256243e5b56e/server/0.log" Sep 10 17:57:03.187925 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:03.187880 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vxckw_e207153e-93f8-49a2-8bce-8250f58e9de7/manager/0.log" Sep 10 17:57:03.383431 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:03.383321 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q_cd4a9ffb-266a-405e-a92c-883e1f7e32ad/manager/0.log" Sep 10 17:57:03.429988 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:03.429961 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7d5cf7ff-j6m6q_cd4a9ffb-266a-405e-a92c-883e1f7e32ad/copy-manifests/0.log" Sep 10 17:57:05.019599 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:05.019568 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6b786784bd-t4g9t_d996a21a-a12f-4010-939c-28ffb2386e7a/manager/0.log" Sep 10 17:57:05.049447 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:05.049381 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cmnfn_fdc90d89-9e9b-497a-bac2-7ba1c6ffdec1/openshift-lws-operator/0.log" Sep 10 17:57:05.247625 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:05.247593 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9kdv6_9cd4efff-650f-401c-8aa3-ef538beaf8ef/discovery/0.log" Sep 10 17:57:05.329939 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:05.329859 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k9gks_44e963bf-60a6-4b3c-a21d-1c1bacfdbd12/payload-processing/0.log" Sep 10 17:57:06.538123 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:06.538003 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9kdv6_9cd4efff-650f-401c-8aa3-ef538beaf8ef/discovery/0.log" Sep 10 17:57:06.641374 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:06.641338 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k9gks_44e963bf-60a6-4b3c-a21d-1c1bacfdbd12/payload-processing/0.log" Sep 10 17:57:11.528629 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:11.528595 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5pnk7_de45abfe-1156-4ea1-8c4e-d09c9fb00720/kube-multus-additional-cni-plugins/0.log" Sep 10 17:57:11.551162 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:11.551136 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5pnk7_de45abfe-1156-4ea1-8c4e-d09c9fb00720/egress-router-binary-copy/0.log" Sep 10 17:57:11.572990 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:11.572966 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5pnk7_de45abfe-1156-4ea1-8c4e-d09c9fb00720/cni-plugins/0.log" Sep 10 17:57:11.594873 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:11.594845 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5pnk7_de45abfe-1156-4ea1-8c4e-d09c9fb00720/bond-cni-plugin/0.log" Sep 10 17:57:11.616600 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:11.616570 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5pnk7_de45abfe-1156-4ea1-8c4e-d09c9fb00720/routeoverride-cni/0.log" Sep 10 17:57:11.638071 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:11.638028 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5pnk7_de45abfe-1156-4ea1-8c4e-d09c9fb00720/whereabouts-cni-bincopy/0.log" Sep 10 17:57:11.658962 ip-10-0-143-62 kubenswrapper[2570]: I0910 17:57:11.658939 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5pnk7_de45abfe-1156-4ea1-8c4e-d09c9fb00720/whereabouts-cni/0.log"