Sep 07 13:37:33.183492 ip-10-0-131-22 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 07 13:37:33.183628 ip-10-0-131-22 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 07 13:37:33.183719 ip-10-0-131-22 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 07 13:37:33.184194 ip-10-0-131-22 systemd[1]: Failed to start Kubernetes Kubelet. Sep 07 13:37:43.230400 ip-10-0-131-22 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 07 13:37:43.230417 ip-10-0-131-22 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 805a26cbddcc46a39dc0451f91b9a941 -- Sep 07 13:39:25.910422 ip-10-0-131-22 systemd[1]: Starting Kubernetes Kubelet... Sep 07 13:39:26.303364 ip-10-0-131-22 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 13:39:26.303364 ip-10-0-131-22 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 13:39:26.303364 ip-10-0-131-22 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 13:39:26.303364 ip-10-0-131-22 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 13:39:26.303364 ip-10-0-131-22 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 13:39:26.304147 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.303387 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 13:39:26.307099 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307076 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:39:26.307099 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307095 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:39:26.307099 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307100 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:39:26.307099 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307104 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:39:26.307099 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307109 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307114 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307132 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307136 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307140 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307144 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307150 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307155 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307160 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307164 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307173 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307177 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307181 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307185 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307189 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307192 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307196 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307200 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307204 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:39:26.307418 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307208 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307212 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307215 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307219 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307224 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307228 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307232 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307235 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307239 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307243 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307248 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307252 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307256 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307261 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307266 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307279 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307284 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307288 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307292 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307296 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:39:26.308208 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307301 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307305 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307310 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307316 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307320 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307325 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307329 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307336 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307342 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307347 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307352 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307357 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307361 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307366 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307371 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307375 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307380 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307384 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307388 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:39:26.309402 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307393 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307397 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307401 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307407 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307411 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307415 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307420 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307424 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307429 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307436 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307442 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307448 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307452 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307457 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307461 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307466 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307470 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307475 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307480 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:39:26.310244 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307484 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307491 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307496 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307500 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307504 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307509 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307513 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307517 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307521 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307526 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307531 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307535 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307539 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307544 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307548 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307552 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307560 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.307564 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308761 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308773 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:39:26.311055 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308777 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308782 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308787 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308793 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308798 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308802 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308807 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308811 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308816 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308820 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308824 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308829 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308833 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308838 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308842 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308846 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308850 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308854 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308859 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:39:26.311924 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308863 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308867 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308871 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308876 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308880 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308884 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308888 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308892 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308897 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308901 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308905 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308910 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308914 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308918 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308923 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308927 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308931 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308936 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308941 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308945 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:39:26.312518 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308949 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308954 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308958 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308962 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308966 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308970 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308974 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308978 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308983 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308989 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.308996 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309000 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309004 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309008 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309013 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309017 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309024 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309029 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309036 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309041 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:39:26.313086 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309046 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309051 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309055 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309060 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309064 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309069 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309074 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309078 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309083 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309088 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309093 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309098 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309102 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309106 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309115 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309154 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309179 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309184 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309189 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:39:26.313642 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309194 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309200 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309204 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309209 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309213 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309218 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309223 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309228 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309233 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309238 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309243 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309248 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309253 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309257 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309261 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309265 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309269 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309273 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309277 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309917 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:39:26.314135 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309927 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309931 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309936 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309942 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309947 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309951 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309955 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309960 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309964 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309970 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309975 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309980 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309984 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309989 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309993 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.309998 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310002 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310007 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310011 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:39:26.314636 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310018 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310024 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310030 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310035 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310040 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310044 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310049 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310054 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310058 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310062 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310067 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310071 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310075 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310080 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310084 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310088 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310092 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310098 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310103 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310107 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:39:26.315136 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310111 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310115 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310137 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310142 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310146 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310151 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310155 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310162 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310166 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310171 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310175 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310179 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310184 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310188 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310192 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310200 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310204 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310209 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310213 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:39:26.315635 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310217 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310221 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310226 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310230 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310234 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310238 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310246 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310251 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310255 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310259 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310263 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310269 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310274 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310278 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310283 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310287 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310291 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310295 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310299 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310303 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:39:26.316137 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310309 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310314 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310318 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310322 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310326 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310330 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310335 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310339 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310345 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310349 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310353 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310357 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310362 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310366 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310371 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310375 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310379 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310383 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310388 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.310392 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:39:26.316630 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310503 2574 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310554 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310569 2574 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310576 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310590 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310595 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310602 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310609 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310614 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310619 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310625 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310630 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310637 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310642 2574 flags.go:64] FLAG: --cgroup-root="" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310647 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310652 2574 flags.go:64] FLAG: --client-ca-file="" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310657 2574 flags.go:64] FLAG: --cloud-provider="external" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310661 2574 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310671 2574 flags.go:64] FLAG: --cluster-domain="" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310675 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310682 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310688 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310693 2574 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310699 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 13:39:26.317116 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310704 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310709 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310715 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310719 2574 flags.go:64] FLAG: --contention-profiling="false" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310724 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310729 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310735 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310739 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310746 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310750 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310755 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310760 2574 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310765 2574 flags.go:64] FLAG: --enable-server="true" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310778 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310792 2574 flags.go:64] FLAG: --event-burst="100" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310797 2574 flags.go:64] FLAG: --event-qps="50" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310802 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310807 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310812 2574 flags.go:64] FLAG: --eviction-hard="" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310818 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310825 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310830 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310835 2574 flags.go:64] FLAG: --eviction-soft="" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310840 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310845 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 13:39:26.317750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310849 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310854 2574 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310859 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310866 2574 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310871 2574 flags.go:64] FLAG: --feature-gates="" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310877 2574 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310882 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310887 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310892 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310897 2574 flags.go:64] FLAG: --healthz-port="10248" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310902 2574 flags.go:64] FLAG: --help="false" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310907 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310912 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310917 2574 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310922 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310927 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310933 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310938 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310943 2574 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310947 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310952 2574 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310957 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310962 2574 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310968 2574 flags.go:64] FLAG: --kube-reserved="" Sep 07 13:39:26.318412 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310972 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310977 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310982 2574 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310990 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310995 2574 flags.go:64] FLAG: --lock-file="" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.310999 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311004 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311009 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311019 2574 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311023 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311028 2574 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311034 2574 flags.go:64] FLAG: --logging-format="text" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311039 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311045 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311049 2574 flags.go:64] FLAG: --manifest-url="" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311054 2574 flags.go:64] FLAG: --manifest-url-header="" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311062 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311066 2574 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311073 2574 flags.go:64] FLAG: --max-pods="110" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311078 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311082 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311087 2574 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311092 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311097 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311101 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 13:39:26.319467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311106 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311135 2574 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311141 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311146 2574 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311151 2574 flags.go:64] FLAG: --pod-cidr="" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311161 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311170 2574 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311175 2574 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311180 2574 flags.go:64] FLAG: --pods-per-core="0" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311184 2574 flags.go:64] FLAG: --port="10250" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311190 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311194 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-002f6f2ad681d546b" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311200 2574 flags.go:64] FLAG: --qos-reserved="" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311205 2574 flags.go:64] FLAG: --read-only-port="10255" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311210 2574 flags.go:64] FLAG: --register-node="true" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311215 2574 flags.go:64] FLAG: --register-with-taints="" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311221 2574 flags.go:64] FLAG: --registry-burst="10" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311226 2574 flags.go:64] FLAG: --registry-qps="5" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311230 2574 flags.go:64] FLAG: --reserved-cpus="" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311236 2574 flags.go:64] FLAG: --reserved-memory="" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311243 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311248 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311253 2574 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311258 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311262 2574 flags.go:64] FLAG: --runonce="false" Sep 07 13:39:26.320590 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311267 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311272 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311277 2574 flags.go:64] FLAG: --seccomp-default="false" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311282 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311286 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311292 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311297 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311302 2574 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311306 2574 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311311 2574 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311317 2574 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311321 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311326 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311342 2574 flags.go:64] FLAG: --system-cgroups="" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311346 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311355 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311360 2574 flags.go:64] FLAG: --tls-cert-file="" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311366 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311375 2574 flags.go:64] FLAG: --tls-min-version="" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311380 2574 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311384 2574 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311389 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311394 2574 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311399 2574 flags.go:64] FLAG: --v="2" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311405 2574 flags.go:64] FLAG: --version="false" Sep 07 13:39:26.321502 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311412 2574 flags.go:64] FLAG: --vmodule="" Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311420 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.311426 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311669 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311676 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311681 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311685 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311689 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311694 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311698 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311702 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311706 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311710 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311714 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311718 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311723 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311727 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311732 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311736 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311740 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:39:26.322468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311744 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311749 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311754 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311758 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311762 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311766 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311770 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311775 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311779 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311783 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311787 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311791 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311795 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311800 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311805 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311809 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311813 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311818 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311822 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:39:26.323326 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311829 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311835 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311839 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311843 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311848 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311852 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311857 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311861 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311865 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311869 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311874 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311878 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311882 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311886 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311890 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311895 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311900 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311904 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311909 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311913 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:39:26.323871 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311917 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311921 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311925 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311929 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311933 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311937 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311943 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311947 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311951 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311956 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311960 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311964 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311968 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311972 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311977 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311981 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311985 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311989 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311993 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.311997 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:39:26.324723 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312001 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312006 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312010 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312015 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312019 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312023 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312027 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312031 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312036 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312042 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312046 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312051 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312055 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312061 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312067 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312071 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312076 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312082 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312088 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:39:26.325588 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312093 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312100 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312105 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.312111 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.312750 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.321012 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.321031 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.321684 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.321703 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321809 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321817 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321822 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321826 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321831 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:39:26.326222 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321835 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321839 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321844 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321848 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321853 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321857 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321861 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321873 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321879 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321883 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321887 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321891 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321896 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321899 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321904 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321908 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321911 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321916 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321921 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321925 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:39:26.326591 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321930 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321934 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321938 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321943 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321948 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321952 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321956 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321960 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321964 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321968 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321981 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321985 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321989 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321993 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.321998 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322002 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322006 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322010 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322014 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:39:26.327147 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322018 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322032 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322039 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322044 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322048 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322054 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322060 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322065 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322070 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322074 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322079 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322084 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322089 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322093 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322097 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322101 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322105 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322110 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322114 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:39:26.327629 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322133 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322138 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322142 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322146 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322150 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322155 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322159 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322165 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322171 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322175 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322179 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322184 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322188 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322192 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322196 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322208 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322213 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322217 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322221 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:39:26.328172 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322226 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322231 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322235 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322240 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322244 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322248 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322252 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322256 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322260 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322264 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322268 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322273 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322277 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322281 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322286 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322290 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:39:26.328655 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322294 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.322302 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322557 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322566 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322571 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322576 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322580 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322585 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322590 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322595 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322599 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322604 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322608 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322621 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322627 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:39:26.329050 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322631 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322636 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322641 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322647 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322654 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322658 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322662 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322671 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322676 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322680 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322684 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322689 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322693 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322697 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322701 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322705 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322710 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322714 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322718 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322723 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:39:26.329624 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322727 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322732 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322736 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322740 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322743 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322747 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322752 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322756 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322760 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322765 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322769 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322781 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322785 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322789 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322794 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322798 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322802 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322807 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322811 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322815 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:39:26.330468 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322819 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322823 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322827 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322832 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322836 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322840 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322844 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322849 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322853 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322857 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322861 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322865 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322869 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322873 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322877 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322882 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322886 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322891 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322895 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322899 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:39:26.331354 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322903 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322907 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322911 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322915 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322927 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322934 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322939 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322944 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322949 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322955 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322960 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322964 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322969 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322974 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322981 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322985 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322990 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322995 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:39:26.332174 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.322999 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.323003 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.323007 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.323011 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.323016 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.323021 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.323025 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:26.323029 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.323037 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.323237 2574 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.325939 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.327026 2574 server.go:1019] "Starting client certificate rotation" Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.327135 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 13:39:26.332847 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.327202 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 13:39:26.333394 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.330164 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 13:39:26.337311 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.337282 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 13:39:26.348333 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.348312 2574 log.go:25] "Validated CRI v1 runtime API" Sep 07 13:39:26.351292 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.351278 2574 log.go:25] "Validated CRI v1 image API" Sep 07 13:39:26.352260 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.352244 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 13:39:26.357335 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.357316 2574 fs.go:135] Filesystem UUIDs: map[093b63d5-eb7e-4f34-aad4-0df0dd5c929c:/dev/nvme0n1p4 2edf3e07-d574-4965-966f-afb34d452c05:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 07 13:39:26.357396 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.357335 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 13:39:26.361295 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.361277 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 13:39:26.362844 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.362731 2574 manager.go:216] Machine: {Timestamp:2026-09-07 13:39:26.361202197 +0000 UTC m=+0.338890003 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3085855 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aab1b588ba9ec3ced7beb31f28a89 SystemUUID:ec2aab1b-588b-a9ec-3ced-7beb31f28a89 BootID:805a26cb-ddcc-46a3-9dc0-451f91b9a941 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cd:49:34:37:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cd:49:34:37:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:eb:69:80:6c:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 13:39:26.362844 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.362842 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 13:39:26.362987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.362975 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 13:39:26.366066 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.366033 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 13:39:26.366221 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.366069 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-22.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 13:39:26.367572 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.367561 2574 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 13:39:26.367608 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.367575 2574 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 13:39:26.367608 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.367584 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 13:39:26.368345 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.368335 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 13:39:26.369231 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.369221 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 13:39:26.373494 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.373480 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 07 13:39:26.373820 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.373808 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 13:39:26.373853 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.373844 2574 kubelet.go:486] "Attempting to sync node with API server" Sep 07 13:39:26.373881 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.373856 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 13:39:26.373881 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.373874 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 13:39:26.373933 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.373886 2574 kubelet.go:398] "Adding apiserver pod source" Sep 07 13:39:26.373933 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.373895 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 13:39:26.374352 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.374339 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 13:39:26.374403 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.374362 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 13:39:26.377709 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.377684 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 13:39:26.379829 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.379815 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 13:39:26.379872 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.379847 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 13:39:26.381594 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381581 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 13:39:26.381635 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381599 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 13:39:26.381635 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381606 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 13:39:26.381635 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381615 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 13:39:26.381635 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381629 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 13:39:26.381635 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381636 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 13:39:26.381757 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381651 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 13:39:26.381757 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381656 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 13:39:26.381757 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381663 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 13:39:26.381757 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381674 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 13:39:26.381757 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381691 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 13:39:26.381757 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.381696 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 13:39:26.382878 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.382868 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 13:39:26.382878 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.382878 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 13:39:26.384047 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.384030 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c4nzh" Sep 07 13:39:26.386237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.386220 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-22.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 13:39:26.386576 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.386548 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 13:39:26.386576 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.386548 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 13:39:26.386941 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.386928 2574 server.go:1268] "Started kubelet" Sep 07 13:39:26.387047 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.387018 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 13:39:26.387297 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.387259 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 13:39:26.393354 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.393325 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 13:39:26.393461 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.393440 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c4nzh" Sep 07 13:39:26.394027 ip-10-0-131-22 systemd[1]: Started Kubernetes Kubelet. Sep 07 13:39:26.395231 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.394516 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 13:39:26.395615 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.395572 2574 server.go:310] "Adding debug handlers to kubelet server" Sep 07 13:39:26.396802 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.396777 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 13:39:26.400659 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.400642 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 13:39:26.401166 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.401146 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 13:39:26.401471 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.401437 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:26.401792 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.401775 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 13:39:26.401792 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.401777 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 13:39:26.401884 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.401804 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 13:39:26.401918 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.401889 2574 reconstruct.go:97] "Volume reconstruction finished" Sep 07 13:39:26.401918 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.401894 2574 reconciler.go:29] "Reconciler: start to sync state" Sep 07 13:39:26.402005 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.401991 2574 factory.go:55] Registering systemd factory Sep 07 13:39:26.402034 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.402008 2574 factory.go:223] Registration of the systemd container factory successfully Sep 07 13:39:26.403371 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.403355 2574 factory.go:153] Registering CRI-O factory Sep 07 13:39:26.403439 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.403375 2574 factory.go:223] Registration of the crio container factory successfully Sep 07 13:39:26.403505 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.403476 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 13:39:26.403505 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.403494 2574 factory.go:103] Registering Raw factory Sep 07 13:39:26.403505 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.403504 2574 manager.go:1196] Started watching for new ooms in manager Sep 07 13:39:26.403970 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.403947 2574 manager.go:349] Starting recovery of all containers Sep 07 13:39:26.405289 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.405269 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:39:26.412439 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.412404 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-22.ec2.internal\" not found" node="ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.414677 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.414515 2574 manager.go:354] Recovery completed Sep 07 13:39:26.420619 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.420605 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:39:26.422757 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.422739 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:39:26.422859 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.422778 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:39:26.422859 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.422789 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:39:26.423817 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.423802 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 13:39:26.423817 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.423815 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 13:39:26.423961 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.423842 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:39:26.423961 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.423864 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 07 13:39:26.424703 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.424685 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:39:26.424772 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.424717 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:39:26.424772 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.424732 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:39:26.425907 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.425895 2574 policy_none.go:49] "None policy: Start" Sep 07 13:39:26.425958 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.425910 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 13:39:26.425958 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.425920 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 13:39:26.427805 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.427794 2574 policy_none.go:47] "Start" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.463789 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.464874 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.464935 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.464965 2574 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.465011 2574 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.467567 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.468950 2574 manager.go:337] "Starting Device Plugin manager" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.469042 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.469105 2574 server.go:87] "Starting device plugin registration server" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.469478 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.469494 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.469605 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.469684 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.469693 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.470168 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 13:39:26.476696 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.470217 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:26.566653 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.565949 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-22.ec2.internal"] Sep 07 13:39:26.566777 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.566664 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:39:26.567773 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.567752 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:39:26.567876 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.567790 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:39:26.567876 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.567804 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:39:26.569888 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.569870 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:39:26.569978 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.569890 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:39:26.570037 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.569999 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.570037 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.570030 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:39:26.570797 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.570768 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:39:26.570878 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.570799 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:39:26.570878 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.570812 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:39:26.570878 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.570776 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:39:26.570878 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.570776 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:39:26.570878 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.570872 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:39:26.570878 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.570878 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:39:26.571078 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.570883 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:39:26.571078 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.570893 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:39:26.571078 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.570927 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.572994 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.572980 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.573060 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.573002 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:39:26.573793 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.573780 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:39:26.573857 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.573803 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:39:26.573857 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.573814 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:39:26.579750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.579736 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.579797 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.579754 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-22.ec2.internal\": node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:26.594084 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.594067 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:26.600713 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.600691 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-22.ec2.internal\" not found" node="ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.603006 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.602910 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d5a7600a30e525f429974d6c4f3b00c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal\" (UID: \"6d5a7600a30e525f429974d6c4f3b00c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.603006 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.602949 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d5a7600a30e525f429974d6c4f3b00c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal\" (UID: \"6d5a7600a30e525f429974d6c4f3b00c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.603006 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.602975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aef2fcf38a14b047ca1c2b9fe741b9ea-config\") pod \"kube-apiserver-proxy-ip-10-0-131-22.ec2.internal\" (UID: \"aef2fcf38a14b047ca1c2b9fe741b9ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.605043 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.605029 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-22.ec2.internal\" not found" node="ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.694399 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.694374 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:26.703645 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.703623 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d5a7600a30e525f429974d6c4f3b00c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal\" (UID: \"6d5a7600a30e525f429974d6c4f3b00c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.703723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.703653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aef2fcf38a14b047ca1c2b9fe741b9ea-config\") pod \"kube-apiserver-proxy-ip-10-0-131-22.ec2.internal\" (UID: \"aef2fcf38a14b047ca1c2b9fe741b9ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.703723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.703675 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d5a7600a30e525f429974d6c4f3b00c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal\" (UID: \"6d5a7600a30e525f429974d6c4f3b00c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.703794 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.703743 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d5a7600a30e525f429974d6c4f3b00c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal\" (UID: \"6d5a7600a30e525f429974d6c4f3b00c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.703794 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.703744 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d5a7600a30e525f429974d6c4f3b00c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal\" (UID: \"6d5a7600a30e525f429974d6c4f3b00c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.703794 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.703750 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aef2fcf38a14b047ca1c2b9fe741b9ea-config\") pod \"kube-apiserver-proxy-ip-10-0-131-22.ec2.internal\" (UID: \"aef2fcf38a14b047ca1c2b9fe741b9ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.795452 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.795421 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:26.896243 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.896174 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:26.903416 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.903398 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.908451 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:26.908118 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-22.ec2.internal" Sep 07 13:39:26.997226 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:26.997185 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:27.097717 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:27.097678 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:27.198249 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:27.198178 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:28.936915 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:28.936880 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:28.965418 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:28.965395 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 13:39:28.966009 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:28.965580 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 13:39:28.966009 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:28.965580 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 13:39:29.037480 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:29.037446 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:29.039701 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:29.039652 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 13:34:28 +0000 UTC" deadline="2028-05-16 11:59:36.432545674 +0000 UTC" Sep 07 13:39:29.039784 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:29.039702 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14806h20m7.392848092s" Sep 07 13:39:29.121489 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:29.121428 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:39:29.138149 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:29.138124 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-22.ec2.internal\" not found" Sep 07 13:39:29.232123 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:29.232095 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:39:29.239688 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:29.239662 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" Sep 07 13:39:29.252559 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:29.252532 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 13:39:29.253368 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:29.253337 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-22.ec2.internal" Sep 07 13:39:29.264044 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:29.264022 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 13:39:29.278260 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:29.278221 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5a7600a30e525f429974d6c4f3b00c.slice/crio-4fb35c6a289a54f3852d96944da9aee9edbd0df2186c8536005d81cdeec3a99b WatchSource:0}: Error finding container 4fb35c6a289a54f3852d96944da9aee9edbd0df2186c8536005d81cdeec3a99b: Status 404 returned error can't find the container with id 4fb35c6a289a54f3852d96944da9aee9edbd0df2186c8536005d81cdeec3a99b Sep 07 13:39:29.281691 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:29.281676 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 13:39:29.609029 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:29.609000 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef2fcf38a14b047ca1c2b9fe741b9ea.slice/crio-86f9991d2f70f71fd8c3602a262aedacb1222e5f30fb8353ab00b687dcec9888 WatchSource:0}: Error finding container 86f9991d2f70f71fd8c3602a262aedacb1222e5f30fb8353ab00b687dcec9888: Status 404 returned error can't find the container with id 86f9991d2f70f71fd8c3602a262aedacb1222e5f30fb8353ab00b687dcec9888 Sep 07 13:39:29.890168 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:29.890088 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:39:30.013277 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.013233 2574 apiserver.go:52] "Watching apiserver" Sep 07 13:39:30.022782 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.022747 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 13:39:30.025687 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.025659 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8d4vm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd","openshift-cluster-node-tuning-operator/tuned-ffg6f","openshift-multus/multus-5pnqv","openshift-multus/multus-additional-cni-plugins-mxgsh","openshift-network-diagnostics/network-check-target-hgqkx","openshift-network-operator/iptables-alerter-xgkfr","openshift-ovn-kubernetes/ovnkube-node-dvsp8","kube-system/konnectivity-agent-4hwvw","kube-system/kube-apiserver-proxy-ip-10-0-131-22.ec2.internal","openshift-dns/node-resolver-nqd8q","openshift-image-registry/node-ca-dwsnv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal","openshift-multus/network-metrics-daemon-l5pc5"] Sep 07 13:39:30.028361 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.028327 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xgkfr" Sep 07 13:39:30.030717 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.030693 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nqd8q" Sep 07 13:39:30.031541 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.031516 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 13:39:30.031797 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.031777 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b4g68\"" Sep 07 13:39:30.031918 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.031895 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 13:39:30.031987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.031906 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 13:39:30.033277 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.033257 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.033397 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.033376 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 13:39:30.033511 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.033493 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2h8rb\"" Sep 07 13:39:30.033647 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.033630 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 13:39:30.037976 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.036694 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.037976 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.037547 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 13:39:30.038413 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.038206 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lq7hm\"" Sep 07 13:39:30.038475 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.038430 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 13:39:30.042810 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.041560 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 13:39:30.042810 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.041892 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 13:39:30.042810 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.041696 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 13:39:30.042810 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.042103 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 13:39:30.042810 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.042206 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rbj7w\"" Sep 07 13:39:30.042810 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.042337 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 13:39:30.042810 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.042449 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.043743 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.043722 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:30.043835 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.043790 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:30.046468 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.046446 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:30.047562 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.047547 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nzb22\"" Sep 07 13:39:30.047650 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.047601 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 13:39:30.047770 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.047754 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 13:39:30.048443 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.048424 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:30.048528 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.048505 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:30.049683 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.049657 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 13:39:30.049847 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.049804 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9rfcg\"" Sep 07 13:39:30.050199 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-run\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.050279 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050215 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kph66\" (UniqueName: \"kubernetes.io/projected/346164b8-01d8-4eac-817a-3193599e898f-kube-api-access-kph66\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.050279 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-cnibin\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.050466 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a53b129-c0b0-4690-8c9d-017bcc36e246-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.050466 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b6de1a-77e8-4fcf-baf1-46dae4022e6b-tmp-dir\") pod \"node-resolver-nqd8q\" (UID: \"d8b6de1a-77e8-4fcf-baf1-46dae4022e6b\") " pod="openshift-dns/node-resolver-nqd8q" Sep 07 13:39:30.050466 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-cni-dir\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.050466 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050361 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f252181b-ac89-4f41-90d5-87c8d4659dec-cni-binary-copy\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.050466 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050386 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-socket-dir-parent\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.050466 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050410 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-var-lib-cni-multus\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.050466 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-sysconfig\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.050466 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050457 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/346164b8-01d8-4eac-817a-3193599e898f-tmp\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050478 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-run-netns\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-hostroot\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-run-multus-certs\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a53b129-c0b0-4690-8c9d-017bcc36e246-cni-binary-copy\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-sysctl-d\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050663 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050661 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-run-k8s-cni-cncf-io\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050700 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-daemon-config\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050751 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq5lx\" (UniqueName: \"kubernetes.io/projected/7a53b129-c0b0-4690-8c9d-017bcc36e246-kube-api-access-lq5lx\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050794 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbjxq\" (UniqueName: \"kubernetes.io/projected/d8b6de1a-77e8-4fcf-baf1-46dae4022e6b-kube-api-access-wbjxq\") pod \"node-resolver-nqd8q\" (UID: \"d8b6de1a-77e8-4fcf-baf1-46dae4022e6b\") " pod="openshift-dns/node-resolver-nqd8q" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050820 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rtqt\" (UniqueName: \"kubernetes.io/projected/f252181b-ac89-4f41-90d5-87c8d4659dec-kube-api-access-8rtqt\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050862 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zdp2\" (UniqueName: \"kubernetes.io/projected/f81a57de-3969-4153-980b-4273bd38127d-kube-api-access-9zdp2\") pod \"iptables-alerter-xgkfr\" (UID: \"f81a57de-3969-4153-980b-4273bd38127d\") " pod="openshift-network-operator/iptables-alerter-xgkfr" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8b6de1a-77e8-4fcf-baf1-46dae4022e6b-hosts-file\") pod \"node-resolver-nqd8q\" (UID: \"d8b6de1a-77e8-4fcf-baf1-46dae4022e6b\") " pod="openshift-dns/node-resolver-nqd8q" Sep 07 13:39:30.050926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050932 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-kubernetes\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-systemd\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.050986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-var-lib-kubelet\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051012 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-system-cni-dir\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051034 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-var-lib-kubelet\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051097 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-sys\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-var-lib-cni-bin\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051167 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-conf-dir\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-etc-kubernetes\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-host\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a53b129-c0b0-4690-8c9d-017bcc36e246-system-cni-dir\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051309 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a53b129-c0b0-4690-8c9d-017bcc36e246-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a53b129-c0b0-4690-8c9d-017bcc36e246-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051388 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thl9b\" (UniqueName: \"kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b\") pod \"network-check-target-hgqkx\" (UID: \"b17085af-30e5-4059-a235-e829361adbf1\") " pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f81a57de-3969-4153-980b-4273bd38127d-iptables-alerter-script\") pod \"iptables-alerter-xgkfr\" (UID: \"f81a57de-3969-4153-980b-4273bd38127d\") " pod="openshift-network-operator/iptables-alerter-xgkfr" Sep 07 13:39:30.051628 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/346164b8-01d8-4eac-817a-3193599e898f-etc-tuned\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.052411 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-lib-modules\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.052411 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051485 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a53b129-c0b0-4690-8c9d-017bcc36e246-cnibin\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.052411 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f81a57de-3969-4153-980b-4273bd38127d-host-slash\") pod \"iptables-alerter-xgkfr\" (UID: \"f81a57de-3969-4153-980b-4273bd38127d\") " pod="openshift-network-operator/iptables-alerter-xgkfr" Sep 07 13:39:30.052411 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051528 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-modprobe-d\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.052411 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.051550 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-sysctl-conf\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.053956 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.053855 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hpxvr\"" Sep 07 13:39:30.054177 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.054155 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 13:39:30.054252 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.054187 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.054951 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.054929 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 13:39:30.055186 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.055170 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 13:39:30.057031 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.056565 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:30.057031 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.056625 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:30.057901 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.057881 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 13:39:30.058000 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.057911 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 13:39:30.058000 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.057942 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 13:39:30.058207 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.058141 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 13:39:30.058278 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.058204 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 13:39:30.059257 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.059228 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f4htb\"" Sep 07 13:39:30.059257 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.059254 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 13:39:30.060022 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.059651 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dwsnv" Sep 07 13:39:30.063477 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.062694 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 13:39:30.063477 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.063056 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zbm6g\"" Sep 07 13:39:30.063477 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.063138 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 13:39:30.063477 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.063164 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 13:39:30.063715 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.063517 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 13:39:30.092510 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.092482 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w72hs" Sep 07 13:39:30.102742 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.102713 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w72hs" Sep 07 13:39:30.115495 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.115442 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-22.ec2.internal" event={"ID":"aef2fcf38a14b047ca1c2b9fe741b9ea","Type":"ContainerStarted","Data":"86f9991d2f70f71fd8c3602a262aedacb1222e5f30fb8353ab00b687dcec9888"} Sep 07 13:39:30.116804 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.116773 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" event={"ID":"6d5a7600a30e525f429974d6c4f3b00c","Type":"ContainerStarted","Data":"4fb35c6a289a54f3852d96944da9aee9edbd0df2186c8536005d81cdeec3a99b"} Sep 07 13:39:30.141000 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.140924 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 13:39:30.151911 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.151870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a53b129-c0b0-4690-8c9d-017bcc36e246-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.151911 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.151918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thl9b\" (UniqueName: \"kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b\") pod \"network-check-target-hgqkx\" (UID: \"b17085af-30e5-4059-a235-e829361adbf1\") " pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:30.152136 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.151946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/346164b8-01d8-4eac-817a-3193599e898f-etc-tuned\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.152136 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.151976 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89a988f9-5e65-475e-9a65-8d45d2c1a94b-konnectivity-ca\") pod \"konnectivity-agent-4hwvw\" (UID: \"89a988f9-5e65-475e-9a65-8d45d2c1a94b\") " pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:30.152136 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-systemd-units\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.152136 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-ovn-node-metrics-cert\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.152136 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-lib-modules\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.152136 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a53b129-c0b0-4690-8c9d-017bcc36e246-cnibin\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.152136 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152094 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-run\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.152136 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152118 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f252181b-ac89-4f41-90d5-87c8d4659dec-cni-binary-copy\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-cni-bin\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a53b129-c0b0-4690-8c9d-017bcc36e246-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-cni-dir\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-socket-dir-parent\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-run-netns\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152294 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-var-lib-openvswitch\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152319 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-run-openvswitch\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-log-socket\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-sysconfig\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/346164b8-01d8-4eac-817a-3193599e898f-tmp\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-kubelet\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a53b129-c0b0-4690-8c9d-017bcc36e246-cni-binary-copy\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152499 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-sysctl-d\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152526 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-run-k8s-cni-cncf-io\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.152550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89a988f9-5e65-475e-9a65-8d45d2c1a94b-agent-certs\") pod \"konnectivity-agent-4hwvw\" (UID: \"89a988f9-5e65-475e-9a65-8d45d2c1a94b\") " pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr84w\" (UniqueName: \"kubernetes.io/projected/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-kube-api-access-zr84w\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-dbus\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec6a5d8f-2407-444c-88f2-d3e836cc90ae-serviceca\") pod \"node-ca-dwsnv\" (UID: \"ec6a5d8f-2407-444c-88f2-d3e836cc90ae\") " pod="openshift-image-registry/node-ca-dwsnv" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152644 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5lx\" (UniqueName: \"kubernetes.io/projected/7a53b129-c0b0-4690-8c9d-017bcc36e246-kube-api-access-lq5lx\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152670 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbjxq\" (UniqueName: \"kubernetes.io/projected/d8b6de1a-77e8-4fcf-baf1-46dae4022e6b-kube-api-access-wbjxq\") pod \"node-resolver-nqd8q\" (UID: \"d8b6de1a-77e8-4fcf-baf1-46dae4022e6b\") " pod="openshift-dns/node-resolver-nqd8q" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rtqt\" (UniqueName: \"kubernetes.io/projected/f252181b-ac89-4f41-90d5-87c8d4659dec-kube-api-access-8rtqt\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152755 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8b6de1a-77e8-4fcf-baf1-46dae4022e6b-hosts-file\") pod \"node-resolver-nqd8q\" (UID: \"d8b6de1a-77e8-4fcf-baf1-46dae4022e6b\") " pod="openshift-dns/node-resolver-nqd8q" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-system-cni-dir\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-var-lib-kubelet\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-conf-dir\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152890 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-slash\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-cni-netd\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152940 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-env-overrides\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152965 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpnsd\" (UniqueName: \"kubernetes.io/projected/249d9193-e8e4-41bc-8fdb-6520c9380538-kube-api-access-lpnsd\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.152988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-node-log\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.153370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153012 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-kubelet-config\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153076 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153119 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a53b129-c0b0-4690-8c9d-017bcc36e246-system-cni-dir\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153150 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a53b129-c0b0-4690-8c9d-017bcc36e246-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153181 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f81a57de-3969-4153-980b-4273bd38127d-iptables-alerter-script\") pod \"iptables-alerter-xgkfr\" (UID: \"f81a57de-3969-4153-980b-4273bd38127d\") " pod="openshift-network-operator/iptables-alerter-xgkfr" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kph66\" (UniqueName: \"kubernetes.io/projected/346164b8-01d8-4eac-817a-3193599e898f-kube-api-access-kph66\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-run-systemd\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153240 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-sysctl-d\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f81a57de-3969-4153-980b-4273bd38127d-host-slash\") pod \"iptables-alerter-xgkfr\" (UID: \"f81a57de-3969-4153-980b-4273bd38127d\") " pod="openshift-network-operator/iptables-alerter-xgkfr" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153290 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-modprobe-d\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153292 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-run-k8s-cni-cncf-io\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-sysctl-conf\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-cnibin\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-var-lib-cni-multus\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153426 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-modprobe-d\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-etc-openvswitch\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-socket-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.154204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153519 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-device-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b6de1a-77e8-4fcf-baf1-46dae4022e6b-tmp-dir\") pod \"node-resolver-nqd8q\" (UID: \"d8b6de1a-77e8-4fcf-baf1-46dae4022e6b\") " pod="openshift-dns/node-resolver-nqd8q" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153588 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-registration-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153618 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-run-netns\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153644 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-hostroot\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-run-multus-certs\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-ovnkube-script-lib\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-daemon-config\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153782 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec6a5d8f-2407-444c-88f2-d3e836cc90ae-host\") pod \"node-ca-dwsnv\" (UID: \"ec6a5d8f-2407-444c-88f2-d3e836cc90ae\") " pod="openshift-image-registry/node-ca-dwsnv" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcms7\" (UniqueName: \"kubernetes.io/projected/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-kube-api-access-vcms7\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zdp2\" (UniqueName: \"kubernetes.io/projected/f81a57de-3969-4153-980b-4273bd38127d-kube-api-access-9zdp2\") pod \"iptables-alerter-xgkfr\" (UID: \"f81a57de-3969-4153-980b-4273bd38127d\") " pod="openshift-network-operator/iptables-alerter-xgkfr" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153864 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-kubernetes\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-systemd\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153921 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-var-lib-kubelet\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-etc-kubernetes\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153973 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-run-ovn\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.154987 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-ovnkube-config\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154024 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-sys\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-var-lib-cni-bin\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154091 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5hw5\" (UniqueName: \"kubernetes.io/projected/ec6a5d8f-2407-444c-88f2-d3e836cc90ae-kube-api-access-n5hw5\") pod \"node-ca-dwsnv\" (UID: \"ec6a5d8f-2407-444c-88f2-d3e836cc90ae\") " pod="openshift-image-registry/node-ca-dwsnv" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154117 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-sys-fs\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154164 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8b6de1a-77e8-4fcf-baf1-46dae4022e6b-hosts-file\") pod \"node-resolver-nqd8q\" (UID: \"d8b6de1a-77e8-4fcf-baf1-46dae4022e6b\") " pod="openshift-dns/node-resolver-nqd8q" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154176 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-host\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154227 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-host\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154267 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-var-lib-kubelet\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154280 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-system-cni-dir\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154330 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-conf-dir\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154803 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.154928 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a53b129-c0b0-4690-8c9d-017bcc36e246-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.155145 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-sysctl-conf\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.155197 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-cnibin\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.153466 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-var-lib-cni-multus\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.155445 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f81a57de-3969-4153-980b-4273bd38127d-host-slash\") pod \"iptables-alerter-xgkfr\" (UID: \"f81a57de-3969-4153-980b-4273bd38127d\") " pod="openshift-network-operator/iptables-alerter-xgkfr" Sep 07 13:39:30.155870 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.155529 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-sysconfig\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.155539 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-run-netns\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.155555 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-lib-modules\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.155586 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-hostroot\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.155612 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-run\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.155625 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-run-multus-certs\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.155697 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-socket-dir-parent\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.155840 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b6de1a-77e8-4fcf-baf1-46dae4022e6b-tmp-dir\") pod \"node-resolver-nqd8q\" (UID: \"d8b6de1a-77e8-4fcf-baf1-46dae4022e6b\") " pod="openshift-dns/node-resolver-nqd8q" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156152 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f252181b-ac89-4f41-90d5-87c8d4659dec-cni-binary-copy\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156216 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a53b129-c0b0-4690-8c9d-017bcc36e246-cnibin\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156241 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-daemon-config\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156296 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-multus-cni-dir\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156370 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a53b129-c0b0-4690-8c9d-017bcc36e246-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156450 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-host-var-lib-cni-bin\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156467 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-var-lib-kubelet\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156483 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-kubernetes\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156512 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f252181b-ac89-4f41-90d5-87c8d4659dec-etc-kubernetes\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156528 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-etc-systemd\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.156723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156577 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a53b129-c0b0-4690-8c9d-017bcc36e246-system-cni-dir\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.157610 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156685 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/346164b8-01d8-4eac-817a-3193599e898f-sys\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.157610 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.156950 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a53b129-c0b0-4690-8c9d-017bcc36e246-cni-binary-copy\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.157610 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.157139 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f81a57de-3969-4153-980b-4273bd38127d-iptables-alerter-script\") pod \"iptables-alerter-xgkfr\" (UID: \"f81a57de-3969-4153-980b-4273bd38127d\") " pod="openshift-network-operator/iptables-alerter-xgkfr" Sep 07 13:39:30.157610 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.157410 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a53b129-c0b0-4690-8c9d-017bcc36e246-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.162464 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.162437 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/346164b8-01d8-4eac-817a-3193599e898f-etc-tuned\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.164023 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.164000 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/346164b8-01d8-4eac-817a-3193599e898f-tmp\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.168981 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.168957 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:39:30.168981 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.168984 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:39:30.169167 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.168999 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thl9b for pod openshift-network-diagnostics/network-check-target-hgqkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:30.169167 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.169105 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b podName:b17085af-30e5-4059-a235-e829361adbf1 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:30.669073413 +0000 UTC m=+3.008534288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-thl9b" (UniqueName: "kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b") pod "network-check-target-hgqkx" (UID: "b17085af-30e5-4059-a235-e829361adbf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:30.171662 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.171616 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq5lx\" (UniqueName: \"kubernetes.io/projected/7a53b129-c0b0-4690-8c9d-017bcc36e246-kube-api-access-lq5lx\") pod \"multus-additional-cni-plugins-mxgsh\" (UID: \"7a53b129-c0b0-4690-8c9d-017bcc36e246\") " pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.177845 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.177797 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zdp2\" (UniqueName: \"kubernetes.io/projected/f81a57de-3969-4153-980b-4273bd38127d-kube-api-access-9zdp2\") pod \"iptables-alerter-xgkfr\" (UID: \"f81a57de-3969-4153-980b-4273bd38127d\") " pod="openshift-network-operator/iptables-alerter-xgkfr" Sep 07 13:39:30.178841 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.178818 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbjxq\" (UniqueName: \"kubernetes.io/projected/d8b6de1a-77e8-4fcf-baf1-46dae4022e6b-kube-api-access-wbjxq\") pod \"node-resolver-nqd8q\" (UID: \"d8b6de1a-77e8-4fcf-baf1-46dae4022e6b\") " pod="openshift-dns/node-resolver-nqd8q" Sep 07 13:39:30.179511 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.179487 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rtqt\" (UniqueName: \"kubernetes.io/projected/f252181b-ac89-4f41-90d5-87c8d4659dec-kube-api-access-8rtqt\") pod \"multus-5pnqv\" (UID: \"f252181b-ac89-4f41-90d5-87c8d4659dec\") " pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.181123 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.181084 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kph66\" (UniqueName: \"kubernetes.io/projected/346164b8-01d8-4eac-817a-3193599e898f-kube-api-access-kph66\") pod \"tuned-ffg6f\" (UID: \"346164b8-01d8-4eac-817a-3193599e898f\") " pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.254782 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.254744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.254950 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.254793 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-sys-fs\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.254950 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.254834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89a988f9-5e65-475e-9a65-8d45d2c1a94b-konnectivity-ca\") pod \"konnectivity-agent-4hwvw\" (UID: \"89a988f9-5e65-475e-9a65-8d45d2c1a94b\") " pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:30.254950 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.254856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-systemd-units\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.254950 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.254876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-ovn-node-metrics-cert\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.254950 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.254883 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.254950 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.254932 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-sys-fs\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.254941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-cni-bin\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.254990 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-systemd-units\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.254997 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255034 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-run-netns\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255045 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255059 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-var-lib-openvswitch\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-run-openvswitch\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255084 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-run-netns\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255123 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-var-lib-openvswitch\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255152 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-log-socket\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255182 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-kubelet\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255225 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-cni-bin\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255233 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89a988f9-5e65-475e-9a65-8d45d2c1a94b-agent-certs\") pod \"konnectivity-agent-4hwvw\" (UID: \"89a988f9-5e65-475e-9a65-8d45d2c1a94b\") " pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255150 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-run-openvswitch\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr84w\" (UniqueName: \"kubernetes.io/projected/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-kube-api-access-zr84w\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.255284 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-dbus\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255294 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-kubelet\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255300 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255306 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec6a5d8f-2407-444c-88f2-d3e836cc90ae-serviceca\") pod \"node-ca-dwsnv\" (UID: \"ec6a5d8f-2407-444c-88f2-d3e836cc90ae\") " pod="openshift-image-registry/node-ca-dwsnv" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255365 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-slash\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255427 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-cni-netd\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-env-overrides\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnsd\" (UniqueName: \"kubernetes.io/projected/249d9193-e8e4-41bc-8fdb-6520c9380538-kube-api-access-lpnsd\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255477 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89a988f9-5e65-475e-9a65-8d45d2c1a94b-konnectivity-ca\") pod \"konnectivity-agent-4hwvw\" (UID: \"89a988f9-5e65-475e-9a65-8d45d2c1a94b\") " pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255500 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-dbus\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-node-log\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255181 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-log-socket\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255563 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-cni-netd\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.255601 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255610 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-slash\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-kubelet-config\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:30.256153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-kubelet-config\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.255670 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs podName:249d9193-e8e4-41bc-8fdb-6520c9380538 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:30.755652536 +0000 UTC m=+3.095113434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs") pod "network-metrics-daemon-l5pc5" (UID: "249d9193-e8e4-41bc-8fdb-6520c9380538") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.255697 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255822 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-node-log\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.255872 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret podName:5e40cd05-9810-44c4-b3a5-2237f9f6ba56 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:30.755859425 +0000 UTC m=+3.095320299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret") pod "global-pull-secret-syncer-8d4vm" (UID: "5e40cd05-9810-44c4-b3a5-2237f9f6ba56") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-run-systemd\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-etc-openvswitch\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-socket-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255976 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-device-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.255993 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-registration-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-ovnkube-script-lib\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256099 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-env-overrides\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256110 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec6a5d8f-2407-444c-88f2-d3e836cc90ae-serviceca\") pod \"node-ca-dwsnv\" (UID: \"ec6a5d8f-2407-444c-88f2-d3e836cc90ae\") " pod="openshift-image-registry/node-ca-dwsnv" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256156 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-run-systemd\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256164 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-etc-openvswitch\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256171 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-registration-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.256932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256241 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-device-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256258 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-socket-dir\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256372 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec6a5d8f-2407-444c-88f2-d3e836cc90ae-host\") pod \"node-ca-dwsnv\" (UID: \"ec6a5d8f-2407-444c-88f2-d3e836cc90ae\") " pod="openshift-image-registry/node-ca-dwsnv" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcms7\" (UniqueName: \"kubernetes.io/projected/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-kube-api-access-vcms7\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-run-ovn\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-ovnkube-config\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5hw5\" (UniqueName: \"kubernetes.io/projected/ec6a5d8f-2407-444c-88f2-d3e836cc90ae-kube-api-access-n5hw5\") pod \"node-ca-dwsnv\" (UID: \"ec6a5d8f-2407-444c-88f2-d3e836cc90ae\") " pod="openshift-image-registry/node-ca-dwsnv" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256668 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-ovnkube-script-lib\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256725 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-run-ovn\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.256768 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec6a5d8f-2407-444c-88f2-d3e836cc90ae-host\") pod \"node-ca-dwsnv\" (UID: \"ec6a5d8f-2407-444c-88f2-d3e836cc90ae\") " pod="openshift-image-registry/node-ca-dwsnv" Sep 07 13:39:30.257542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.257112 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-ovnkube-config\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.259421 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.259386 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-ovn-node-metrics-cert\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.259543 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.259514 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89a988f9-5e65-475e-9a65-8d45d2c1a94b-agent-certs\") pod \"konnectivity-agent-4hwvw\" (UID: \"89a988f9-5e65-475e-9a65-8d45d2c1a94b\") " pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:30.277201 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.277134 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr84w\" (UniqueName: \"kubernetes.io/projected/62efdb8c-5ab4-4949-b6aa-78a5e3422f7e-kube-api-access-zr84w\") pod \"ovnkube-node-dvsp8\" (UID: \"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.279071 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.279035 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5hw5\" (UniqueName: \"kubernetes.io/projected/ec6a5d8f-2407-444c-88f2-d3e836cc90ae-kube-api-access-n5hw5\") pod \"node-ca-dwsnv\" (UID: \"ec6a5d8f-2407-444c-88f2-d3e836cc90ae\") " pod="openshift-image-registry/node-ca-dwsnv" Sep 07 13:39:30.279224 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.279045 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpnsd\" (UniqueName: \"kubernetes.io/projected/249d9193-e8e4-41bc-8fdb-6520c9380538-kube-api-access-lpnsd\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:30.280112 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.280084 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcms7\" (UniqueName: \"kubernetes.io/projected/6e08b4de-ebe4-4470-b740-26ef5f5b4b0e-kube-api-access-vcms7\") pod \"aws-ebs-csi-driver-node-4vssd\" (UID: \"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.342585 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.342547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xgkfr" Sep 07 13:39:30.349606 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.349576 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nqd8q" Sep 07 13:39:30.359781 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.359753 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" Sep 07 13:39:30.365593 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.365569 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5pnqv" Sep 07 13:39:30.374624 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.374605 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mxgsh" Sep 07 13:39:30.381322 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.381298 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:30.393199 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.393112 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" Sep 07 13:39:30.403472 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.403452 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:30.413108 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.413083 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dwsnv" Sep 07 13:39:30.490821 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:30.490781 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b6de1a_77e8_4fcf_baf1_46dae4022e6b.slice/crio-cff3593a880d7000cf9862a857dda94a63948133c821035265be238d6d975cb4 WatchSource:0}: Error finding container cff3593a880d7000cf9862a857dda94a63948133c821035265be238d6d975cb4: Status 404 returned error can't find the container with id cff3593a880d7000cf9862a857dda94a63948133c821035265be238d6d975cb4 Sep 07 13:39:30.493453 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:30.493421 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf252181b_ac89_4f41_90d5_87c8d4659dec.slice/crio-742e081ab3904def6b3f8f532d2ac7c6fab472a9e4a4dddd3ecaf14fa3697e0d WatchSource:0}: Error finding container 742e081ab3904def6b3f8f532d2ac7c6fab472a9e4a4dddd3ecaf14fa3697e0d: Status 404 returned error can't find the container with id 742e081ab3904def6b3f8f532d2ac7c6fab472a9e4a4dddd3ecaf14fa3697e0d Sep 07 13:39:30.498625 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:30.498605 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a988f9_5e65_475e_9a65_8d45d2c1a94b.slice/crio-c79e31abc72a0f7375fe71a106cd4c1bcb3edc83d785c55777c4fb7bb1a3c530 WatchSource:0}: Error finding container c79e31abc72a0f7375fe71a106cd4c1bcb3edc83d785c55777c4fb7bb1a3c530: Status 404 returned error can't find the container with id c79e31abc72a0f7375fe71a106cd4c1bcb3edc83d785c55777c4fb7bb1a3c530 Sep 07 13:39:30.516633 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.516607 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:39:30.519138 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:30.519116 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6a5d8f_2407_444c_88f2_d3e836cc90ae.slice/crio-81f692ed0a8b2154033399205a9c84b2559657dda03874938d30ed8988e92ff8 WatchSource:0}: Error finding container 81f692ed0a8b2154033399205a9c84b2559657dda03874938d30ed8988e92ff8: Status 404 returned error can't find the container with id 81f692ed0a8b2154033399205a9c84b2559657dda03874938d30ed8988e92ff8 Sep 07 13:39:30.519927 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:30.519874 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81a57de_3969_4153_980b_4273bd38127d.slice/crio-09fa12e4175c9bc0f4bc94b48e14c9f0a1154d3170aa66696faea23068a28f1b WatchSource:0}: Error finding container 09fa12e4175c9bc0f4bc94b48e14c9f0a1154d3170aa66696faea23068a28f1b: Status 404 returned error can't find the container with id 09fa12e4175c9bc0f4bc94b48e14c9f0a1154d3170aa66696faea23068a28f1b Sep 07 13:39:30.520905 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:30.520881 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62efdb8c_5ab4_4949_b6aa_78a5e3422f7e.slice/crio-e80ca80e3885f7a41c583359c12db6ba0a403d3acd6bf513dce0caad59aafd57 WatchSource:0}: Error finding container e80ca80e3885f7a41c583359c12db6ba0a403d3acd6bf513dce0caad59aafd57: Status 404 returned error can't find the container with id e80ca80e3885f7a41c583359c12db6ba0a403d3acd6bf513dce0caad59aafd57 Sep 07 13:39:30.521652 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:30.521628 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e08b4de_ebe4_4470_b740_26ef5f5b4b0e.slice/crio-7192fbbd06ec9326abf92f62ec27b7ccfce4f964b91e690ef981c9ffcb40582d WatchSource:0}: Error finding container 7192fbbd06ec9326abf92f62ec27b7ccfce4f964b91e690ef981c9ffcb40582d: Status 404 returned error can't find the container with id 7192fbbd06ec9326abf92f62ec27b7ccfce4f964b91e690ef981c9ffcb40582d Sep 07 13:39:30.760107 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.760010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thl9b\" (UniqueName: \"kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b\") pod \"network-check-target-hgqkx\" (UID: \"b17085af-30e5-4059-a235-e829361adbf1\") " pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:30.760107 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.760086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:30.760366 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:30.760122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:30.760366 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.760212 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:39:30.760366 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.760235 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:30.760366 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.760244 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:39:30.760366 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.760258 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thl9b for pod openshift-network-diagnostics/network-check-target-hgqkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:30.760366 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.760236 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:30.760366 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.760298 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret podName:5e40cd05-9810-44c4-b3a5-2237f9f6ba56 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:31.760278506 +0000 UTC m=+4.099739393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret") pod "global-pull-secret-syncer-8d4vm" (UID: "5e40cd05-9810-44c4-b3a5-2237f9f6ba56") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:30.760366 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.760316 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b podName:b17085af-30e5-4059-a235-e829361adbf1 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:31.760306705 +0000 UTC m=+4.099767586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-thl9b" (UniqueName: "kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b") pod "network-check-target-hgqkx" (UID: "b17085af-30e5-4059-a235-e829361adbf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:30.760366 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:30.760334 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs podName:249d9193-e8e4-41bc-8fdb-6520c9380538 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:31.760325159 +0000 UTC m=+4.099786038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs") pod "network-metrics-daemon-l5pc5" (UID: "249d9193-e8e4-41bc-8fdb-6520c9380538") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:30.849287 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:30.849252 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346164b8_01d8_4eac_817a_3193599e898f.slice/crio-83ee3ee50022c6d6844144a83ef369add264e8283ec53501c574bb6be30aff79 WatchSource:0}: Error finding container 83ee3ee50022c6d6844144a83ef369add264e8283ec53501c574bb6be30aff79: Status 404 returned error can't find the container with id 83ee3ee50022c6d6844144a83ef369add264e8283ec53501c574bb6be30aff79 Sep 07 13:39:30.849778 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:39:30.849759 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a53b129_c0b0_4690_8c9d_017bcc36e246.slice/crio-fc35d84fbfc4ec530634458839afd059cc424f7be45dad7c4db1da2a7166bc31 WatchSource:0}: Error finding container fc35d84fbfc4ec530634458839afd059cc424f7be45dad7c4db1da2a7166bc31: Status 404 returned error can't find the container with id fc35d84fbfc4ec530634458839afd059cc424f7be45dad7c4db1da2a7166bc31 Sep 07 13:39:31.106550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.106411 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 13:34:30 +0000 UTC" deadline="2028-02-13 16:02:35.018334409 +0000 UTC" Sep 07 13:39:31.106550 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.106450 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12578h23m3.911889291s" Sep 07 13:39:31.121636 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.121518 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xgkfr" event={"ID":"f81a57de-3969-4153-980b-4273bd38127d","Type":"ContainerStarted","Data":"09fa12e4175c9bc0f4bc94b48e14c9f0a1154d3170aa66696faea23068a28f1b"} Sep 07 13:39:31.123997 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.123965 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4hwvw" event={"ID":"89a988f9-5e65-475e-9a65-8d45d2c1a94b","Type":"ContainerStarted","Data":"c79e31abc72a0f7375fe71a106cd4c1bcb3edc83d785c55777c4fb7bb1a3c530"} Sep 07 13:39:31.126027 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.125955 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5pnqv" event={"ID":"f252181b-ac89-4f41-90d5-87c8d4659dec","Type":"ContainerStarted","Data":"742e081ab3904def6b3f8f532d2ac7c6fab472a9e4a4dddd3ecaf14fa3697e0d"} Sep 07 13:39:31.129579 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.129543 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nqd8q" event={"ID":"d8b6de1a-77e8-4fcf-baf1-46dae4022e6b","Type":"ContainerStarted","Data":"cff3593a880d7000cf9862a857dda94a63948133c821035265be238d6d975cb4"} Sep 07 13:39:31.132938 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.132883 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dwsnv" event={"ID":"ec6a5d8f-2407-444c-88f2-d3e836cc90ae","Type":"ContainerStarted","Data":"81f692ed0a8b2154033399205a9c84b2559657dda03874938d30ed8988e92ff8"} Sep 07 13:39:31.134747 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.134715 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxgsh" event={"ID":"7a53b129-c0b0-4690-8c9d-017bcc36e246","Type":"ContainerStarted","Data":"fc35d84fbfc4ec530634458839afd059cc424f7be45dad7c4db1da2a7166bc31"} Sep 07 13:39:31.136255 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.136226 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" event={"ID":"346164b8-01d8-4eac-817a-3193599e898f","Type":"ContainerStarted","Data":"83ee3ee50022c6d6844144a83ef369add264e8283ec53501c574bb6be30aff79"} Sep 07 13:39:31.137731 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.137698 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" event={"ID":"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e","Type":"ContainerStarted","Data":"7192fbbd06ec9326abf92f62ec27b7ccfce4f964b91e690ef981c9ffcb40582d"} Sep 07 13:39:31.139310 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.139287 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" event={"ID":"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e","Type":"ContainerStarted","Data":"e80ca80e3885f7a41c583359c12db6ba0a403d3acd6bf513dce0caad59aafd57"} Sep 07 13:39:31.769571 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.769400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thl9b\" (UniqueName: \"kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b\") pod \"network-check-target-hgqkx\" (UID: \"b17085af-30e5-4059-a235-e829361adbf1\") " pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:31.769571 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.769482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:31.769571 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:31.769519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:31.769840 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:31.769617 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:31.769840 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:31.769670 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:31.769840 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:31.769681 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret podName:5e40cd05-9810-44c4-b3a5-2237f9f6ba56 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:33.769663452 +0000 UTC m=+6.109124350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret") pod "global-pull-secret-syncer-8d4vm" (UID: "5e40cd05-9810-44c4-b3a5-2237f9f6ba56") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:31.769840 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:31.769708 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs podName:249d9193-e8e4-41bc-8fdb-6520c9380538 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:33.769697754 +0000 UTC m=+6.109158641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs") pod "network-metrics-daemon-l5pc5" (UID: "249d9193-e8e4-41bc-8fdb-6520c9380538") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:31.769840 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:31.769620 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:39:31.769840 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:31.769730 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:39:31.769840 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:31.769744 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thl9b for pod openshift-network-diagnostics/network-check-target-hgqkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:31.769840 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:31.769775 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b podName:b17085af-30e5-4059-a235-e829361adbf1 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:33.769766419 +0000 UTC m=+6.109227300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-thl9b" (UniqueName: "kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b") pod "network-check-target-hgqkx" (UID: "b17085af-30e5-4059-a235-e829361adbf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:32.104760 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:32.104192 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:32.104760 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:32.104342 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:32.104976 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:32.104789 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:32.104976 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:32.104899 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:32.104976 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:32.104965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:32.105125 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:32.105031 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:32.106633 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:32.106581 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 13:34:30 +0000 UTC" deadline="2028-02-27 00:34:04.170143137 +0000 UTC" Sep 07 13:39:32.106633 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:32.106632 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12898h54m32.063515192s" Sep 07 13:39:32.155536 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:32.155496 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-22.ec2.internal" event={"ID":"aef2fcf38a14b047ca1c2b9fe741b9ea","Type":"ContainerStarted","Data":"74ffe60b6191df133b49cdff050fd62594ad934c4fe6020edd7a504b1ebe550d"} Sep 07 13:39:32.159677 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:32.159645 2574 generic.go:356] "Generic (PLEG): container finished" podID="6d5a7600a30e525f429974d6c4f3b00c" containerID="2ed4c281a34ced3e37b54836206590f243aa1a2f2c862b0731b04becd1672e9c" exitCode=0 Sep 07 13:39:32.159824 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:32.159701 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" event={"ID":"6d5a7600a30e525f429974d6c4f3b00c","Type":"ContainerDied","Data":"2ed4c281a34ced3e37b54836206590f243aa1a2f2c862b0731b04becd1672e9c"} Sep 07 13:39:32.207999 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:32.207933 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-22.ec2.internal" podStartSLOduration=3.20790847 podStartE2EDuration="3.20790847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:39:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:32.179224227 +0000 UTC m=+4.518685149" watchObservedRunningTime="2026-09-07 13:39:32.20790847 +0000 UTC m=+4.547369367" Sep 07 13:39:33.179433 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:33.178809 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" event={"ID":"6d5a7600a30e525f429974d6c4f3b00c","Type":"ContainerStarted","Data":"c9dcda59b7b37958d57749dc50519ac10dd469fcdfe86665aa93301b89d262ea"} Sep 07 13:39:33.784652 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:33.783567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:33.784652 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:33.783634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:33.784652 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:33.783693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thl9b\" (UniqueName: \"kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b\") pod \"network-check-target-hgqkx\" (UID: \"b17085af-30e5-4059-a235-e829361adbf1\") " pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:33.784652 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:33.783849 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:39:33.784652 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:33.783871 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:39:33.784652 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:33.783892 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thl9b for pod openshift-network-diagnostics/network-check-target-hgqkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:33.784652 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:33.783969 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b podName:b17085af-30e5-4059-a235-e829361adbf1 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:37.783935691 +0000 UTC m=+10.123396570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-thl9b" (UniqueName: "kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b") pod "network-check-target-hgqkx" (UID: "b17085af-30e5-4059-a235-e829361adbf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:33.784652 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:33.784442 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:33.784652 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:33.784501 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs podName:249d9193-e8e4-41bc-8fdb-6520c9380538 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:37.784484317 +0000 UTC m=+10.123945205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs") pod "network-metrics-daemon-l5pc5" (UID: "249d9193-e8e4-41bc-8fdb-6520c9380538") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:33.784652 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:33.784571 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:33.784652 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:33.784615 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret podName:5e40cd05-9810-44c4-b3a5-2237f9f6ba56 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:37.784601984 +0000 UTC m=+10.124062862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret") pod "global-pull-secret-syncer-8d4vm" (UID: "5e40cd05-9810-44c4-b3a5-2237f9f6ba56") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:34.105141 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:34.105066 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:34.105298 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:34.105204 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:34.105504 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:34.105431 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:34.105504 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:34.105469 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:34.105655 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:34.105547 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:34.105709 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:34.105643 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:36.104299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:36.104262 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:36.104749 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:36.104432 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:36.104809 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:36.104795 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:36.104905 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:36.104878 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:36.105021 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:36.104929 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:36.105021 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:36.104980 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:37.818510 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:37.818215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thl9b\" (UniqueName: \"kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b\") pod \"network-check-target-hgqkx\" (UID: \"b17085af-30e5-4059-a235-e829361adbf1\") " pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:37.818977 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:37.818363 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:39:37.818977 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:37.818556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:37.818977 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:37.818578 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:39:37.818977 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:37.818593 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thl9b for pod openshift-network-diagnostics/network-check-target-hgqkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:37.818977 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:37.818598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:37.818977 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:37.818668 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b podName:b17085af-30e5-4059-a235-e829361adbf1 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:45.818648139 +0000 UTC m=+18.158109030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-thl9b" (UniqueName: "kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b") pod "network-check-target-hgqkx" (UID: "b17085af-30e5-4059-a235-e829361adbf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:37.818977 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:37.818713 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:37.818977 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:37.818724 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:37.818977 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:37.818779 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs podName:249d9193-e8e4-41bc-8fdb-6520c9380538 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:45.81875896 +0000 UTC m=+18.158219841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs") pod "network-metrics-daemon-l5pc5" (UID: "249d9193-e8e4-41bc-8fdb-6520c9380538") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:37.818977 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:37.818799 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret podName:5e40cd05-9810-44c4-b3a5-2237f9f6ba56 nodeName:}" failed. No retries permitted until 2026-09-07 13:39:45.818788925 +0000 UTC m=+18.158249808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret") pod "global-pull-secret-syncer-8d4vm" (UID: "5e40cd05-9810-44c4-b3a5-2237f9f6ba56") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:38.105048 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:38.104967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:38.105267 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:38.105049 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:38.105267 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:38.105083 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:38.105267 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:38.105128 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:38.105267 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:38.105170 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:38.105267 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:38.105236 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:40.104151 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:40.104109 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:40.104151 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:40.104137 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:40.104715 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:40.104111 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:40.104715 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:40.104246 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:40.104715 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:40.104299 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:40.104715 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:40.104385 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:42.107526 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:42.107492 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:42.107526 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:42.107529 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:42.107928 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:42.107609 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:42.107928 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:42.107617 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:42.107928 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:42.107715 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:42.107928 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:42.107779 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:44.107165 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:44.107132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:44.107653 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:44.107132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:44.107653 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:44.107261 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:44.107653 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:44.107132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:44.107653 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:44.107399 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:44.107653 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:44.107438 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:45.881181 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:45.881139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thl9b\" (UniqueName: \"kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b\") pod \"network-check-target-hgqkx\" (UID: \"b17085af-30e5-4059-a235-e829361adbf1\") " pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:45.881814 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:45.881204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:45.881814 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:45.881238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:45.881814 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:45.881312 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:45.881814 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:45.881332 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:45.881814 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:45.881392 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret podName:5e40cd05-9810-44c4-b3a5-2237f9f6ba56 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:01.881375112 +0000 UTC m=+34.220835985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret") pod "global-pull-secret-syncer-8d4vm" (UID: "5e40cd05-9810-44c4-b3a5-2237f9f6ba56") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:39:45.881814 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:45.881315 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:39:45.881814 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:45.881436 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:39:45.881814 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:45.881456 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thl9b for pod openshift-network-diagnostics/network-check-target-hgqkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:45.881814 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:45.881409 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs podName:249d9193-e8e4-41bc-8fdb-6520c9380538 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:01.881400534 +0000 UTC m=+34.220861410 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs") pod "network-metrics-daemon-l5pc5" (UID: "249d9193-e8e4-41bc-8fdb-6520c9380538") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:39:45.881814 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:45.881514 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b podName:b17085af-30e5-4059-a235-e829361adbf1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:01.881498913 +0000 UTC m=+34.220959792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-thl9b" (UniqueName: "kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b") pod "network-check-target-hgqkx" (UID: "b17085af-30e5-4059-a235-e829361adbf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:39:46.104252 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:46.104214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:46.104252 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:46.104253 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:46.104493 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:46.104217 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:46.104493 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:46.104363 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:46.104493 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:46.104435 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:46.104616 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:46.104531 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:48.107131 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:48.107104 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:48.107623 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:48.107205 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:48.107623 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:48.107217 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:48.107623 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:48.107239 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:48.107623 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:48.107334 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:48.107623 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:48.107488 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:49.216876 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.216482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dwsnv" event={"ID":"ec6a5d8f-2407-444c-88f2-d3e836cc90ae","Type":"ContainerStarted","Data":"7fa64f7e4146f79600aec8a18f68ec84e2244aa32ed5aa9dc117da6171a0a996"} Sep 07 13:39:49.218370 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.218323 2574 generic.go:356] "Generic (PLEG): container finished" podID="7a53b129-c0b0-4690-8c9d-017bcc36e246" containerID="2054bda3fb13593cf4a89fc88378622f424ee11e71ea551f33f53532a7dfc066" exitCode=0 Sep 07 13:39:49.218461 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.218386 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxgsh" event={"ID":"7a53b129-c0b0-4690-8c9d-017bcc36e246","Type":"ContainerDied","Data":"2054bda3fb13593cf4a89fc88378622f424ee11e71ea551f33f53532a7dfc066"} Sep 07 13:39:49.220248 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.220139 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" event={"ID":"346164b8-01d8-4eac-817a-3193599e898f","Type":"ContainerStarted","Data":"d1f451ba4da25e8ae3b2de47d9e7f3eb51d3692406276e8e338b3ac6163bf03e"} Sep 07 13:39:49.222148 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.222002 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" event={"ID":"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e","Type":"ContainerStarted","Data":"3dcfc5a3d0a337484e7034ef6c8f1fac920ee07f3bbc365431f6bb924f2e3124"} Sep 07 13:39:49.224906 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.224883 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-acl-logging/0.log" Sep 07 13:39:49.225344 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.225317 2574 generic.go:356] "Generic (PLEG): container finished" podID="62efdb8c-5ab4-4949-b6aa-78a5e3422f7e" containerID="e615a1ff04d836474449964406dd4aae170c0b7e455b4a9a72e3e712557f9bf1" exitCode=1 Sep 07 13:39:49.225454 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.225415 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" event={"ID":"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e","Type":"ContainerStarted","Data":"991197e54024be3f4b98691a13717506d72af340f25a1711d40ec9d24072fccc"} Sep 07 13:39:49.225517 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.225484 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" event={"ID":"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e","Type":"ContainerDied","Data":"e615a1ff04d836474449964406dd4aae170c0b7e455b4a9a72e3e712557f9bf1"} Sep 07 13:39:49.225579 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.225533 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" event={"ID":"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e","Type":"ContainerStarted","Data":"e699b9138e9096a5dedf54d5f05e227df8a5a5add852fe9a885e54f39478ec79"} Sep 07 13:39:49.227226 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.227203 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4hwvw" event={"ID":"89a988f9-5e65-475e-9a65-8d45d2c1a94b","Type":"ContainerStarted","Data":"a273f5c125b1ccdef24cc9e6d50dfb1cc8f26410ffcff7c52966d3e7c4c2bd05"} Sep 07 13:39:49.229154 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.229121 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5pnqv" event={"ID":"f252181b-ac89-4f41-90d5-87c8d4659dec","Type":"ContainerStarted","Data":"a89a6e9459d8c5e9db997f2deb6212125e9fc0ba0112e75aae77b578e0bc9023"} Sep 07 13:39:49.233126 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.233096 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nqd8q" event={"ID":"d8b6de1a-77e8-4fcf-baf1-46dae4022e6b","Type":"ContainerStarted","Data":"864bc5410cd9bf5e1bf833bf8cd4dfb797df91a14e075ae7cf080a1feb26acd3"} Sep 07 13:39:49.243529 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.243470 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-22.ec2.internal" podStartSLOduration=20.243426857 podStartE2EDuration="20.243426857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:39:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:33.2025588 +0000 UTC m=+5.542019699" watchObservedRunningTime="2026-09-07 13:39:49.243426857 +0000 UTC m=+21.582887754" Sep 07 13:39:49.244313 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.244279 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dwsnv" podStartSLOduration=3.122171625 podStartE2EDuration="21.244265333s" totalImagesPullingTime="18.122093708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:49.243317402 +0000 UTC m=+21.582778297" watchObservedRunningTime="2026-09-07 13:39:49.244265333 +0000 UTC m=+21.583726229" Sep 07 13:39:49.282245 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.282151 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ffg6f" podStartSLOduration=3.485137452 podStartE2EDuration="21.282129406s" totalImagesPullingTime="17.796991954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:49.281035004 +0000 UTC m=+21.620495899" watchObservedRunningTime="2026-09-07 13:39:49.282129406 +0000 UTC m=+21.621590302" Sep 07 13:39:49.332387 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.332322 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4hwvw" podStartSLOduration=3.220351879 podStartE2EDuration="21.332306633s" totalImagesPullingTime="18.111954754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:49.332164454 +0000 UTC m=+21.671625349" watchObservedRunningTime="2026-09-07 13:39:49.332306633 +0000 UTC m=+21.671767528" Sep 07 13:39:49.384564 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.384364 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5pnqv" podStartSLOduration=2.873048869 podStartE2EDuration="21.384327871s" totalImagesPullingTime="18.511279002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:49.384072978 +0000 UTC m=+21.723533888" watchObservedRunningTime="2026-09-07 13:39:49.384327871 +0000 UTC m=+21.723788766" Sep 07 13:39:49.384940 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:49.384916 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nqd8q" podStartSLOduration=7.470640203 podStartE2EDuration="21.384905569s" totalImagesPullingTime="13.914265366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:49.351299905 +0000 UTC m=+21.690760800" watchObservedRunningTime="2026-09-07 13:39:49.384905569 +0000 UTC m=+21.724366466" Sep 07 13:39:50.052344 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.052317 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 13:39:50.104462 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.103901 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:50.104462 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.103909 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:50.104462 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:50.104097 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:50.104462 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.104122 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:50.104462 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:50.104218 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:50.104462 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:50.104280 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:50.117787 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.117641 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T13:39:50.052339042Z","UUID":"de624753-32a4-4cc8-be14-a88d3a1fa0c8","Handler":null,"Name":"","Endpoint":""} Sep 07 13:39:50.120376 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.120221 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 13:39:50.120376 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.120255 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 13:39:50.238099 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.238057 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" event={"ID":"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e","Type":"ContainerStarted","Data":"c5c83c42c8e5b4bfcad27d6ba3cc685c2a8db3b5be3ad06a0463b5762b977e2b"} Sep 07 13:39:50.241654 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.241632 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-acl-logging/0.log" Sep 07 13:39:50.242091 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.242067 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" event={"ID":"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e","Type":"ContainerStarted","Data":"3cdb11d9bee7b9288c57496e4a0e656e5511af50448f86cb258930b805dbd6d4"} Sep 07 13:39:50.242202 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.242136 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" event={"ID":"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e","Type":"ContainerStarted","Data":"9ae493f4b97f99b3ca202882bcbdb02361c3df29abbd43f06fa8618a86f29536"} Sep 07 13:39:50.242202 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.242184 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" event={"ID":"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e","Type":"ContainerStarted","Data":"0755ad64339d922a7983653d6f666abfaaa3f89728310d0f1a385fedea97a28f"} Sep 07 13:39:50.243739 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:50.243709 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xgkfr" event={"ID":"f81a57de-3969-4153-980b-4273bd38127d","Type":"ContainerStarted","Data":"84f86360fa4f27ab6888e96979916fa66470bfcaa4d9446a66c88aede63d0c0f"} Sep 07 13:39:51.249260 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:51.249225 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" event={"ID":"6e08b4de-ebe4-4470-b740-26ef5f5b4b0e","Type":"ContainerStarted","Data":"5a0989d40845c8694d445d8b094b59855bc06baab642f4dc881d21972c3c469f"} Sep 07 13:39:51.276381 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:51.276306 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xgkfr" podStartSLOduration=9.39123708 podStartE2EDuration="23.27629069s" totalImagesPullingTime="13.88505361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:50.28282725 +0000 UTC m=+22.622288146" watchObservedRunningTime="2026-09-07 13:39:51.27629069 +0000 UTC m=+23.615751585" Sep 07 13:39:51.675096 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:51.675067 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:51.675739 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:51.675714 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:51.694138 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:51.694092 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4vssd" podStartSLOduration=3.511760892 podStartE2EDuration="23.694073694s" totalImagesPullingTime="20.182312802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:51.276987776 +0000 UTC m=+23.616448672" watchObservedRunningTime="2026-09-07 13:39:51.694073694 +0000 UTC m=+24.033534592" Sep 07 13:39:52.104223 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:52.104077 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:52.104223 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:52.104077 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:52.104223 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:52.104215 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:52.104539 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:52.104251 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:52.104539 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:52.104365 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:52.104539 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:52.104449 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:52.257199 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:52.257170 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-acl-logging/0.log" Sep 07 13:39:52.257777 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:52.257738 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" event={"ID":"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e","Type":"ContainerStarted","Data":"25ef41ec65cc0eced727182399355bc9a4c66cc2e7ea26193674d9fbbaf9aeef"} Sep 07 13:39:54.104613 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:54.104417 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:54.105155 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:54.104418 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:54.105155 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:54.104689 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:54.105155 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:54.104423 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:54.105155 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:54.104776 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:54.105155 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:54.104871 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:54.263614 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:54.263578 2574 generic.go:356] "Generic (PLEG): container finished" podID="7a53b129-c0b0-4690-8c9d-017bcc36e246" containerID="7ff1f28519660776703a403e5f8b9ed45ea4ed031dc98ba177d829c4e2c54493" exitCode=0 Sep 07 13:39:54.263777 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:54.263646 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxgsh" event={"ID":"7a53b129-c0b0-4690-8c9d-017bcc36e246","Type":"ContainerDied","Data":"7ff1f28519660776703a403e5f8b9ed45ea4ed031dc98ba177d829c4e2c54493"} Sep 07 13:39:54.267173 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:54.267154 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-acl-logging/0.log" Sep 07 13:39:54.267611 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:54.267578 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" event={"ID":"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e","Type":"ContainerStarted","Data":"5831b6f5aec9e25cb69c51240e63f8332eecc987cc8c25169cfecc6086856dec"} Sep 07 13:39:54.267866 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:54.267847 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:54.268025 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:54.268012 2574 scope.go:117] "RemoveContainer" containerID="e615a1ff04d836474449964406dd4aae170c0b7e455b4a9a72e3e712557f9bf1" Sep 07 13:39:54.284195 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:54.284177 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:55.272218 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.272031 2574 generic.go:356] "Generic (PLEG): container finished" podID="7a53b129-c0b0-4690-8c9d-017bcc36e246" containerID="172889c4ab88cfe1da1d504726098b933c9bf358a32ad5b0babea31ccd3123d2" exitCode=0 Sep 07 13:39:55.272652 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.272114 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxgsh" event={"ID":"7a53b129-c0b0-4690-8c9d-017bcc36e246","Type":"ContainerDied","Data":"172889c4ab88cfe1da1d504726098b933c9bf358a32ad5b0babea31ccd3123d2"} Sep 07 13:39:55.276491 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.276472 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-acl-logging/0.log" Sep 07 13:39:55.276878 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.276857 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" event={"ID":"62efdb8c-5ab4-4949-b6aa-78a5e3422f7e","Type":"ContainerStarted","Data":"f218c98ce3abca2f9ee641a2608de6e9a26acaf2e0415da7ba51eb541727b99c"} Sep 07 13:39:55.277028 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.277013 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 07 13:39:55.277303 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.277282 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:55.292581 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.292558 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:55.753442 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.753383 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" podStartSLOduration=9.615894812 podStartE2EDuration="27.753340048s" totalImagesPullingTime="18.137445236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:39:55.351259644 +0000 UTC m=+27.690720551" watchObservedRunningTime="2026-09-07 13:39:55.753340048 +0000 UTC m=+28.092800944" Sep 07 13:39:55.753866 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.753841 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l5pc5"] Sep 07 13:39:55.753984 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.753967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:55.754095 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:55.754070 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:55.759246 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.759220 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hgqkx"] Sep 07 13:39:55.759384 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.759332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:55.759486 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:55.759459 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:55.759874 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.759850 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8d4vm"] Sep 07 13:39:55.759970 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:55.759944 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:55.760059 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:55.760039 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:56.104414 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:56.104376 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:39:56.233169 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:56.233133 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:39:56.281877 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:56.281841 2574 generic.go:356] "Generic (PLEG): container finished" podID="7a53b129-c0b0-4690-8c9d-017bcc36e246" containerID="f5ea5699f76392e0d2593320dff68e97e12cab2a1d7132f1b0344f402c41e1fb" exitCode=0 Sep 07 13:39:56.282496 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:56.281926 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxgsh" event={"ID":"7a53b129-c0b0-4690-8c9d-017bcc36e246","Type":"ContainerDied","Data":"f5ea5699f76392e0d2593320dff68e97e12cab2a1d7132f1b0344f402c41e1fb"} Sep 07 13:39:56.282496 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:56.282025 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 07 13:39:56.806429 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:56.806389 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:39:57.104111 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:57.104033 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:57.104280 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:57.104144 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:39:57.367694 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:57.367590 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:57.368123 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:57.367775 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 07 13:39:57.368452 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:57.368416 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4hwvw" Sep 07 13:39:57.446320 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:57.446285 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:39:58.107844 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:58.107768 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:39:58.107983 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:58.107886 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:39:58.107983 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:58.107932 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:39:58.108095 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:58.108034 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:39:58.298919 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:58.298873 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" podUID="62efdb8c-5ab4-4949-b6aa-78a5e3422f7e" containerName="ovnkube-controller" probeResult="failure" output="" Sep 07 13:39:58.761463 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:58.761210 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:39:59.104045 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:39:59.103963 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:39:59.104196 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:39:59.104086 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:40:00.103461 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:00.103424 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:40:00.103461 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:00.103449 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:40:00.103949 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:00.103554 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgqkx" podUID="b17085af-30e5-4059-a235-e829361adbf1" Sep 07 13:40:00.103949 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:00.103690 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8d4vm" podUID="5e40cd05-9810-44c4-b3a5-2237f9f6ba56" Sep 07 13:40:00.159101 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:00.159069 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:01.103371 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:01.103331 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:40:01.103552 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:01.103524 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5pc5" podUID="249d9193-e8e4-41bc-8fdb-6520c9380538" Sep 07 13:40:01.295814 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:01.295777 2574 generic.go:356] "Generic (PLEG): container finished" podID="7a53b129-c0b0-4690-8c9d-017bcc36e246" containerID="293cfbeb665cfe3032fb4d0bac00bef37e1bcf96898b57ecd0633537a17135cd" exitCode=0 Sep 07 13:40:01.295984 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:01.295862 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxgsh" event={"ID":"7a53b129-c0b0-4690-8c9d-017bcc36e246","Type":"ContainerDied","Data":"293cfbeb665cfe3032fb4d0bac00bef37e1bcf96898b57ecd0633537a17135cd"} Sep 07 13:40:01.905158 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:01.905115 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:40:01.905158 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:01.905158 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:40:01.905527 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:01.905191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thl9b\" (UniqueName: \"kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b\") pod \"network-check-target-hgqkx\" (UID: \"b17085af-30e5-4059-a235-e829361adbf1\") " pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:40:01.905527 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:01.905256 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:40:01.905527 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:01.905278 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:40:01.905527 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:01.905316 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs podName:249d9193-e8e4-41bc-8fdb-6520c9380538 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:33.90530182 +0000 UTC m=+66.244762697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs") pod "network-metrics-daemon-l5pc5" (UID: "249d9193-e8e4-41bc-8fdb-6520c9380538") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:40:01.905527 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:01.905343 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret podName:5e40cd05-9810-44c4-b3a5-2237f9f6ba56 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:33.905325116 +0000 UTC m=+66.244786000 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret") pod "global-pull-secret-syncer-8d4vm" (UID: "5e40cd05-9810-44c4-b3a5-2237f9f6ba56") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:40:01.905527 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:01.905288 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:40:01.905527 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:01.905392 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:40:01.905527 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:01.905406 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thl9b for pod openshift-network-diagnostics/network-check-target-hgqkx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:40:01.905527 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:01.905447 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b podName:b17085af-30e5-4059-a235-e829361adbf1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:33.90543602 +0000 UTC m=+66.244896895 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-thl9b" (UniqueName: "kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b") pod "network-check-target-hgqkx" (UID: "b17085af-30e5-4059-a235-e829361adbf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:40:02.017161 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.017136 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-22.ec2.internal" event="NodeReady" Sep 07 13:40:02.017433 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.017259 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 13:40:02.087485 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.087442 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4tchg"] Sep 07 13:40:02.108673 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.108642 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k4zj2"] Sep 07 13:40:02.109095 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.108781 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.114341 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.114315 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 13:40:02.114532 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.114514 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 13:40:02.114827 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.114810 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-npl4p\"" Sep 07 13:40:02.134575 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.134547 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4tchg"] Sep 07 13:40:02.134705 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.134589 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k4zj2"] Sep 07 13:40:02.134705 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.134635 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k4zj2" Sep 07 13:40:02.134794 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.134759 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:40:02.134794 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.134778 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:40:02.138114 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.138095 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 13:40:02.139216 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.139199 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 13:40:02.139435 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.139419 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 13:40:02.139532 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.139520 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-96jw5\"" Sep 07 13:40:02.139593 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.139573 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 13:40:02.139649 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.139599 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 13:40:02.139649 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.139636 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ppdgm\"" Sep 07 13:40:02.139872 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.139860 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 13:40:02.207265 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.207230 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e67131-76b3-4498-b189-b5e75264b7e0-config-volume\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.207265 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.207263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b2ba3dd-f860-479a-827d-e041f79a87dc-cert\") pod \"ingress-canary-k4zj2\" (UID: \"4b2ba3dd-f860-479a-827d-e041f79a87dc\") " pod="openshift-ingress-canary/ingress-canary-k4zj2" Sep 07 13:40:02.207493 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.207282 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4e67131-76b3-4498-b189-b5e75264b7e0-tmp-dir\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.207493 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.207368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.207493 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.207453 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4xmq\" (UniqueName: \"kubernetes.io/projected/b4e67131-76b3-4498-b189-b5e75264b7e0-kube-api-access-b4xmq\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.207493 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.207487 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2cdz\" (UniqueName: \"kubernetes.io/projected/4b2ba3dd-f860-479a-827d-e041f79a87dc-kube-api-access-x2cdz\") pod \"ingress-canary-k4zj2\" (UID: \"4b2ba3dd-f860-479a-827d-e041f79a87dc\") " pod="openshift-ingress-canary/ingress-canary-k4zj2" Sep 07 13:40:02.301467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.301393 2574 generic.go:356] "Generic (PLEG): container finished" podID="7a53b129-c0b0-4690-8c9d-017bcc36e246" containerID="092155ba4dadd9da751a6b1e8da6ca40921563e6b766396c88215859f173f66e" exitCode=0 Sep 07 13:40:02.301467 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.301457 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxgsh" event={"ID":"7a53b129-c0b0-4690-8c9d-017bcc36e246","Type":"ContainerDied","Data":"092155ba4dadd9da751a6b1e8da6ca40921563e6b766396c88215859f173f66e"} Sep 07 13:40:02.307835 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.307813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4xmq\" (UniqueName: \"kubernetes.io/projected/b4e67131-76b3-4498-b189-b5e75264b7e0-kube-api-access-b4xmq\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.307944 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.307852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2cdz\" (UniqueName: \"kubernetes.io/projected/4b2ba3dd-f860-479a-827d-e041f79a87dc-kube-api-access-x2cdz\") pod \"ingress-canary-k4zj2\" (UID: \"4b2ba3dd-f860-479a-827d-e041f79a87dc\") " pod="openshift-ingress-canary/ingress-canary-k4zj2" Sep 07 13:40:02.307944 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.307884 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e67131-76b3-4498-b189-b5e75264b7e0-config-volume\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.307944 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.307899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b2ba3dd-f860-479a-827d-e041f79a87dc-cert\") pod \"ingress-canary-k4zj2\" (UID: \"4b2ba3dd-f860-479a-827d-e041f79a87dc\") " pod="openshift-ingress-canary/ingress-canary-k4zj2" Sep 07 13:40:02.307944 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.307916 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4e67131-76b3-4498-b189-b5e75264b7e0-tmp-dir\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.308132 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.307944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.308132 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:02.308128 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:40:02.308272 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:02.308206 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls podName:b4e67131-76b3-4498-b189-b5e75264b7e0 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:02.808184779 +0000 UTC m=+35.147645670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls") pod "dns-default-4tchg" (UID: "b4e67131-76b3-4498-b189-b5e75264b7e0") : secret "dns-default-metrics-tls" not found Sep 07 13:40:02.308322 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.308280 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4e67131-76b3-4498-b189-b5e75264b7e0-tmp-dir\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.308477 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.308460 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e67131-76b3-4498-b189-b5e75264b7e0-config-volume\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.312136 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.312111 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b2ba3dd-f860-479a-827d-e041f79a87dc-cert\") pod \"ingress-canary-k4zj2\" (UID: \"4b2ba3dd-f860-479a-827d-e041f79a87dc\") " pod="openshift-ingress-canary/ingress-canary-k4zj2" Sep 07 13:40:02.319318 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.319290 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2cdz\" (UniqueName: \"kubernetes.io/projected/4b2ba3dd-f860-479a-827d-e041f79a87dc-kube-api-access-x2cdz\") pod \"ingress-canary-k4zj2\" (UID: \"4b2ba3dd-f860-479a-827d-e041f79a87dc\") " pod="openshift-ingress-canary/ingress-canary-k4zj2" Sep 07 13:40:02.322574 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.322555 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4xmq\" (UniqueName: \"kubernetes.io/projected/b4e67131-76b3-4498-b189-b5e75264b7e0-kube-api-access-b4xmq\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.444279 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.444243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k4zj2" Sep 07 13:40:02.760367 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.760182 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k4zj2"] Sep 07 13:40:02.766880 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:40:02.766855 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2ba3dd_f860_479a_827d_e041f79a87dc.slice/crio-c189f90e78cd7f0015d2d11d71d70d2bb86cb563a4acc7f121760729eab870ae WatchSource:0}: Error finding container c189f90e78cd7f0015d2d11d71d70d2bb86cb563a4acc7f121760729eab870ae: Status 404 returned error can't find the container with id c189f90e78cd7f0015d2d11d71d70d2bb86cb563a4acc7f121760729eab870ae Sep 07 13:40:02.812247 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.812215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:02.812416 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:02.812371 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:40:02.812467 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:02.812435 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls podName:b4e67131-76b3-4498-b189-b5e75264b7e0 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:03.812419993 +0000 UTC m=+36.151880872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls") pod "dns-default-4tchg" (UID: "b4e67131-76b3-4498-b189-b5e75264b7e0") : secret "dns-default-metrics-tls" not found Sep 07 13:40:02.974577 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:02.974548 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:03.104289 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.104203 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:40:03.108312 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.108288 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gbgxg\"" Sep 07 13:40:03.108762 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.108749 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 13:40:03.305455 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.305414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k4zj2" event={"ID":"4b2ba3dd-f860-479a-827d-e041f79a87dc","Type":"ContainerStarted","Data":"c189f90e78cd7f0015d2d11d71d70d2bb86cb563a4acc7f121760729eab870ae"} Sep 07 13:40:03.309364 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.309319 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mxgsh" event={"ID":"7a53b129-c0b0-4690-8c9d-017bcc36e246","Type":"ContainerStarted","Data":"2e1eaa940f5b6fe0f2f53090169e2afa4aabc76c00bbe00fca2ee477ae74a433"} Sep 07 13:40:03.330575 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.330541 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:03.342443 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.342389 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mxgsh" podStartSLOduration=7.547278616 podStartE2EDuration="35.342373093s" totalImagesPullingTime="27.795094477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:03.340221069 +0000 UTC m=+35.679681964" watchObservedRunningTime="2026-09-07 13:40:03.342373093 +0000 UTC m=+35.681833989" Sep 07 13:40:03.432162 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.432078 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:03.533047 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.532952 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:03.633433 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.633397 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:03.763231 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.763194 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:03.822434 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:03.822398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:03.822611 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:03.822526 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:40:03.822611 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:03.822595 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls podName:b4e67131-76b3-4498-b189-b5e75264b7e0 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:05.822579219 +0000 UTC m=+38.162040098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls") pod "dns-default-4tchg" (UID: "b4e67131-76b3-4498-b189-b5e75264b7e0") : secret "dns-default-metrics-tls" not found Sep 07 13:40:05.316173 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:05.316143 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k4zj2" event={"ID":"4b2ba3dd-f860-479a-827d-e041f79a87dc","Type":"ContainerStarted","Data":"f018c6fce8cf687364178d6cbd8862412f14a035d74939c0d0fe93aaee7aaeeb"} Sep 07 13:40:05.338572 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:05.338504 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k4zj2" podStartSLOduration=0.89718929 podStartE2EDuration="3.338480441s" totalImagesPullingTime="2.441291151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:05.338249697 +0000 UTC m=+37.677710598" watchObservedRunningTime="2026-09-07 13:40:05.338480441 +0000 UTC m=+37.677941401" Sep 07 13:40:05.838525 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:05.838485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:05.838696 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:05.838623 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:40:05.838696 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:05.838681 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls podName:b4e67131-76b3-4498-b189-b5e75264b7e0 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:09.838667425 +0000 UTC m=+42.178128300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls") pod "dns-default-4tchg" (UID: "b4e67131-76b3-4498-b189-b5e75264b7e0") : secret "dns-default-metrics-tls" not found Sep 07 13:40:06.776882 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:06.776833 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:06.862753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:06.862709 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:07.181232 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:07.181148 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:07.252900 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:07.252869 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:09.865547 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:09.865510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:09.865932 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:09.865676 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:40:09.865932 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:09.865752 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls podName:b4e67131-76b3-4498-b189-b5e75264b7e0 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:17.865726432 +0000 UTC m=+50.205187311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls") pod "dns-default-4tchg" (UID: "b4e67131-76b3-4498-b189-b5e75264b7e0") : secret "dns-default-metrics-tls" not found Sep 07 13:40:14.551609 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:14.551575 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:14.664542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:14.664507 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:17.922631 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:17.922584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:17.923043 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:17.922731 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:40:17.923043 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:17.922796 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls podName:b4e67131-76b3-4498-b189-b5e75264b7e0 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:33.92277982 +0000 UTC m=+66.262240693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls") pod "dns-default-4tchg" (UID: "b4e67131-76b3-4498-b189-b5e75264b7e0") : secret "dns-default-metrics-tls" not found Sep 07 13:40:19.152199 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:19.152164 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:19.343563 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:19.343529 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:24.986584 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:24.986550 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:25.225581 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:25.225549 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:25.331813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:25.331731 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:28.296577 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:28.296550 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvsp8" Sep 07 13:40:28.496331 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:28.496293 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:28.594434 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:28.594330 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:30.518362 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:30.518314 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:33.933702 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:33.933657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:40:33.933702 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:33.933707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:40:33.934253 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:33.933740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:40:33.934253 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:33.933757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thl9b\" (UniqueName: \"kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b\") pod \"network-check-target-hgqkx\" (UID: \"b17085af-30e5-4059-a235-e829361adbf1\") " pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:40:33.934253 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:33.933857 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:40:33.934253 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:33.933936 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls podName:b4e67131-76b3-4498-b189-b5e75264b7e0 nodeName:}" failed. No retries permitted until 2026-09-07 13:41:05.933915556 +0000 UTC m=+98.273376436 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls") pod "dns-default-4tchg" (UID: "b4e67131-76b3-4498-b189-b5e75264b7e0") : secret "dns-default-metrics-tls" not found Sep 07 13:40:33.940145 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:33.940123 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 13:40:33.940401 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:33.940381 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 13:40:33.940886 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:33.940872 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 13:40:33.944047 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:33.944032 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 13:40:33.944105 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:33.944095 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs podName:249d9193-e8e4-41bc-8fdb-6520c9380538 nodeName:}" failed. No retries permitted until 2026-09-07 13:41:37.94406882 +0000 UTC m=+130.283529695 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs") pod "network-metrics-daemon-l5pc5" (UID: "249d9193-e8e4-41bc-8fdb-6520c9380538") : secret "metrics-daemon-secret" not found Sep 07 13:40:33.946686 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:33.946667 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 13:40:33.946878 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:33.946862 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e40cd05-9810-44c4-b3a5-2237f9f6ba56-original-pull-secret\") pod \"global-pull-secret-syncer-8d4vm\" (UID: \"5e40cd05-9810-44c4-b3a5-2237f9f6ba56\") " pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:40:33.954089 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:33.954069 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8d4vm" Sep 07 13:40:33.956702 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:33.956675 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thl9b\" (UniqueName: \"kubernetes.io/projected/b17085af-30e5-4059-a235-e829361adbf1-kube-api-access-thl9b\") pod \"network-check-target-hgqkx\" (UID: \"b17085af-30e5-4059-a235-e829361adbf1\") " pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:40:34.225499 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.225444 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8d4vm"] Sep 07 13:40:34.229414 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:40:34.229380 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e40cd05_9810_44c4_b3a5_2237f9f6ba56.slice/crio-9fb974adfefe294828c89c8985a80010af93782ac00f6f7a7e7f8165bae91cb2 WatchSource:0}: Error finding container 9fb974adfefe294828c89c8985a80010af93782ac00f6f7a7e7f8165bae91cb2: Status 404 returned error can't find the container with id 9fb974adfefe294828c89c8985a80010af93782ac00f6f7a7e7f8165bae91cb2 Sep 07 13:40:34.254556 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.254532 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ppdgm\"" Sep 07 13:40:34.261757 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.261729 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:40:34.386751 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.386718 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8d4vm" event={"ID":"5e40cd05-9810-44c4-b3a5-2237f9f6ba56","Type":"ContainerStarted","Data":"9fb974adfefe294828c89c8985a80010af93782ac00f6f7a7e7f8165bae91cb2"} Sep 07 13:40:34.426866 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.426834 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:34.535033 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.534952 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hgqkx"] Sep 07 13:40:34.538101 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:40:34.538068 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17085af_30e5_4059_a235_e829361adbf1.slice/crio-db623b0b8c6a994374a44d2b6d031d34a795f94a565b7717c8e648c57af2d062 WatchSource:0}: Error finding container db623b0b8c6a994374a44d2b6d031d34a795f94a565b7717c8e648c57af2d062: Status 404 returned error can't find the container with id db623b0b8c6a994374a44d2b6d031d34a795f94a565b7717c8e648c57af2d062 Sep 07 13:40:34.855728 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.855639 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g54f9"] Sep 07 13:40:34.858162 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.858142 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g54f9" Sep 07 13:40:34.864445 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.864423 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cvj7d\"" Sep 07 13:40:34.865966 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.865937 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 07 13:40:34.866068 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.865986 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 07 13:40:34.871185 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.871164 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g54f9"] Sep 07 13:40:34.942398 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.942325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6ml\" (UniqueName: \"kubernetes.io/projected/5ba2609a-b6c3-4972-9929-d2ee663ef8c0-kube-api-access-6h6ml\") pod \"volume-data-source-validator-695c895bd6-g54f9\" (UID: \"5ba2609a-b6c3-4972-9929-d2ee663ef8c0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g54f9" Sep 07 13:40:34.978964 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.978927 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-69cd4f8474-865kt"] Sep 07 13:40:34.981714 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.981618 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7"] Sep 07 13:40:34.981842 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.981759 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:34.983946 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.983683 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jfpl8"] Sep 07 13:40:34.984077 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.983984 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:34.985876 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.985853 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:34.987043 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.987025 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 07 13:40:34.987219 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.987088 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 07 13:40:34.987219 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.987098 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ggsmh\"" Sep 07 13:40:34.988318 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.987664 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 07 13:40:34.988839 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.988664 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 07 13:40:34.989452 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.989251 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 07 13:40:34.991031 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.990915 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 07 13:40:34.996898 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.996872 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 07 13:40:34.997123 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.997101 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 07 13:40:34.998070 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.997497 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 07 13:40:34.998070 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.997868 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 13:40:34.998070 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.997868 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 13:40:34.998279 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.998267 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v8jhn\"" Sep 07 13:40:34.998635 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.998393 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 07 13:40:34.998635 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.998444 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 07 13:40:34.998780 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:34.998706 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7"] Sep 07 13:40:35.003428 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.002605 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7k56h\"" Sep 07 13:40:35.005379 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.004934 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 07 13:40:35.006898 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.006839 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jfpl8"] Sep 07 13:40:35.009750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.009701 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69cd4f8474-865kt"] Sep 07 13:40:35.010446 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.009906 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 07 13:40:35.044053 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.043762 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6ml\" (UniqueName: \"kubernetes.io/projected/5ba2609a-b6c3-4972-9929-d2ee663ef8c0-kube-api-access-6h6ml\") pod \"volume-data-source-validator-695c895bd6-g54f9\" (UID: \"5ba2609a-b6c3-4972-9929-d2ee663ef8c0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g54f9" Sep 07 13:40:35.053852 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.053822 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6ml\" (UniqueName: \"kubernetes.io/projected/5ba2609a-b6c3-4972-9929-d2ee663ef8c0-kube-api-access-6h6ml\") pod \"volume-data-source-validator-695c895bd6-g54f9\" (UID: \"5ba2609a-b6c3-4972-9929-d2ee663ef8c0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g54f9" Sep 07 13:40:35.145037 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.144954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:35.145037 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.145004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szt2p\" (UniqueName: \"kubernetes.io/projected/b51efc57-cf6f-40b7-9057-e0d5870963c8-kube-api-access-szt2p\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:35.145261 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.145069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b51efc57-cf6f-40b7-9057-e0d5870963c8-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:35.145261 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.145121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b687009b-a57a-4c02-925e-af07c3ad9667-serving-cert\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.145261 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.145136 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b687009b-a57a-4c02-925e-af07c3ad9667-trusted-ca\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.145261 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.145162 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-default-certificate\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.145261 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.145192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.145505 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.145266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b687009b-a57a-4c02-925e-af07c3ad9667-config\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.145505 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.145298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghbh8\" (UniqueName: \"kubernetes.io/projected/b687009b-a57a-4c02-925e-af07c3ad9667-kube-api-access-ghbh8\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.145505 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.145406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.145505 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.145451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-stats-auth\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.145505 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.145483 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ldgm\" (UniqueName: \"kubernetes.io/projected/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-kube-api-access-7ldgm\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.169051 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.169017 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g54f9" Sep 07 13:40:35.245978 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.245944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-default-certificate\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.246147 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.245993 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.246147 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.246031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b687009b-a57a-4c02-925e-af07c3ad9667-config\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.246147 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.246065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghbh8\" (UniqueName: \"kubernetes.io/projected/b687009b-a57a-4c02-925e-af07c3ad9667-kube-api-access-ghbh8\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.246533 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:35.246174 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 13:40:35.246533 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:35.246256 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs podName:3e80ef99-5f11-4f55-bfc0-bf8344d479a1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:35.746231234 +0000 UTC m=+68.085692122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs") pod "router-default-69cd4f8474-865kt" (UID: "3e80ef99-5f11-4f55-bfc0-bf8344d479a1") : secret "router-metrics-certs-default" not found Sep 07 13:40:35.246533 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.246488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.246648 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.246531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-stats-auth\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.246648 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.246566 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ldgm\" (UniqueName: \"kubernetes.io/projected/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-kube-api-access-7ldgm\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.246648 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.246607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:35.246648 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:35.246622 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle podName:3e80ef99-5f11-4f55-bfc0-bf8344d479a1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:35.746605082 +0000 UTC m=+68.086065972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle") pod "router-default-69cd4f8474-865kt" (UID: "3e80ef99-5f11-4f55-bfc0-bf8344d479a1") : configmap references non-existent config key: service-ca.crt Sep 07 13:40:35.246784 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.246653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szt2p\" (UniqueName: \"kubernetes.io/projected/b51efc57-cf6f-40b7-9057-e0d5870963c8-kube-api-access-szt2p\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:35.246784 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.246686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b51efc57-cf6f-40b7-9057-e0d5870963c8-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:35.246784 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:35.246691 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:35.246784 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:35.246738 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls podName:b51efc57-cf6f-40b7-9057-e0d5870963c8 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:35.746725883 +0000 UTC m=+68.086186763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ljqt7" (UID: "b51efc57-cf6f-40b7-9057-e0d5870963c8") : secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:35.246784 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.246753 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b687009b-a57a-4c02-925e-af07c3ad9667-serving-cert\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.246784 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.246780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b687009b-a57a-4c02-925e-af07c3ad9667-trusted-ca\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.246991 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.246836 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b687009b-a57a-4c02-925e-af07c3ad9667-config\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.247520 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.247491 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b51efc57-cf6f-40b7-9057-e0d5870963c8-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:35.247708 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.247629 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b687009b-a57a-4c02-925e-af07c3ad9667-trusted-ca\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.249828 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.249801 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-stats-auth\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.250383 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.250338 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:35.250581 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.250541 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b687009b-a57a-4c02-925e-af07c3ad9667-serving-cert\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.256150 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.256106 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-default-certificate\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.261266 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.261232 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ldgm\" (UniqueName: \"kubernetes.io/projected/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-kube-api-access-7ldgm\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.264004 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.263697 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szt2p\" (UniqueName: \"kubernetes.io/projected/b51efc57-cf6f-40b7-9057-e0d5870963c8-kube-api-access-szt2p\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:35.264004 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.263973 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghbh8\" (UniqueName: \"kubernetes.io/projected/b687009b-a57a-4c02-925e-af07c3ad9667-kube-api-access-ghbh8\") pod \"console-operator-85b454874b-jfpl8\" (UID: \"b687009b-a57a-4c02-925e-af07c3ad9667\") " pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.317601 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.317566 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:35.340177 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.340139 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:35.393879 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.393694 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hgqkx" event={"ID":"b17085af-30e5-4059-a235-e829361adbf1","Type":"ContainerStarted","Data":"db623b0b8c6a994374a44d2b6d031d34a795f94a565b7717c8e648c57af2d062"} Sep 07 13:40:35.455721 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.455636 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g54f9"] Sep 07 13:40:35.459001 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:40:35.458968 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba2609a_b6c3_4972_9929_d2ee663ef8c0.slice/crio-f7b8f170b9597a04ec5577582500d959267ca5451b80781182dbfb1c9a8e1b25 WatchSource:0}: Error finding container f7b8f170b9597a04ec5577582500d959267ca5451b80781182dbfb1c9a8e1b25: Status 404 returned error can't find the container with id f7b8f170b9597a04ec5577582500d959267ca5451b80781182dbfb1c9a8e1b25 Sep 07 13:40:35.605233 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.605186 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jfpl8"] Sep 07 13:40:35.610043 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:40:35.610014 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb687009b_a57a_4c02_925e_af07c3ad9667.slice/crio-97bb17b4eb420b832483fb2129041b194e9920241e23dd9acf3e7c9aafc34aaa WatchSource:0}: Error finding container 97bb17b4eb420b832483fb2129041b194e9920241e23dd9acf3e7c9aafc34aaa: Status 404 returned error can't find the container with id 97bb17b4eb420b832483fb2129041b194e9920241e23dd9acf3e7c9aafc34aaa Sep 07 13:40:35.751760 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.751722 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.751938 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.751796 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:35.751938 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:35.751828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:35.751938 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:35.751890 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 13:40:35.751938 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:35.751930 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:35.752104 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:35.751964 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle podName:3e80ef99-5f11-4f55-bfc0-bf8344d479a1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:36.751944092 +0000 UTC m=+69.091404987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle") pod "router-default-69cd4f8474-865kt" (UID: "3e80ef99-5f11-4f55-bfc0-bf8344d479a1") : configmap references non-existent config key: service-ca.crt Sep 07 13:40:35.752104 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:35.751986 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls podName:b51efc57-cf6f-40b7-9057-e0d5870963c8 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:36.751976494 +0000 UTC m=+69.091437372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ljqt7" (UID: "b51efc57-cf6f-40b7-9057-e0d5870963c8") : secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:35.752104 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:35.752002 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs podName:3e80ef99-5f11-4f55-bfc0-bf8344d479a1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:36.751994382 +0000 UTC m=+69.091455269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs") pod "router-default-69cd4f8474-865kt" (UID: "3e80ef99-5f11-4f55-bfc0-bf8344d479a1") : secret "router-metrics-certs-default" not found Sep 07 13:40:36.399367 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:36.399243 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g54f9" event={"ID":"5ba2609a-b6c3-4972-9929-d2ee663ef8c0","Type":"ContainerStarted","Data":"f7b8f170b9597a04ec5577582500d959267ca5451b80781182dbfb1c9a8e1b25"} Sep 07 13:40:36.401518 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:36.401448 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" event={"ID":"b687009b-a57a-4c02-925e-af07c3ad9667","Type":"ContainerStarted","Data":"97bb17b4eb420b832483fb2129041b194e9920241e23dd9acf3e7c9aafc34aaa"} Sep 07 13:40:36.761723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:36.760793 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:36.761723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:36.760872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:36.761723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:36.760911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:36.761723 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:36.761039 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:36.761723 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:36.761103 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls podName:b51efc57-cf6f-40b7-9057-e0d5870963c8 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:38.761085253 +0000 UTC m=+71.100546141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ljqt7" (UID: "b51efc57-cf6f-40b7-9057-e0d5870963c8") : secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:36.761723 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:36.761172 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 13:40:36.761723 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:36.761208 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs podName:3e80ef99-5f11-4f55-bfc0-bf8344d479a1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:38.761195841 +0000 UTC m=+71.100656729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs") pod "router-default-69cd4f8474-865kt" (UID: "3e80ef99-5f11-4f55-bfc0-bf8344d479a1") : secret "router-metrics-certs-default" not found Sep 07 13:40:36.761723 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:36.761270 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle podName:3e80ef99-5f11-4f55-bfc0-bf8344d479a1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:38.761260409 +0000 UTC m=+71.100721297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle") pod "router-default-69cd4f8474-865kt" (UID: "3e80ef99-5f11-4f55-bfc0-bf8344d479a1") : configmap references non-existent config key: service-ca.crt Sep 07 13:40:38.776776 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:38.776739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:38.777247 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:38.776786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:38.777247 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:38.776908 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:38.777247 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:38.776948 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle podName:3e80ef99-5f11-4f55-bfc0-bf8344d479a1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:42.77692289 +0000 UTC m=+75.116383783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle") pod "router-default-69cd4f8474-865kt" (UID: "3e80ef99-5f11-4f55-bfc0-bf8344d479a1") : configmap references non-existent config key: service-ca.crt Sep 07 13:40:38.777247 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:38.776986 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls podName:b51efc57-cf6f-40b7-9057-e0d5870963c8 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:42.776975544 +0000 UTC m=+75.116436417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ljqt7" (UID: "b51efc57-cf6f-40b7-9057-e0d5870963c8") : secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:38.777247 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:38.777031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:38.777247 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:38.777149 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 13:40:38.777247 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:38.777191 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs podName:3e80ef99-5f11-4f55-bfc0-bf8344d479a1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:42.77717336 +0000 UTC m=+75.116634235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs") pod "router-default-69cd4f8474-865kt" (UID: "3e80ef99-5f11-4f55-bfc0-bf8344d479a1") : secret "router-metrics-certs-default" not found Sep 07 13:40:39.301135 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.301094 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:39.322982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.322948 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t9rbc"] Sep 07 13:40:39.325389 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.325344 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.328567 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.328542 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 13:40:39.329813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.329791 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 13:40:39.329931 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.329855 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 13:40:39.329931 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.329901 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 13:40:39.330051 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.329973 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fmc5q\"" Sep 07 13:40:39.344162 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.344133 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t9rbc"] Sep 07 13:40:39.413479 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.413441 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:39.482339 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.482301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkn6v\" (UniqueName: \"kubernetes.io/projected/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-api-access-xkn6v\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.482541 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.482388 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-data-volume\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.482541 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.482434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-crio-socket\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.482541 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.482470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.482541 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.482529 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.583456 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.583406 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-data-volume\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.583568 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.583476 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-crio-socket\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.583568 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.583522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.583568 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.583553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.583747 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.583619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkn6v\" (UniqueName: \"kubernetes.io/projected/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-api-access-xkn6v\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.583867 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.583749 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-data-volume\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.583922 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:39.583903 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:40:39.583971 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:39.583943 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:40:39.583971 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:39.583963 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls podName:fc8d79cb-3fa4-49a9-8601-ecacd081a6ba nodeName:}" failed. No retries permitted until 2026-09-07 13:40:40.083941983 +0000 UTC m=+72.423402858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t9rbc" (UID: "fc8d79cb-3fa4-49a9-8601-ecacd081a6ba") : secret "insights-runtime-extractor-tls" not found Sep 07 13:40:39.584074 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:39.583992 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm podName:fc8d79cb-3fa4-49a9-8601-ecacd081a6ba nodeName:}" failed. No retries permitted until 2026-09-07 13:40:40.083975799 +0000 UTC m=+72.423436687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t9rbc" (UID: "fc8d79cb-3fa4-49a9-8601-ecacd081a6ba") : configmap "kube-rbac-proxy" not found Sep 07 13:40:39.584074 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.584024 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-crio-socket\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.600832 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.600811 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkn6v\" (UniqueName: \"kubernetes.io/projected/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-api-access-xkn6v\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:39.659894 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.659854 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:39.873966 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:39.873842 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:40.040650 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.040600 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:40.087731 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.087692 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:40.087879 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.087832 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:40.087879 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:40.087855 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:40:40.088010 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:40.087928 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:40:40.088010 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:40.087940 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm podName:fc8d79cb-3fa4-49a9-8601-ecacd081a6ba nodeName:}" failed. No retries permitted until 2026-09-07 13:40:41.087917587 +0000 UTC m=+73.427378479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t9rbc" (UID: "fc8d79cb-3fa4-49a9-8601-ecacd081a6ba") : configmap "kube-rbac-proxy" not found Sep 07 13:40:40.088010 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:40.087974 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls podName:fc8d79cb-3fa4-49a9-8601-ecacd081a6ba nodeName:}" failed. No retries permitted until 2026-09-07 13:40:41.087960956 +0000 UTC m=+73.427421830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t9rbc" (UID: "fc8d79cb-3fa4-49a9-8601-ecacd081a6ba") : secret "insights-runtime-extractor-tls" not found Sep 07 13:40:40.414475 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.414434 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hgqkx" event={"ID":"b17085af-30e5-4059-a235-e829361adbf1","Type":"ContainerStarted","Data":"54d6f5a2a079e3576024ceb7a39ba77fdc139219f87dacb7e22624a4f72ec351"} Sep 07 13:40:40.414673 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.414529 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:40:40.416037 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.416018 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jfpl8_b687009b-a57a-4c02-925e-af07c3ad9667/console-operator/0.log" Sep 07 13:40:40.416117 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.416056 2574 generic.go:356] "Generic (PLEG): container finished" podID="b687009b-a57a-4c02-925e-af07c3ad9667" containerID="e0204feab36b49d518ddf7710b9356e9b8eafedc49df48292df008202f470dff" exitCode=255 Sep 07 13:40:40.416161 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.416133 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" event={"ID":"b687009b-a57a-4c02-925e-af07c3ad9667","Type":"ContainerDied","Data":"e0204feab36b49d518ddf7710b9356e9b8eafedc49df48292df008202f470dff"} Sep 07 13:40:40.416308 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.416293 2574 scope.go:117] "RemoveContainer" containerID="e0204feab36b49d518ddf7710b9356e9b8eafedc49df48292df008202f470dff" Sep 07 13:40:40.417597 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.417569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g54f9" event={"ID":"5ba2609a-b6c3-4972-9929-d2ee663ef8c0","Type":"ContainerStarted","Data":"3ad49dc6c70f4b57729d9afab1850d644dc57d158c1815aaabcfeebff8a42ba2"} Sep 07 13:40:40.419021 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.418999 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8d4vm" event={"ID":"5e40cd05-9810-44c4-b3a5-2237f9f6ba56","Type":"ContainerStarted","Data":"0d5bee126f123a375a8213bcf3c06e71397ac8fc0664d5be22c7a524ea071714"} Sep 07 13:40:40.465083 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.465037 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hgqkx" podStartSLOduration=67.414467495 podStartE2EDuration="1m12.465010825s" totalImagesPullingTime="5.05054333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:40.464852475 +0000 UTC m=+72.804313393" watchObservedRunningTime="2026-09-07 13:40:40.465010825 +0000 UTC m=+72.804471736" Sep 07 13:40:40.514096 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.514033 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8d4vm" podStartSLOduration=67.152497082 podStartE2EDuration="1m12.514017415s" totalImagesPullingTime="5.361520333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:40.510817444 +0000 UTC m=+72.850278342" watchObservedRunningTime="2026-09-07 13:40:40.514017415 +0000 UTC m=+72.853478302" Sep 07 13:40:40.571231 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.571200 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:40.596276 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.596223 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-g54f9" podStartSLOduration=2.478040007 podStartE2EDuration="6.596209002s" totalImagesPullingTime="4.118168995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:40.59554504 +0000 UTC m=+72.935005935" watchObservedRunningTime="2026-09-07 13:40:40.596209002 +0000 UTC m=+72.935669899" Sep 07 13:40:40.693951 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.693865 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:40.871075 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:40.871042 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:41.096929 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:41.096894 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:41.097400 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:41.097023 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:40:41.097400 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:41.097044 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:41.097400 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:41.097086 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm podName:fc8d79cb-3fa4-49a9-8601-ecacd081a6ba nodeName:}" failed. No retries permitted until 2026-09-07 13:40:43.097068858 +0000 UTC m=+75.436529754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t9rbc" (UID: "fc8d79cb-3fa4-49a9-8601-ecacd081a6ba") : configmap "kube-rbac-proxy" not found Sep 07 13:40:41.097400 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:41.097187 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:40:41.097400 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:41.097252 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls podName:fc8d79cb-3fa4-49a9-8601-ecacd081a6ba nodeName:}" failed. No retries permitted until 2026-09-07 13:40:43.09723402 +0000 UTC m=+75.436694895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t9rbc" (UID: "fc8d79cb-3fa4-49a9-8601-ecacd081a6ba") : secret "insights-runtime-extractor-tls" not found Sep 07 13:40:41.420736 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:41.420660 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nqd8q_d8b6de1a-77e8-4fcf-baf1-46dae4022e6b/dns-node-resolver/0.log" Sep 07 13:40:41.423075 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:41.423052 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jfpl8_b687009b-a57a-4c02-925e-af07c3ad9667/console-operator/1.log" Sep 07 13:40:41.423484 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:41.423467 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jfpl8_b687009b-a57a-4c02-925e-af07c3ad9667/console-operator/0.log" Sep 07 13:40:41.423582 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:41.423507 2574 generic.go:356] "Generic (PLEG): container finished" podID="b687009b-a57a-4c02-925e-af07c3ad9667" containerID="677c6ea2cfe64782ddb7a9b946ce3db271cf93848d65bd4402deebe866cd6168" exitCode=255 Sep 07 13:40:41.423633 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:41.423607 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" event={"ID":"b687009b-a57a-4c02-925e-af07c3ad9667","Type":"ContainerDied","Data":"677c6ea2cfe64782ddb7a9b946ce3db271cf93848d65bd4402deebe866cd6168"} Sep 07 13:40:41.423713 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:41.423684 2574 scope.go:117] "RemoveContainer" containerID="e0204feab36b49d518ddf7710b9356e9b8eafedc49df48292df008202f470dff" Sep 07 13:40:41.423830 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:41.423812 2574 scope.go:117] "RemoveContainer" containerID="677c6ea2cfe64782ddb7a9b946ce3db271cf93848d65bd4402deebe866cd6168" Sep 07 13:40:41.424034 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:41.424008 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-jfpl8_openshift-console-operator(b687009b-a57a-4c02-925e-af07c3ad9667)\"" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" podUID="b687009b-a57a-4c02-925e-af07c3ad9667" Sep 07 13:40:42.014375 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:42.014328 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dwsnv_ec6a5d8f-2407-444c-88f2-d3e836cc90ae/node-ca/0.log" Sep 07 13:40:42.245291 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:42.245259 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:42.391231 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:42.391156 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:42.428202 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:42.428178 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jfpl8_b687009b-a57a-4c02-925e-af07c3ad9667/console-operator/1.log" Sep 07 13:40:42.428557 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:42.428540 2574 scope.go:117] "RemoveContainer" containerID="677c6ea2cfe64782ddb7a9b946ce3db271cf93848d65bd4402deebe866cd6168" Sep 07 13:40:42.428730 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:42.428709 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-jfpl8_openshift-console-operator(b687009b-a57a-4c02-925e-af07c3ad9667)\"" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" podUID="b687009b-a57a-4c02-925e-af07c3ad9667" Sep 07 13:40:42.810155 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:42.810114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:42.810331 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:42.810169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:42.810331 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:42.810240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:42.810331 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:42.810285 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle podName:3e80ef99-5f11-4f55-bfc0-bf8344d479a1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:50.810264354 +0000 UTC m=+83.149725241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle") pod "router-default-69cd4f8474-865kt" (UID: "3e80ef99-5f11-4f55-bfc0-bf8344d479a1") : configmap references non-existent config key: service-ca.crt Sep 07 13:40:42.810331 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:42.810323 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:42.810574 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:42.810338 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 13:40:42.810574 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:42.810411 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls podName:b51efc57-cf6f-40b7-9057-e0d5870963c8 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:50.810395677 +0000 UTC m=+83.149856572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ljqt7" (UID: "b51efc57-cf6f-40b7-9057-e0d5870963c8") : secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:42.810574 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:42.810428 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs podName:3e80ef99-5f11-4f55-bfc0-bf8344d479a1 nodeName:}" failed. No retries permitted until 2026-09-07 13:40:50.81042125 +0000 UTC m=+83.149882124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs") pod "router-default-69cd4f8474-865kt" (UID: "3e80ef99-5f11-4f55-bfc0-bf8344d479a1") : secret "router-metrics-certs-default" not found Sep 07 13:40:43.112469 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:43.112370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:43.112647 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:43.112491 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:40:43.112647 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:43.112507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:43.112647 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:43.112556 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm podName:fc8d79cb-3fa4-49a9-8601-ecacd081a6ba nodeName:}" failed. No retries permitted until 2026-09-07 13:40:47.112539752 +0000 UTC m=+79.452000642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t9rbc" (UID: "fc8d79cb-3fa4-49a9-8601-ecacd081a6ba") : configmap "kube-rbac-proxy" not found Sep 07 13:40:43.112647 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:43.112626 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:40:43.112820 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:43.112684 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls podName:fc8d79cb-3fa4-49a9-8601-ecacd081a6ba nodeName:}" failed. No retries permitted until 2026-09-07 13:40:47.112667572 +0000 UTC m=+79.452128446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t9rbc" (UID: "fc8d79cb-3fa4-49a9-8601-ecacd081a6ba") : secret "insights-runtime-extractor-tls" not found Sep 07 13:40:43.208634 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:43.208578 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k4zj2_4b2ba3dd-f860-479a-827d-e041f79a87dc/serve-healthcheck-canary/0.log" Sep 07 13:40:43.705201 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:43.705169 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:45.318578 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:45.318541 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:45.319053 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:45.318610 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:45.319053 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:45.319003 2574 scope.go:117] "RemoveContainer" containerID="677c6ea2cfe64782ddb7a9b946ce3db271cf93848d65bd4402deebe866cd6168" Sep 07 13:40:45.319215 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:45.319193 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-jfpl8_openshift-console-operator(b687009b-a57a-4c02-925e-af07c3ad9667)\"" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" podUID="b687009b-a57a-4c02-925e-af07c3ad9667" Sep 07 13:40:46.014798 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:46.014763 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:46.266141 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:46.266061 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:46.572828 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:46.572749 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:47.139076 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:47.139038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:47.139269 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:47.139079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:47.139269 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:47.139200 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:40:47.139269 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:47.139245 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:40:47.139269 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:47.139263 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls podName:fc8d79cb-3fa4-49a9-8601-ecacd081a6ba nodeName:}" failed. No retries permitted until 2026-09-07 13:40:55.13924588 +0000 UTC m=+87.478706774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t9rbc" (UID: "fc8d79cb-3fa4-49a9-8601-ecacd081a6ba") : secret "insights-runtime-extractor-tls" not found Sep 07 13:40:47.139495 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:47.139314 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm podName:fc8d79cb-3fa4-49a9-8601-ecacd081a6ba nodeName:}" failed. No retries permitted until 2026-09-07 13:40:55.139294259 +0000 UTC m=+87.478755147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t9rbc" (UID: "fc8d79cb-3fa4-49a9-8601-ecacd081a6ba") : configmap "kube-rbac-proxy" not found Sep 07 13:40:47.310211 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:47.310180 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:47.950914 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:47.950882 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:48.113269 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:48.113238 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:48.520385 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:48.520312 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:48.705186 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:48.705157 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:49.358677 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:49.358617 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:49.662059 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:49.661955 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:49.809644 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:49.809615 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:49.959389 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:49.959301 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:50.119388 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:50.119339 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:50.488079 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:50.487964 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:50.624858 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:50.624827 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:50.733318 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:50.733287 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:50.868560 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:50.868482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:50.868560 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:50.868535 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:50.868734 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:50.868562 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:40:50.868734 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:50.868660 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:50.868734 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:50.868712 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls podName:b51efc57-cf6f-40b7-9057-e0d5870963c8 nodeName:}" failed. No retries permitted until 2026-09-07 13:41:06.868699537 +0000 UTC m=+99.208160411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-ljqt7" (UID: "b51efc57-cf6f-40b7-9057-e0d5870963c8") : secret "cluster-monitoring-operator-tls" not found Sep 07 13:40:50.868734 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:50.868725 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle podName:3e80ef99-5f11-4f55-bfc0-bf8344d479a1 nodeName:}" failed. No retries permitted until 2026-09-07 13:41:06.868718563 +0000 UTC m=+99.208179437 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle") pod "router-default-69cd4f8474-865kt" (UID: "3e80ef99-5f11-4f55-bfc0-bf8344d479a1") : configmap references non-existent config key: service-ca.crt Sep 07 13:40:50.870900 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:50.870882 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-metrics-certs\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:40:51.303935 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:51.303902 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:51.828438 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:51.828395 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:51.934794 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:51.934765 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:52.087277 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:52.087185 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:52.285447 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:52.285415 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:52.429668 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:52.429583 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:52.550654 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:52.550626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:53.316517 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:53.316487 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:53.892425 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:53.892390 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:54.093310 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:54.093274 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:54.499925 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:54.499890 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:54.704746 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:54.704714 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:54.876038 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:54.875960 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:55.203604 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:55.203506 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:55.203604 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:55.203558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:55.203811 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:55.203663 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:40:55.203811 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:40:55.203735 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls podName:fc8d79cb-3fa4-49a9-8601-ecacd081a6ba nodeName:}" failed. No retries permitted until 2026-09-07 13:41:11.203716238 +0000 UTC m=+103.543177112 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t9rbc" (UID: "fc8d79cb-3fa4-49a9-8601-ecacd081a6ba") : secret "insights-runtime-extractor-tls" not found Sep 07 13:40:55.203998 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:55.203980 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:40:55.908392 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:55.908344 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:56.207209 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:56.207126 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:56.545158 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:56.545108 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:56.778334 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:56.778305 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:58.106077 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:58.106045 2574 scope.go:117] "RemoveContainer" containerID="677c6ea2cfe64782ddb7a9b946ce3db271cf93848d65bd4402deebe866cd6168" Sep 07 13:40:58.478596 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:58.478569 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jfpl8_b687009b-a57a-4c02-925e-af07c3ad9667/console-operator/1.log" Sep 07 13:40:58.478760 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:58.478624 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" event={"ID":"b687009b-a57a-4c02-925e-af07c3ad9667","Type":"ContainerStarted","Data":"6337569ae2053cec42aead42a01a4d5164e6e9c5676e146362c02208c8c0a7c9"} Sep 07 13:40:58.478966 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:58.478934 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:59.095040 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:59.095003 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" Sep 07 13:40:59.126100 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:59.126049 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-jfpl8" podStartSLOduration=21.151733637 podStartE2EDuration="25.126032338s" totalImagesPullingTime="3.974298701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:40:58.512932797 +0000 UTC m=+90.852393694" watchObservedRunningTime="2026-09-07 13:40:59.126032338 +0000 UTC m=+91.465493230" Sep 07 13:40:59.491790 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:59.491757 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:59.640849 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:59.640815 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:59.792515 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:59.792417 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:40:59.911611 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:40:59.911575 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:00.411496 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:00.411462 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:00.827281 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:00.827247 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:01.062779 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:01.062747 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:01.418026 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:01.417979 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:03.292085 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:03.292053 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:03.535704 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:03.533757 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:05.985655 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:05.985620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:41:05.987872 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:05.987841 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4e67131-76b3-4498-b189-b5e75264b7e0-metrics-tls\") pod \"dns-default-4tchg\" (UID: \"b4e67131-76b3-4498-b189-b5e75264b7e0\") " pod="openshift-dns/dns-default-4tchg" Sep 07 13:41:06.022695 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:06.022666 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-npl4p\"" Sep 07 13:41:06.028506 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:06.028485 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4tchg" Sep 07 13:41:06.315237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:06.315214 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4tchg"] Sep 07 13:41:06.317846 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:06.317819 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e67131_76b3_4498_b189_b5e75264b7e0.slice/crio-e34e1f49e730f1622c97df58e6d71cb90905e1d4380e8e5bd651f7c8b962add9 WatchSource:0}: Error finding container e34e1f49e730f1622c97df58e6d71cb90905e1d4380e8e5bd651f7c8b962add9: Status 404 returned error can't find the container with id e34e1f49e730f1622c97df58e6d71cb90905e1d4380e8e5bd651f7c8b962add9 Sep 07 13:41:06.503364 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:06.503318 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4tchg" event={"ID":"b4e67131-76b3-4498-b189-b5e75264b7e0","Type":"ContainerStarted","Data":"e34e1f49e730f1622c97df58e6d71cb90905e1d4380e8e5bd651f7c8b962add9"} Sep 07 13:41:06.849978 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:06.849934 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:06.893156 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:06.893114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:41:06.893378 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:06.893172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:41:06.893811 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:06.893782 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e80ef99-5f11-4f55-bfc0-bf8344d479a1-service-ca-bundle\") pod \"router-default-69cd4f8474-865kt\" (UID: \"3e80ef99-5f11-4f55-bfc0-bf8344d479a1\") " pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:41:06.895807 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:06.895784 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b51efc57-cf6f-40b7-9057-e0d5870963c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-ljqt7\" (UID: \"b51efc57-cf6f-40b7-9057-e0d5870963c8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:41:07.014893 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:07.014845 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:07.096673 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:07.096634 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:41:07.105778 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:07.105753 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" Sep 07 13:41:07.400644 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:07.400564 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69cd4f8474-865kt"] Sep 07 13:41:07.424619 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:07.424590 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7"] Sep 07 13:41:07.834645 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:07.834607 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e80ef99_5f11_4f55_bfc0_bf8344d479a1.slice/crio-51ad34f1f9f645c2d7bc35d86e3fafcb3c167f7566e8a359c89143dbb325803f WatchSource:0}: Error finding container 51ad34f1f9f645c2d7bc35d86e3fafcb3c167f7566e8a359c89143dbb325803f: Status 404 returned error can't find the container with id 51ad34f1f9f645c2d7bc35d86e3fafcb3c167f7566e8a359c89143dbb325803f Sep 07 13:41:07.835339 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:07.835314 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51efc57_cf6f_40b7_9057_e0d5870963c8.slice/crio-f35456d6b0ef9c9d072d66a0327f0528e53655941781b369c546e3c484be2a82 WatchSource:0}: Error finding container f35456d6b0ef9c9d072d66a0327f0528e53655941781b369c546e3c484be2a82: Status 404 returned error can't find the container with id f35456d6b0ef9c9d072d66a0327f0528e53655941781b369c546e3c484be2a82 Sep 07 13:41:08.512831 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:08.512791 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69cd4f8474-865kt" event={"ID":"3e80ef99-5f11-4f55-bfc0-bf8344d479a1","Type":"ContainerStarted","Data":"0e383bb88715b704ede5b184eb6f3b1b9fce57bd4028d0520002cc1a2acc54df"} Sep 07 13:41:08.513329 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:08.512888 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69cd4f8474-865kt" event={"ID":"3e80ef99-5f11-4f55-bfc0-bf8344d479a1","Type":"ContainerStarted","Data":"51ad34f1f9f645c2d7bc35d86e3fafcb3c167f7566e8a359c89143dbb325803f"} Sep 07 13:41:08.515209 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:08.515176 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4tchg" event={"ID":"b4e67131-76b3-4498-b189-b5e75264b7e0","Type":"ContainerStarted","Data":"eaa6d085fcb58b26cfe77d9c1fb63dcdd6d36e264fb96a7e9f261729c8f1a029"} Sep 07 13:41:08.515336 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:08.515231 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4tchg" event={"ID":"b4e67131-76b3-4498-b189-b5e75264b7e0","Type":"ContainerStarted","Data":"fd96277e2a170ff36b95dd6ad193b671111b989e3044fd2a8a8a94aea538e43f"} Sep 07 13:41:08.515336 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:08.515298 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4tchg" Sep 07 13:41:08.516394 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:08.516371 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" event={"ID":"b51efc57-cf6f-40b7-9057-e0d5870963c8","Type":"ContainerStarted","Data":"f35456d6b0ef9c9d072d66a0327f0528e53655941781b369c546e3c484be2a82"} Sep 07 13:41:08.552697 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:08.552636 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-69cd4f8474-865kt" podStartSLOduration=34.552615021 podStartE2EDuration="34.552615021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:08.552283742 +0000 UTC m=+100.891744641" watchObservedRunningTime="2026-09-07 13:41:08.552615021 +0000 UTC m=+100.892075953" Sep 07 13:41:08.586666 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:08.586599 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4tchg" podStartSLOduration=65.023131337 podStartE2EDuration="1m6.586574455s" totalImagesPullingTime="1.563443118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:08.58482985 +0000 UTC m=+100.924290746" watchObservedRunningTime="2026-09-07 13:41:08.586574455 +0000 UTC m=+100.926035351" Sep 07 13:41:09.097572 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:09.097532 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:41:09.100597 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:09.100551 2574 patch_prober.go:28] interesting pod/router-default-69cd4f8474-865kt container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 07 13:41:09.100597 ip-10-0-131-22 kubenswrapper[2574]: [-]has-synced failed: reason withheld Sep 07 13:41:09.100597 ip-10-0-131-22 kubenswrapper[2574]: [+]process-running ok Sep 07 13:41:09.100597 ip-10-0-131-22 kubenswrapper[2574]: healthz check failed Sep 07 13:41:09.100844 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:09.100620 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-69cd4f8474-865kt" podUID="3e80ef99-5f11-4f55-bfc0-bf8344d479a1" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 13:41:09.943534 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:09.943422 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:10.098879 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:10.098842 2574 patch_prober.go:28] interesting pod/router-default-69cd4f8474-865kt container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 07 13:41:10.098879 ip-10-0-131-22 kubenswrapper[2574]: [-]has-synced failed: reason withheld Sep 07 13:41:10.098879 ip-10-0-131-22 kubenswrapper[2574]: [+]process-running ok Sep 07 13:41:10.098879 ip-10-0-131-22 kubenswrapper[2574]: healthz check failed Sep 07 13:41:10.099106 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:10.098939 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-69cd4f8474-865kt" podUID="3e80ef99-5f11-4f55-bfc0-bf8344d479a1" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 13:41:10.258577 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:10.258545 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:10.373009 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:10.372981 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:10.525311 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:10.525222 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" event={"ID":"b51efc57-cf6f-40b7-9057-e0d5870963c8","Type":"ContainerStarted","Data":"5748a9f1e5f6fc57ef70a40fdaf4a83fd3c9c8239b1b37ae3f9b2acdb887b9e6"} Sep 07 13:41:10.563014 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:10.562962 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-ljqt7" podStartSLOduration=34.8519425 podStartE2EDuration="36.562942683s" totalImagesPullingTime="1.711000183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:10.561541183 +0000 UTC m=+102.901002079" watchObservedRunningTime="2026-09-07 13:41:10.562942683 +0000 UTC m=+102.902403579" Sep 07 13:41:10.950782 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:10.950687 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:11.098263 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:11.098225 2574 patch_prober.go:28] interesting pod/router-default-69cd4f8474-865kt container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 07 13:41:11.098263 ip-10-0-131-22 kubenswrapper[2574]: [-]has-synced failed: reason withheld Sep 07 13:41:11.098263 ip-10-0-131-22 kubenswrapper[2574]: [+]process-running ok Sep 07 13:41:11.098263 ip-10-0-131-22 kubenswrapper[2574]: healthz check failed Sep 07 13:41:11.098493 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:11.098281 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-69cd4f8474-865kt" podUID="3e80ef99-5f11-4f55-bfc0-bf8344d479a1" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 13:41:11.227332 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:11.227294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:41:11.229649 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:11.229618 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc8d79cb-3fa4-49a9-8601-ecacd081a6ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t9rbc\" (UID: \"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba\") " pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:41:11.426163 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:11.426127 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hgqkx" Sep 07 13:41:11.436137 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:11.436111 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t9rbc" Sep 07 13:41:11.745237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:11.745204 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t9rbc"] Sep 07 13:41:11.748706 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:11.748681 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8d79cb_3fa4_49a9_8601_ecacd081a6ba.slice/crio-996a8d08cf0d902741a2af07c438dff3d7b0fce5d7d729db034f8ccd66f01366 WatchSource:0}: Error finding container 996a8d08cf0d902741a2af07c438dff3d7b0fce5d7d729db034f8ccd66f01366: Status 404 returned error can't find the container with id 996a8d08cf0d902741a2af07c438dff3d7b0fce5d7d729db034f8ccd66f01366 Sep 07 13:41:12.098513 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:12.098424 2574 patch_prober.go:28] interesting pod/router-default-69cd4f8474-865kt container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 07 13:41:12.098513 ip-10-0-131-22 kubenswrapper[2574]: [-]has-synced failed: reason withheld Sep 07 13:41:12.098513 ip-10-0-131-22 kubenswrapper[2574]: [+]process-running ok Sep 07 13:41:12.098513 ip-10-0-131-22 kubenswrapper[2574]: healthz check failed Sep 07 13:41:12.098513 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:12.098488 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-69cd4f8474-865kt" podUID="3e80ef99-5f11-4f55-bfc0-bf8344d479a1" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 13:41:12.533083 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:12.533044 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t9rbc" event={"ID":"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba","Type":"ContainerStarted","Data":"086dd1a2b5b6dc15ef09d3ba8e41f081f5ac7544030c86fc914d024e1bf74c3c"} Sep 07 13:41:12.533244 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:12.533104 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t9rbc" event={"ID":"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba","Type":"ContainerStarted","Data":"996a8d08cf0d902741a2af07c438dff3d7b0fce5d7d729db034f8ccd66f01366"} Sep 07 13:41:13.097923 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:13.097889 2574 patch_prober.go:28] interesting pod/router-default-69cd4f8474-865kt container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 07 13:41:13.097923 ip-10-0-131-22 kubenswrapper[2574]: [-]has-synced failed: reason withheld Sep 07 13:41:13.097923 ip-10-0-131-22 kubenswrapper[2574]: [+]process-running ok Sep 07 13:41:13.097923 ip-10-0-131-22 kubenswrapper[2574]: healthz check failed Sep 07 13:41:13.098140 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:13.097948 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-69cd4f8474-865kt" podUID="3e80ef99-5f11-4f55-bfc0-bf8344d479a1" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 13:41:13.538593 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:13.538562 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t9rbc" event={"ID":"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba","Type":"ContainerStarted","Data":"1b627664866b943d27aeabc2b4e94383500d316cbd932a25a533737bcf0ae737"} Sep 07 13:41:14.098583 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.098540 2574 patch_prober.go:28] interesting pod/router-default-69cd4f8474-865kt container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 07 13:41:14.098583 ip-10-0-131-22 kubenswrapper[2574]: [-]has-synced failed: reason withheld Sep 07 13:41:14.098583 ip-10-0-131-22 kubenswrapper[2574]: [+]process-running ok Sep 07 13:41:14.098583 ip-10-0-131-22 kubenswrapper[2574]: healthz check failed Sep 07 13:41:14.098950 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.098601 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-69cd4f8474-865kt" podUID="3e80ef99-5f11-4f55-bfc0-bf8344d479a1" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 13:41:14.546218 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.546181 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t9rbc" event={"ID":"fc8d79cb-3fa4-49a9-8601-ecacd081a6ba","Type":"ContainerStarted","Data":"ee7969cc9590df2b7029b19aec05faff420fba5aec73a6233d63b40a116ab568"} Sep 07 13:41:14.585853 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.585794 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t9rbc" podStartSLOduration=33.231695033 podStartE2EDuration="35.585775842s" totalImagesPullingTime="2.354080809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:40:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:14.584931911 +0000 UTC m=+106.924392808" watchObservedRunningTime="2026-09-07 13:41:14.585775842 +0000 UTC m=+106.925236751" Sep 07 13:41:14.795529 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.795490 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z"] Sep 07 13:41:14.797831 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.797804 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z" Sep 07 13:41:14.800945 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.800913 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 07 13:41:14.802438 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.802403 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jlp2w\"" Sep 07 13:41:14.802561 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.802438 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 07 13:41:14.802561 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.802439 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 07 13:41:14.814010 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.813967 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 07 13:41:14.834109 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.834078 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z"] Sep 07 13:41:14.854874 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.854847 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2l7h\" (UniqueName: \"kubernetes.io/projected/92fdca61-bc5b-43f8-bf09-cfcaf2daaf25-kube-api-access-l2l7h\") pod \"managed-serviceaccount-addon-agent-75d5948978-fg78z\" (UID: \"92fdca61-bc5b-43f8-bf09-cfcaf2daaf25\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z" Sep 07 13:41:14.855039 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.854887 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92fdca61-bc5b-43f8-bf09-cfcaf2daaf25-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75d5948978-fg78z\" (UID: \"92fdca61-bc5b-43f8-bf09-cfcaf2daaf25\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z" Sep 07 13:41:14.883121 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.883091 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-pnqpv"] Sep 07 13:41:14.885020 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.885004 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-mchqm"] Sep 07 13:41:14.885144 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.885127 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-pnqpv" Sep 07 13:41:14.886727 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.886710 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-mchqm" Sep 07 13:41:14.889890 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.889867 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 07 13:41:14.892040 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.892025 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lqpqg\"" Sep 07 13:41:14.892868 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.892851 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 07 13:41:14.892933 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.892859 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 07 13:41:14.902387 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.902339 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 07 13:41:14.902517 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.902500 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gt2l6\"" Sep 07 13:41:14.922784 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.922758 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-pnqpv"] Sep 07 13:41:14.930183 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.930151 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-mchqm"] Sep 07 13:41:14.955636 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.955609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2l7h\" (UniqueName: \"kubernetes.io/projected/92fdca61-bc5b-43f8-bf09-cfcaf2daaf25-kube-api-access-l2l7h\") pod \"managed-serviceaccount-addon-agent-75d5948978-fg78z\" (UID: \"92fdca61-bc5b-43f8-bf09-cfcaf2daaf25\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z" Sep 07 13:41:14.955750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.955641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8c45689-172c-45df-8c17-6b2597f297a1-nginx-conf\") pod \"networking-console-plugin-79977f9844-pnqpv\" (UID: \"e8c45689-172c-45df-8c17-6b2597f297a1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnqpv" Sep 07 13:41:14.955750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.955697 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92fdca61-bc5b-43f8-bf09-cfcaf2daaf25-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75d5948978-fg78z\" (UID: \"92fdca61-bc5b-43f8-bf09-cfcaf2daaf25\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z" Sep 07 13:41:14.955750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.955714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qnvn\" (UniqueName: \"kubernetes.io/projected/ac257d6f-b303-42be-bfed-f5c7a8d61bba-kube-api-access-5qnvn\") pod \"downloads-85d98c998f-mchqm\" (UID: \"ac257d6f-b303-42be-bfed-f5c7a8d61bba\") " pod="openshift-console/downloads-85d98c998f-mchqm" Sep 07 13:41:14.955750 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.955744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8c45689-172c-45df-8c17-6b2597f297a1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pnqpv\" (UID: \"e8c45689-172c-45df-8c17-6b2597f297a1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnqpv" Sep 07 13:41:14.958124 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:14.958097 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92fdca61-bc5b-43f8-bf09-cfcaf2daaf25-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75d5948978-fg78z\" (UID: \"92fdca61-bc5b-43f8-bf09-cfcaf2daaf25\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z" Sep 07 13:41:15.004518 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.004488 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2l7h\" (UniqueName: \"kubernetes.io/projected/92fdca61-bc5b-43f8-bf09-cfcaf2daaf25-kube-api-access-l2l7h\") pod \"managed-serviceaccount-addon-agent-75d5948978-fg78z\" (UID: \"92fdca61-bc5b-43f8-bf09-cfcaf2daaf25\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z" Sep 07 13:41:15.056560 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.056464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qnvn\" (UniqueName: \"kubernetes.io/projected/ac257d6f-b303-42be-bfed-f5c7a8d61bba-kube-api-access-5qnvn\") pod \"downloads-85d98c998f-mchqm\" (UID: \"ac257d6f-b303-42be-bfed-f5c7a8d61bba\") " pod="openshift-console/downloads-85d98c998f-mchqm" Sep 07 13:41:15.056560 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.056514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8c45689-172c-45df-8c17-6b2597f297a1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pnqpv\" (UID: \"e8c45689-172c-45df-8c17-6b2597f297a1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnqpv" Sep 07 13:41:15.056560 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.056538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8c45689-172c-45df-8c17-6b2597f297a1-nginx-conf\") pod \"networking-console-plugin-79977f9844-pnqpv\" (UID: \"e8c45689-172c-45df-8c17-6b2597f297a1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnqpv" Sep 07 13:41:15.057248 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.057219 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8c45689-172c-45df-8c17-6b2597f297a1-nginx-conf\") pod \"networking-console-plugin-79977f9844-pnqpv\" (UID: \"e8c45689-172c-45df-8c17-6b2597f297a1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnqpv" Sep 07 13:41:15.058926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.058908 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8c45689-172c-45df-8c17-6b2597f297a1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pnqpv\" (UID: \"e8c45689-172c-45df-8c17-6b2597f297a1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnqpv" Sep 07 13:41:15.086115 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.086087 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qnvn\" (UniqueName: \"kubernetes.io/projected/ac257d6f-b303-42be-bfed-f5c7a8d61bba-kube-api-access-5qnvn\") pod \"downloads-85d98c998f-mchqm\" (UID: \"ac257d6f-b303-42be-bfed-f5c7a8d61bba\") " pod="openshift-console/downloads-85d98c998f-mchqm" Sep 07 13:41:15.112052 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.112015 2574 patch_prober.go:28] interesting pod/router-default-69cd4f8474-865kt container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 07 13:41:15.112052 ip-10-0-131-22 kubenswrapper[2574]: [-]has-synced failed: reason withheld Sep 07 13:41:15.112052 ip-10-0-131-22 kubenswrapper[2574]: [+]process-running ok Sep 07 13:41:15.112052 ip-10-0-131-22 kubenswrapper[2574]: healthz check failed Sep 07 13:41:15.112277 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.112077 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-69cd4f8474-865kt" podUID="3e80ef99-5f11-4f55-bfc0-bf8344d479a1" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 13:41:15.117228 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.117209 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z" Sep 07 13:41:15.157789 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.157752 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:15.194829 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.194797 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-pnqpv" Sep 07 13:41:15.201230 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.201207 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-mchqm" Sep 07 13:41:15.334680 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.334605 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:15.396177 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.396147 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z"] Sep 07 13:41:15.399682 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:15.399642 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92fdca61_bc5b_43f8_bf09_cfcaf2daaf25.slice/crio-b29c66aba4d1ad403ab289149ad9ef0d02b7d8c32b38c4864cdcf6c63c4eef80 WatchSource:0}: Error finding container b29c66aba4d1ad403ab289149ad9ef0d02b7d8c32b38c4864cdcf6c63c4eef80: Status 404 returned error can't find the container with id b29c66aba4d1ad403ab289149ad9ef0d02b7d8c32b38c4864cdcf6c63c4eef80 Sep 07 13:41:15.484167 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.484136 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-pnqpv"] Sep 07 13:41:15.488445 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:15.488420 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c45689_172c_45df_8c17_6b2597f297a1.slice/crio-4206d1ee2c5a92426bc1078c3dead58cd07802865870c553c589697684805a79 WatchSource:0}: Error finding container 4206d1ee2c5a92426bc1078c3dead58cd07802865870c553c589697684805a79: Status 404 returned error can't find the container with id 4206d1ee2c5a92426bc1078c3dead58cd07802865870c553c589697684805a79 Sep 07 13:41:15.546645 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.546613 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-mchqm"] Sep 07 13:41:15.549444 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:15.549420 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac257d6f_b303_42be_bfed_f5c7a8d61bba.slice/crio-b019be5b4bde05ce81c8407ee05380ee49f06bcb006744dc9b076aa9835feabc WatchSource:0}: Error finding container b019be5b4bde05ce81c8407ee05380ee49f06bcb006744dc9b076aa9835feabc: Status 404 returned error can't find the container with id b019be5b4bde05ce81c8407ee05380ee49f06bcb006744dc9b076aa9835feabc Sep 07 13:41:15.550441 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.550413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-pnqpv" event={"ID":"e8c45689-172c-45df-8c17-6b2597f297a1","Type":"ContainerStarted","Data":"4206d1ee2c5a92426bc1078c3dead58cd07802865870c553c589697684805a79"} Sep 07 13:41:15.551742 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:15.551716 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z" event={"ID":"92fdca61-bc5b-43f8-bf09-cfcaf2daaf25","Type":"ContainerStarted","Data":"b29c66aba4d1ad403ab289149ad9ef0d02b7d8c32b38c4864cdcf6c63c4eef80"} Sep 07 13:41:16.098726 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:16.098299 2574 patch_prober.go:28] interesting pod/router-default-69cd4f8474-865kt container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Sep 07 13:41:16.098726 ip-10-0-131-22 kubenswrapper[2574]: [-]has-synced failed: reason withheld Sep 07 13:41:16.098726 ip-10-0-131-22 kubenswrapper[2574]: [+]process-running ok Sep 07 13:41:16.098726 ip-10-0-131-22 kubenswrapper[2574]: healthz check failed Sep 07 13:41:16.098726 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:16.098379 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-69cd4f8474-865kt" podUID="3e80ef99-5f11-4f55-bfc0-bf8344d479a1" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 13:41:16.295471 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:16.295379 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:16.558624 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:16.558582 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-mchqm" event={"ID":"ac257d6f-b303-42be-bfed-f5c7a8d61bba","Type":"ContainerStarted","Data":"b019be5b4bde05ce81c8407ee05380ee49f06bcb006744dc9b076aa9835feabc"} Sep 07 13:41:17.097380 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:17.097169 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:41:17.098753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:17.098730 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:41:17.564990 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:17.564944 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-pnqpv" event={"ID":"e8c45689-172c-45df-8c17-6b2597f297a1","Type":"ContainerStarted","Data":"3ba243354803116b910c4532b9e81a0b4ad6de7eadadd6951a47b97e0c50e858"} Sep 07 13:41:17.566946 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:17.566919 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-69cd4f8474-865kt" Sep 07 13:41:17.634942 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:17.634490 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-pnqpv" podStartSLOduration=2.422605829 podStartE2EDuration="3.634470365s" totalImagesPullingTime="1.211864536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:17.633476578 +0000 UTC m=+109.972937464" watchObservedRunningTime="2026-09-07 13:41:17.634470365 +0000 UTC m=+109.973931262" Sep 07 13:41:17.896144 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:17.896011 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:17.994129 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:17.994091 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:18.223240 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:18.223208 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:18.331067 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:18.331032 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:18.523899 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:18.523823 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4tchg" Sep 07 13:41:18.571636 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:18.571301 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z" event={"ID":"92fdca61-bc5b-43f8-bf09-cfcaf2daaf25","Type":"ContainerStarted","Data":"37523766d76c6c224ab805b00606a1877994b99d4b8eba7a740c659a9bbb4dda"} Sep 07 13:41:18.593545 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:18.593036 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75d5948978-fg78z" podStartSLOduration=1.713762015 podStartE2EDuration="4.593012994s" totalImagesPullingTime="2.879250979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:18.591966964 +0000 UTC m=+110.931427858" watchObservedRunningTime="2026-09-07 13:41:18.593012994 +0000 UTC m=+110.932473891" Sep 07 13:41:18.826575 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:18.826488 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:20.359133 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:20.359097 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:20.545890 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:20.545847 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:20.641343 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:20.641258 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:20.886534 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:20.886493 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:21.002979 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:21.002944 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:21.089187 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:21.089150 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:22.055342 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.055304 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:22.137834 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.137802 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:22.380926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.380845 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:22.480077 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.480037 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:22.636947 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.636862 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:22.704240 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.704201 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4"] Sep 07 13:41:22.706676 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.706649 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.707439 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.707415 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-t44b7"] Sep 07 13:41:22.709751 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.709731 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.719701 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.719673 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 07 13:41:22.721646 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.721446 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 13:41:22.721646 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.721462 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 07 13:41:22.721646 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.721502 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 07 13:41:22.721646 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.721584 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 07 13:41:22.721934 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.721702 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 07 13:41:22.721934 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.721819 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mhm6g\"" Sep 07 13:41:22.721934 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.721842 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xkr74\"" Sep 07 13:41:22.736273 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.736242 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4"] Sep 07 13:41:22.747830 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.747795 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-t44b7"] Sep 07 13:41:22.760146 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.760115 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:22.772393 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.772359 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7hvb7"] Sep 07 13:41:22.775110 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.775085 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.778796 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.778773 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 13:41:22.778927 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.778779 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f4rn6\"" Sep 07 13:41:22.779153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.779136 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 13:41:22.779871 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.779852 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 13:41:22.826649 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.826618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltcvn\" (UniqueName: \"kubernetes.io/projected/9215ee1a-36d8-4b43-98ad-dd86794699b7-kube-api-access-ltcvn\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.826854 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.826662 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.826854 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.826691 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmkj5\" (UniqueName: \"kubernetes.io/projected/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-api-access-zmkj5\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.826854 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.826777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f521fd42-93ff-433b-adca-d3bdc658878c-metrics-client-ca\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.826854 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.826846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.827076 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.826875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.827076 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.826905 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.827076 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.826933 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.827076 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.826980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.827076 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.827023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-wtmp\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.827076 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.827040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9215ee1a-36d8-4b43-98ad-dd86794699b7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.827426 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.827068 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-tls\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.827426 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.827115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.827426 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.827130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9215ee1a-36d8-4b43-98ad-dd86794699b7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.827426 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.827146 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9215ee1a-36d8-4b43-98ad-dd86794699b7-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.827426 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.827218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f521fd42-93ff-433b-adca-d3bdc658878c-sys\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.827426 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.827267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f521fd42-93ff-433b-adca-d3bdc658878c-root\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.827426 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.827304 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-textfile\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.827426 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.827382 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s25sj\" (UniqueName: \"kubernetes.io/projected/f521fd42-93ff-433b-adca-d3bdc658878c-kube-api-access-s25sj\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.855497 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.855444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:22.929221 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.928686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-tls\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929221 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.928737 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929221 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.928772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9215ee1a-36d8-4b43-98ad-dd86794699b7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.929221 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.928801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9215ee1a-36d8-4b43-98ad-dd86794699b7-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.929221 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.928835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f521fd42-93ff-433b-adca-d3bdc658878c-sys\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929221 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.928857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f521fd42-93ff-433b-adca-d3bdc658878c-root\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929221 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.928878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-textfile\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929221 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:41:22.929009 2574 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 07 13:41:22.929221 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:41:22.929115 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9215ee1a-36d8-4b43-98ad-dd86794699b7-openshift-state-metrics-tls podName:9215ee1a-36d8-4b43-98ad-dd86794699b7 nodeName:}" failed. No retries permitted until 2026-09-07 13:41:23.429057794 +0000 UTC m=+115.768518678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9215ee1a-36d8-4b43-98ad-dd86794699b7-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-qzjt4" (UID: "9215ee1a-36d8-4b43-98ad-dd86794699b7") : secret "openshift-state-metrics-tls" not found Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929237 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f521fd42-93ff-433b-adca-d3bdc658878c-sys\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929247 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f521fd42-93ff-433b-adca-d3bdc658878c-root\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s25sj\" (UniqueName: \"kubernetes.io/projected/f521fd42-93ff-433b-adca-d3bdc658878c-kube-api-access-s25sj\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929365 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltcvn\" (UniqueName: \"kubernetes.io/projected/9215ee1a-36d8-4b43-98ad-dd86794699b7-kube-api-access-ltcvn\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmkj5\" (UniqueName: \"kubernetes.io/projected/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-api-access-zmkj5\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f521fd42-93ff-433b-adca-d3bdc658878c-metrics-client-ca\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929548 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-textfile\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929570 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929595 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-wtmp\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.929813 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.929694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9215ee1a-36d8-4b43-98ad-dd86794699b7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.930561 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.930307 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.930561 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.930517 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.930659 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.930635 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.930734 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.930711 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9215ee1a-36d8-4b43-98ad-dd86794699b7-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.930890 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.930866 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-wtmp\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.931130 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.931108 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f521fd42-93ff-433b-adca-d3bdc658878c-metrics-client-ca\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.931208 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.931138 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.932342 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.932292 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.932679 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.932653 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9215ee1a-36d8-4b43-98ad-dd86794699b7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.933277 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.933252 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f521fd42-93ff-433b-adca-d3bdc658878c-node-exporter-tls\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.933387 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.933282 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.933677 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.933644 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.938814 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.938794 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s25sj\" (UniqueName: \"kubernetes.io/projected/f521fd42-93ff-433b-adca-d3bdc658878c-kube-api-access-s25sj\") pod \"node-exporter-7hvb7\" (UID: \"f521fd42-93ff-433b-adca-d3bdc658878c\") " pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:22.941820 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.941796 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmkj5\" (UniqueName: \"kubernetes.io/projected/43989d5b-64f4-4e17-9cd9-0a76e7ab7244-kube-api-access-zmkj5\") pod \"kube-state-metrics-74cb57df7-t44b7\" (UID: \"43989d5b-64f4-4e17-9cd9-0a76e7ab7244\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:22.949930 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.949908 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltcvn\" (UniqueName: \"kubernetes.io/projected/9215ee1a-36d8-4b43-98ad-dd86794699b7-kube-api-access-ltcvn\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:22.958119 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:22.958089 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:23.024679 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.024646 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" Sep 07 13:41:23.058531 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.058464 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:23.086888 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.086855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7hvb7" Sep 07 13:41:23.111056 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:23.111017 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf521fd42_93ff_433b_adca_d3bdc658878c.slice/crio-8bff5fc52aa0dcb7c977a84a9d95c46502d08fbb993fc46670221a8a3ed19c47 WatchSource:0}: Error finding container 8bff5fc52aa0dcb7c977a84a9d95c46502d08fbb993fc46670221a8a3ed19c47: Status 404 returned error can't find the container with id 8bff5fc52aa0dcb7c977a84a9d95c46502d08fbb993fc46670221a8a3ed19c47 Sep 07 13:41:23.319270 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.319244 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-t44b7"] Sep 07 13:41:23.321503 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:23.321471 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43989d5b_64f4_4e17_9cd9_0a76e7ab7244.slice/crio-b289ad60f36c67f779f8f913c32cd190a1ed99f201558a1b0d987dd69e53fbca WatchSource:0}: Error finding container b289ad60f36c67f779f8f913c32cd190a1ed99f201558a1b0d987dd69e53fbca: Status 404 returned error can't find the container with id b289ad60f36c67f779f8f913c32cd190a1ed99f201558a1b0d987dd69e53fbca Sep 07 13:41:23.435071 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.435037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9215ee1a-36d8-4b43-98ad-dd86794699b7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:23.437759 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.437723 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9215ee1a-36d8-4b43-98ad-dd86794699b7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qzjt4\" (UID: \"9215ee1a-36d8-4b43-98ad-dd86794699b7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:23.542293 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.542249 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:23.592608 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.592519 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" event={"ID":"43989d5b-64f4-4e17-9cd9-0a76e7ab7244","Type":"ContainerStarted","Data":"b289ad60f36c67f779f8f913c32cd190a1ed99f201558a1b0d987dd69e53fbca"} Sep 07 13:41:23.593868 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.593837 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7hvb7" event={"ID":"f521fd42-93ff-433b-adca-d3bdc658878c","Type":"ContainerStarted","Data":"8bff5fc52aa0dcb7c977a84a9d95c46502d08fbb993fc46670221a8a3ed19c47"} Sep 07 13:41:23.619109 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.619077 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" Sep 07 13:41:23.682836 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.682803 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:23.842598 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.836694 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:23.943959 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.943930 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4"] Sep 07 13:41:23.989557 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:23.986199 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:24.179417 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:24.179325 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:24.293682 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:24.293612 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:24.601178 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:24.601091 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" event={"ID":"9215ee1a-36d8-4b43-98ad-dd86794699b7","Type":"ContainerStarted","Data":"a1821f253f8de1e79083b71afaa7f7b949681cca14ec39f178b9694be0ee7966"} Sep 07 13:41:24.601178 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:24.601169 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" event={"ID":"9215ee1a-36d8-4b43-98ad-dd86794699b7","Type":"ContainerStarted","Data":"b271326aaf2138c15f72f6ec20709d35b3d5ad91fa5af5795dd0e3c7e165a77a"} Sep 07 13:41:24.601482 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:24.601199 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" event={"ID":"9215ee1a-36d8-4b43-98ad-dd86794699b7","Type":"ContainerStarted","Data":"97c060cddf4b4578132f328a9b6141114c417c10d70c9786c513ce57959aa846"} Sep 07 13:41:24.715309 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:24.715278 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:24.802044 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:24.801958 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:25.278633 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.278600 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f997ff49c-swrtj"] Sep 07 13:41:25.282326 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.281265 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.291595 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.290386 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 07 13:41:25.291595 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.290661 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 07 13:41:25.291595 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.290836 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 07 13:41:25.291595 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.291031 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gj45r\"" Sep 07 13:41:25.291595 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.291198 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 07 13:41:25.291595 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.291421 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 07 13:41:25.297868 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.297838 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f997ff49c-swrtj"] Sep 07 13:41:25.357393 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.357317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-oauth-config\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.357573 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.357406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgjk9\" (UniqueName: \"kubernetes.io/projected/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-kube-api-access-qgjk9\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.357573 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.357460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-oauth-serving-cert\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.357573 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.357535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-service-ca\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.357731 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.357596 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-config\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.357731 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.357698 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-serving-cert\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.458684 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.458644 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-serving-cert\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.458839 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.458700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-oauth-config\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.458839 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.458735 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgjk9\" (UniqueName: \"kubernetes.io/projected/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-kube-api-access-qgjk9\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.458839 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.458783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-oauth-serving-cert\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.458940 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.458844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-service-ca\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.458940 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.458915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-config\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.459638 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.459608 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-service-ca\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.459760 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.459608 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-oauth-serving-cert\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.459760 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.459685 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-config\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.461403 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.461377 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-serving-cert\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.461615 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.461598 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-oauth-config\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.486517 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.486000 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgjk9\" (UniqueName: \"kubernetes.io/projected/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-kube-api-access-qgjk9\") pod \"console-7f997ff49c-swrtj\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.504830 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.504795 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:25.598262 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.598180 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:25.608530 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.608493 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" event={"ID":"43989d5b-64f4-4e17-9cd9-0a76e7ab7244","Type":"ContainerStarted","Data":"edc7f813a50053a528021fad96693de5bfee80d5eacfd2ab3e598f6d52b5323d"} Sep 07 13:41:25.608661 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.608560 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" event={"ID":"43989d5b-64f4-4e17-9cd9-0a76e7ab7244","Type":"ContainerStarted","Data":"da9ce6c91f0059bcf19ae1be3fa05b26f449d41323cebb61cd3e9dc7e727ddb5"} Sep 07 13:41:25.608661 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.608590 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" event={"ID":"43989d5b-64f4-4e17-9cd9-0a76e7ab7244","Type":"ContainerStarted","Data":"2d864c3cf042ab1ece826dc8b4ba73ecb31c1d5584db575867b8fb4a5a776a39"} Sep 07 13:41:25.610375 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.610323 2574 generic.go:356] "Generic (PLEG): container finished" podID="f521fd42-93ff-433b-adca-d3bdc658878c" containerID="1afe51abfa861a67ddd4ece3d0e0c3fa47c3139ad016b856b9624418087d1616" exitCode=0 Sep 07 13:41:25.610517 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.610414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7hvb7" event={"ID":"f521fd42-93ff-433b-adca-d3bdc658878c","Type":"ContainerDied","Data":"1afe51abfa861a67ddd4ece3d0e0c3fa47c3139ad016b856b9624418087d1616"} Sep 07 13:41:25.642790 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.642748 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:25.671992 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.671932 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-t44b7" podStartSLOduration=2.219228301 podStartE2EDuration="3.671915474s" totalImagesPullingTime="1.452687173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:25.63809279 +0000 UTC m=+117.977553689" watchObservedRunningTime="2026-09-07 13:41:25.671915474 +0000 UTC m=+118.011376367" Sep 07 13:41:25.788049 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.788006 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:25.789134 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.789093 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f568487bc-kc4vf"] Sep 07 13:41:25.791838 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.791816 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.795458 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.795402 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 07 13:41:25.795605 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.795590 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1iurp0cbtliur\"" Sep 07 13:41:25.795723 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.795705 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 07 13:41:25.795786 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.795739 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 07 13:41:25.795975 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.795958 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 07 13:41:25.796062 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.795987 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 07 13:41:25.796062 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.796007 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wjx8g\"" Sep 07 13:41:25.819301 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.819267 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f568487bc-kc4vf"] Sep 07 13:41:25.862601 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.862514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-tls\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.862601 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.862563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.862601 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.862602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mk7z\" (UniqueName: \"kubernetes.io/projected/0e5a3f54-8518-4015-9a23-35e39b39c182-kube-api-access-2mk7z\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.862865 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.862623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.862865 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.862642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-grpc-tls\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.862865 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.862733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.862865 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.862799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.862865 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.862828 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e5a3f54-8518-4015-9a23-35e39b39c182-metrics-client-ca\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.872888 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.872857 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:25.963862 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.963821 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-tls\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.964055 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.963870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.964055 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.964010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mk7z\" (UniqueName: \"kubernetes.io/projected/0e5a3f54-8518-4015-9a23-35e39b39c182-kube-api-access-2mk7z\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.964163 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.964055 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.964163 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.964075 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-grpc-tls\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.964163 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.964143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.964314 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.964199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.964314 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.964231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e5a3f54-8518-4015-9a23-35e39b39c182-metrics-client-ca\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.964983 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.964954 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e5a3f54-8518-4015-9a23-35e39b39c182-metrics-client-ca\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.966961 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.966931 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.967088 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.967025 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.967421 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.967379 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.967523 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.967450 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.967605 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.967584 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-thanos-querier-tls\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.967658 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.967603 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e5a3f54-8518-4015-9a23-35e39b39c182-secret-grpc-tls\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:25.973998 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:25.973978 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mk7z\" (UniqueName: \"kubernetes.io/projected/0e5a3f54-8518-4015-9a23-35e39b39c182-kube-api-access-2mk7z\") pod \"thanos-querier-f568487bc-kc4vf\" (UID: \"0e5a3f54-8518-4015-9a23-35e39b39c182\") " pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:26.103186 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:26.103144 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:26.104858 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:26.104825 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:26.278104 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:26.278038 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:26.468003 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:26.467957 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:26.568310 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:26.568221 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:27.020726 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.020688 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5cb74979ff-pq9r2"] Sep 07 13:41:27.023121 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.023092 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.026079 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.026058 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 07 13:41:27.026215 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.026100 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-45wjg\"" Sep 07 13:41:27.027912 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.027888 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 07 13:41:27.028020 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.027966 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 13:41:27.028020 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.027888 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 07 13:41:27.028154 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.028110 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-edvvp8ou6udm2\"" Sep 07 13:41:27.035607 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.035586 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cb74979ff-pq9r2"] Sep 07 13:41:27.174069 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.174031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndqnz\" (UniqueName: \"kubernetes.io/projected/58b19ac1-af6f-43a1-af40-289be163524f-kube-api-access-ndqnz\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.174249 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.174095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b19ac1-af6f-43a1-af40-289be163524f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.174249 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.174118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/58b19ac1-af6f-43a1-af40-289be163524f-metrics-server-audit-profiles\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.174249 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.174200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b19ac1-af6f-43a1-af40-289be163524f-client-ca-bundle\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.174249 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.174240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/58b19ac1-af6f-43a1-af40-289be163524f-audit-log\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.174470 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.174289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/58b19ac1-af6f-43a1-af40-289be163524f-secret-metrics-server-tls\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.174470 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.174315 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/58b19ac1-af6f-43a1-af40-289be163524f-secret-metrics-server-client-certs\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.274562 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.274466 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:27.274838 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.274797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b19ac1-af6f-43a1-af40-289be163524f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.274838 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.274841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/58b19ac1-af6f-43a1-af40-289be163524f-metrics-server-audit-profiles\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.275034 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.274886 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b19ac1-af6f-43a1-af40-289be163524f-client-ca-bundle\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.275034 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.274924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/58b19ac1-af6f-43a1-af40-289be163524f-audit-log\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.275034 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.274976 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/58b19ac1-af6f-43a1-af40-289be163524f-secret-metrics-server-tls\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.275034 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.275000 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/58b19ac1-af6f-43a1-af40-289be163524f-secret-metrics-server-client-certs\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.275279 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.275038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndqnz\" (UniqueName: \"kubernetes.io/projected/58b19ac1-af6f-43a1-af40-289be163524f-kube-api-access-ndqnz\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.275657 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.275622 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b19ac1-af6f-43a1-af40-289be163524f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.275778 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.275690 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/58b19ac1-af6f-43a1-af40-289be163524f-audit-log\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.275946 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.275928 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/58b19ac1-af6f-43a1-af40-289be163524f-metrics-server-audit-profiles\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.277653 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.277630 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b19ac1-af6f-43a1-af40-289be163524f-client-ca-bundle\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.277806 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.277789 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/58b19ac1-af6f-43a1-af40-289be163524f-secret-metrics-server-tls\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.277872 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.277844 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/58b19ac1-af6f-43a1-af40-289be163524f-secret-metrics-server-client-certs\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.287650 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.287622 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndqnz\" (UniqueName: \"kubernetes.io/projected/58b19ac1-af6f-43a1-af40-289be163524f-kube-api-access-ndqnz\") pod \"metrics-server-5cb74979ff-pq9r2\" (UID: \"58b19ac1-af6f-43a1-af40-289be163524f\") " pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.334837 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.334788 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:27.376522 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.376403 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:27.473264 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.473216 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:27.474409 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.474386 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b5c475f5-lqdv9"] Sep 07 13:41:27.476654 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.476632 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.490251 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.490223 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 07 13:41:27.495475 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.495449 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5c475f5-lqdv9"] Sep 07 13:41:27.556163 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.556073 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:27.577691 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.577655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-service-ca\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.577871 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.577703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmkg8\" (UniqueName: \"kubernetes.io/projected/202c6fd8-01b7-4973-8474-82ef3da08550-kube-api-access-gmkg8\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.577871 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.577733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-trusted-ca-bundle\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.577871 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.577819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-serving-cert\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.577871 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.577852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-oauth-config\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.578031 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.577938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-oauth-serving-cert\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.578031 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.577994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-console-config\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.678756 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.678715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-serving-cert\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.678756 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.678761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-oauth-config\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.679014 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.678831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-oauth-serving-cert\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.679014 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.678852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-console-config\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.679014 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.678881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-service-ca\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.679014 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.678910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmkg8\" (UniqueName: \"kubernetes.io/projected/202c6fd8-01b7-4973-8474-82ef3da08550-kube-api-access-gmkg8\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.679014 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.678947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-trusted-ca-bundle\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.680022 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.679992 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-trusted-ca-bundle\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.680592 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.680542 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-console-config\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.680712 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.680609 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-service-ca\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.680712 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.680609 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-oauth-serving-cert\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.682137 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.682114 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-serving-cert\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.682241 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.682122 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-oauth-config\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.689884 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.689848 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmkg8\" (UniqueName: \"kubernetes.io/projected/202c6fd8-01b7-4973-8474-82ef3da08550-kube-api-access-gmkg8\") pod \"console-b5c475f5-lqdv9\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.788609 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.788568 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:27.864524 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.864443 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:27.964441 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:27.964404 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:29.073710 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.073671 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:29.080264 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.080237 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:41:29.086666 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.086629 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.086812 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.086782 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f997ff49c-swrtj"] Sep 07 13:41:29.091984 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.091955 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 13:41:29.092224 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.092198 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 13:41:29.092224 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.092210 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 13:41:29.093145 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.093127 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 13:41:29.093456 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.093439 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c4glk\"" Sep 07 13:41:29.093540 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.093452 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 13:41:29.093540 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.093452 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 13:41:29.093540 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.093436 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 13:41:29.093742 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.093724 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 13:41:29.093831 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.093786 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 13:41:29.094010 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.093992 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 13:41:29.095614 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.095593 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 13:41:29.095683 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.095670 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ag4ko9icmcea5\"" Sep 07 13:41:29.095866 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.095843 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 13:41:29.098139 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.098117 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 13:41:29.101724 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.101706 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 13:41:29.130862 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.130823 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:41:29.194248 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194457 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194457 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194291 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194457 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m78mv\" (UniqueName: \"kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-kube-api-access-m78mv\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194457 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194457 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194428 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194705 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194705 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194596 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194705 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194705 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194705 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194696 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194936 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194936 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194936 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194822 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-web-config\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194936 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194842 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.194936 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.195175 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.194974 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-config-out\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.195175 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.195009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-config\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.195175 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.195046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.195175 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.195106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296419 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296419 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296426 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-web-config\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296688 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296688 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296688 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-config-out\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296688 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-config\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296688 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296688 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296646 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m78mv\" (UniqueName: \"kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-kube-api-access-m78mv\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296878 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.296982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.296977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.297497 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.297040 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.297497 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.297070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.297497 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.297096 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.297497 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.297465 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.297972 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.297947 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.298079 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.297983 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.298760 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.298680 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.299613 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.299587 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.300432 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.299979 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.300432 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.300388 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.300743 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.300720 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.300866 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.300844 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-config-out\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.300935 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.300877 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.301325 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.301271 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-config\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.302439 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.302414 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.303269 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.303236 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.303809 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.303766 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.303956 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.303924 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-web-config\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.304868 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.304818 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.305038 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.304995 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.305197 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.305153 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.306753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.306730 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m78mv\" (UniqueName: \"kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-kube-api-access-m78mv\") pod \"prometheus-k8s-0\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:29.398953 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:29.398873 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:30.653013 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:30.652979 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:30.754276 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:30.754235 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:31.748225 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:31.748185 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:31.870098 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:31.870065 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:32.407334 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:32.407292 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:32.513805 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:32.507871 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:32.609552 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:32.609318 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:32.651822 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:32.651718 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7hvb7" event={"ID":"f521fd42-93ff-433b-adca-d3bdc658878c","Type":"ContainerStarted","Data":"0ae81810d736922290b178955b336d5c0630a8308419fe4bd21bc4909debb710"} Sep 07 13:41:32.655121 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:32.655091 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" event={"ID":"9215ee1a-36d8-4b43-98ad-dd86794699b7","Type":"ContainerStarted","Data":"5dcf63b582d4b837ea895dd7170113a1597bc33db5017c74b96a9ab6e59a45db"} Sep 07 13:41:32.678945 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:32.678893 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qzjt4" podStartSLOduration=2.565542133 podStartE2EDuration="10.678875868s" totalImagesPullingTime="8.113333735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:32.677690398 +0000 UTC m=+125.017151317" watchObservedRunningTime="2026-09-07 13:41:32.678875868 +0000 UTC m=+125.018336772" Sep 07 13:41:32.792192 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:32.792153 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cb74979ff-pq9r2"] Sep 07 13:41:32.795986 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:32.795948 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b19ac1_af6f_43a1_af40_289be163524f.slice/crio-7a4a3a7eaf8c9d5be03c8bc6a8ede26f80106f5b3ee217446229d90d07a72dfd WatchSource:0}: Error finding container 7a4a3a7eaf8c9d5be03c8bc6a8ede26f80106f5b3ee217446229d90d07a72dfd: Status 404 returned error can't find the container with id 7a4a3a7eaf8c9d5be03c8bc6a8ede26f80106f5b3ee217446229d90d07a72dfd Sep 07 13:41:32.796124 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:32.796022 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f568487bc-kc4vf"] Sep 07 13:41:32.799787 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:32.799757 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e5a3f54_8518_4015_9a23_35e39b39c182.slice/crio-205d7ab50e5fb1c6531a75c3028a2c915df046061ed42887f35fbfd1ce160a42 WatchSource:0}: Error finding container 205d7ab50e5fb1c6531a75c3028a2c915df046061ed42887f35fbfd1ce160a42: Status 404 returned error can't find the container with id 205d7ab50e5fb1c6531a75c3028a2c915df046061ed42887f35fbfd1ce160a42 Sep 07 13:41:32.808544 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:32.808520 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5c475f5-lqdv9"] Sep 07 13:41:32.811998 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:32.811968 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202c6fd8_01b7_4973_8474_82ef3da08550.slice/crio-48b42618d3507847051651e7116df778e0c6bcc4d31b897e39bf74fec98506e2 WatchSource:0}: Error finding container 48b42618d3507847051651e7116df778e0c6bcc4d31b897e39bf74fec98506e2: Status 404 returned error can't find the container with id 48b42618d3507847051651e7116df778e0c6bcc4d31b897e39bf74fec98506e2 Sep 07 13:41:32.830739 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:32.830661 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f997ff49c-swrtj"] Sep 07 13:41:32.832961 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:32.832933 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc3c70c_e8e2_4bae_ac6f_86f74a4cb5de.slice/crio-3dac84656694c353f5d8ee7420de49cc223abb0f27df449d9c294150afd7186b WatchSource:0}: Error finding container 3dac84656694c353f5d8ee7420de49cc223abb0f27df449d9c294150afd7186b: Status 404 returned error can't find the container with id 3dac84656694c353f5d8ee7420de49cc223abb0f27df449d9c294150afd7186b Sep 07 13:41:32.844413 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:32.844322 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:41:32.846298 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:32.846268 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88f450f_2ea5_4177_97d0_6293286bdb63.slice/crio-11b738f9c3f86c7e05b58b9805c3b87f8f8b7bb107b06e15c652f1bbea9f284d WatchSource:0}: Error finding container 11b738f9c3f86c7e05b58b9805c3b87f8f8b7bb107b06e15c652f1bbea9f284d: Status 404 returned error can't find the container with id 11b738f9c3f86c7e05b58b9805c3b87f8f8b7bb107b06e15c652f1bbea9f284d Sep 07 13:41:33.020098 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.020062 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:33.086267 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.086232 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:33.676487 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.675539 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7hvb7" event={"ID":"f521fd42-93ff-433b-adca-d3bdc658878c","Type":"ContainerStarted","Data":"3545c253d85045349fc05ccafef6990046d0304b53c9ccf35adfb6c2d666cb54"} Sep 07 13:41:33.680140 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.679964 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerStarted","Data":"11b738f9c3f86c7e05b58b9805c3b87f8f8b7bb107b06e15c652f1bbea9f284d"} Sep 07 13:41:33.683186 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.683049 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" event={"ID":"0e5a3f54-8518-4015-9a23-35e39b39c182","Type":"ContainerStarted","Data":"205d7ab50e5fb1c6531a75c3028a2c915df046061ed42887f35fbfd1ce160a42"} Sep 07 13:41:33.689134 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.686492 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-mchqm" event={"ID":"ac257d6f-b303-42be-bfed-f5c7a8d61bba","Type":"ContainerStarted","Data":"139a72ed4e71983a7faec25d589660bae01d8f68dd720ef374dc3933a43690d6"} Sep 07 13:41:33.689134 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.687522 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-mchqm" Sep 07 13:41:33.690613 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.690581 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" event={"ID":"58b19ac1-af6f-43a1-af40-289be163524f","Type":"ContainerStarted","Data":"7a4a3a7eaf8c9d5be03c8bc6a8ede26f80106f5b3ee217446229d90d07a72dfd"} Sep 07 13:41:33.694501 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.694430 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f997ff49c-swrtj" event={"ID":"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de","Type":"ContainerStarted","Data":"3dac84656694c353f5d8ee7420de49cc223abb0f27df449d9c294150afd7186b"} Sep 07 13:41:33.697080 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.696969 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5c475f5-lqdv9" event={"ID":"202c6fd8-01b7-4973-8474-82ef3da08550","Type":"ContainerStarted","Data":"48b42618d3507847051651e7116df778e0c6bcc4d31b897e39bf74fec98506e2"} Sep 07 13:41:33.698715 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.698665 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-mchqm" Sep 07 13:41:33.707979 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.707922 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7hvb7" podStartSLOduration=9.976738617 podStartE2EDuration="11.707901155s" totalImagesPullingTime="1.638137295s" totalInitContainerRuntime="93.025243ms" isStatefulPod=true podCreationTimestamp="2026-09-07 13:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:33.707380187 +0000 UTC m=+126.046841110" watchObservedRunningTime="2026-09-07 13:41:33.707901155 +0000 UTC m=+126.047362053" Sep 07 13:41:33.737365 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:33.737289 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-mchqm" podStartSLOduration=2.713320829 podStartE2EDuration="19.737257915s" totalImagesPullingTime="17.023937086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:33.735389651 +0000 UTC m=+126.074850550" watchObservedRunningTime="2026-09-07 13:41:33.737257915 +0000 UTC m=+126.076718814" Sep 07 13:41:36.150080 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:36.149994 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:36.229151 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:36.229066 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:37.179793 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:37.179762 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:37.282829 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:37.282737 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:37.351276 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:37.351168 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:37.995181 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:37.995105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:41:37.998560 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:37.998498 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/249d9193-e8e4-41bc-8fdb-6520c9380538-metrics-certs\") pod \"network-metrics-daemon-l5pc5\" (UID: \"249d9193-e8e4-41bc-8fdb-6520c9380538\") " pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:41:38.216632 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:38.216382 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gbgxg\"" Sep 07 13:41:38.224207 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:38.224166 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5pc5" Sep 07 13:41:38.730557 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:38.730513 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerStarted","Data":"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c"} Sep 07 13:41:38.732868 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:38.732837 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" event={"ID":"0e5a3f54-8518-4015-9a23-35e39b39c182","Type":"ContainerStarted","Data":"4caa52f1630dacfa6594176dc73ce712a2c2a392df27c2f4246e8bbfda762622"} Sep 07 13:41:38.734583 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:38.734557 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" event={"ID":"58b19ac1-af6f-43a1-af40-289be163524f","Type":"ContainerStarted","Data":"0a2cf9c9df2953a0b0d6403d263f938e545f0b265ce7aa66f6ab2ee578120a8e"} Sep 07 13:41:38.782686 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:38.782652 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l5pc5"] Sep 07 13:41:38.786135 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:38.786080 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" podStartSLOduration=7.08078406 podStartE2EDuration="12.786058333s" totalImagesPullingTime="5.705274273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:38.783658047 +0000 UTC m=+131.123118943" watchObservedRunningTime="2026-09-07 13:41:38.786058333 +0000 UTC m=+131.125519230" Sep 07 13:41:38.831523 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:41:38.831476 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249d9193_e8e4_41bc_8fdb_6520c9380538.slice/crio-bb6d00c0224aef2a0d7e0afca7d99584bd710f50c44bf7b0915df9e89c3eac21 WatchSource:0}: Error finding container bb6d00c0224aef2a0d7e0afca7d99584bd710f50c44bf7b0915df9e89c3eac21: Status 404 returned error can't find the container with id bb6d00c0224aef2a0d7e0afca7d99584bd710f50c44bf7b0915df9e89c3eac21 Sep 07 13:41:39.741207 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:39.741169 2574 generic.go:356] "Generic (PLEG): container finished" podID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerID="2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c" exitCode=0 Sep 07 13:41:39.741792 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:39.741258 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerDied","Data":"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c"} Sep 07 13:41:39.744763 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:39.744728 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" event={"ID":"0e5a3f54-8518-4015-9a23-35e39b39c182","Type":"ContainerStarted","Data":"7725a6dc2e7ce83857ba1a00f7f004c23620e00674cbd4fe4cdc53d7cb0a3fbd"} Sep 07 13:41:39.744879 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:39.744818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" event={"ID":"0e5a3f54-8518-4015-9a23-35e39b39c182","Type":"ContainerStarted","Data":"afdd7eea6f7d634340737fd2b4f38a33d587f9b43944478fd32aad0c78b2cd0e"} Sep 07 13:41:39.746783 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:39.746757 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f997ff49c-swrtj" event={"ID":"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de","Type":"ContainerStarted","Data":"f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d"} Sep 07 13:41:39.748675 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:39.748644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5c475f5-lqdv9" event={"ID":"202c6fd8-01b7-4973-8474-82ef3da08550","Type":"ContainerStarted","Data":"cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e"} Sep 07 13:41:39.750884 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:39.750858 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5pc5" event={"ID":"249d9193-e8e4-41bc-8fdb-6520c9380538","Type":"ContainerStarted","Data":"bb6d00c0224aef2a0d7e0afca7d99584bd710f50c44bf7b0915df9e89c3eac21"} Sep 07 13:41:39.857201 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:39.856324 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b5c475f5-lqdv9" podStartSLOduration=6.728073508 podStartE2EDuration="12.856299443s" totalImagesPullingTime="6.128225935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:41:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:39.826638114 +0000 UTC m=+132.166099011" watchObservedRunningTime="2026-09-07 13:41:39.856299443 +0000 UTC m=+132.195760341" Sep 07 13:41:39.858254 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:39.857618 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f997ff49c-swrtj" podStartSLOduration=8.739970682 podStartE2EDuration="14.857599469s" totalImagesPullingTime="6.117628787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:41:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:39.855679579 +0000 UTC m=+132.195140476" watchObservedRunningTime="2026-09-07 13:41:39.857599469 +0000 UTC m=+132.197060366" Sep 07 13:41:40.258810 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:40.258767 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5c475f5-lqdv9"] Sep 07 13:41:40.418473 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:40.418435 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:40.527899 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:40.527816 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:41.764306 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:41.764258 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" event={"ID":"0e5a3f54-8518-4015-9a23-35e39b39c182","Type":"ContainerStarted","Data":"5d110929e07bd6e79f5039c2a47cbbc723729fdca362f186ad75f80b0c2b9dc3"} Sep 07 13:41:41.764833 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:41.764400 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" event={"ID":"0e5a3f54-8518-4015-9a23-35e39b39c182","Type":"ContainerStarted","Data":"5455a8688f4dffb5488946c5d20762699975a6f88a452ee190c40c23ab0428bf"} Sep 07 13:41:41.764833 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:41.764445 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" event={"ID":"0e5a3f54-8518-4015-9a23-35e39b39c182","Type":"ContainerStarted","Data":"6427db886d7ad321de6078e7e7833c70ddd4e4237ad3200cda890caec6c148f4"} Sep 07 13:41:41.764833 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:41.764487 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:41.769096 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:41.769058 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5pc5" event={"ID":"249d9193-e8e4-41bc-8fdb-6520c9380538","Type":"ContainerStarted","Data":"317197cb232ff2e6d26e28b2f57e25f95d3f52faee737e12d90c2a88af14ed2a"} Sep 07 13:41:41.769245 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:41.769122 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5pc5" event={"ID":"249d9193-e8e4-41bc-8fdb-6520c9380538","Type":"ContainerStarted","Data":"12d416242c7c20665cefcd78c13c748523c0fcf96e6a150a1c1ec628ae4e401a"} Sep 07 13:41:41.798481 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:41.798414 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" podStartSLOduration=9.419811499 podStartE2EDuration="16.798328953s" totalImagesPullingTime="7.378517454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:41:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:41.795163075 +0000 UTC m=+134.134623983" watchObservedRunningTime="2026-09-07 13:41:41.798328953 +0000 UTC m=+134.137789848" Sep 07 13:41:41.845854 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:41.845799 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l5pc5" podStartSLOduration=131.895168467 podStartE2EDuration="2m13.845781479s" totalImagesPullingTime="1.950613012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:41.820409104 +0000 UTC m=+134.159870001" watchObservedRunningTime="2026-09-07 13:41:41.845781479 +0000 UTC m=+134.185242376" Sep 07 13:41:41.942830 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:41.942793 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:42.045165 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:42.045074 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:42.446033 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:42.445924 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:42.547403 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:42.547255 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:44.023119 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:44.023078 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:44.196454 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:44.196423 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:44.310048 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:44.310010 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:44.794071 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:44.794030 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerStarted","Data":"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a"} Sep 07 13:41:44.794301 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:44.794161 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerStarted","Data":"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6"} Sep 07 13:41:44.794301 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:44.794203 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerStarted","Data":"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8"} Sep 07 13:41:44.794301 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:44.794241 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerStarted","Data":"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41"} Sep 07 13:41:44.794301 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:44.794276 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerStarted","Data":"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e"} Sep 07 13:41:44.794478 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:44.794315 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerStarted","Data":"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df"} Sep 07 13:41:44.846006 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:44.845946 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.077947528 podStartE2EDuration="15.845929836s" totalImagesPullingTime="9.738351939s" totalInitContainerRuntime="29.630369ms" isStatefulPod=false podCreationTimestamp="2026-09-07 13:41:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:41:44.843995131 +0000 UTC m=+137.183456052" watchObservedRunningTime="2026-09-07 13:41:44.845929836 +0000 UTC m=+137.185390729" Sep 07 13:41:45.338839 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:45.338803 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:45.454848 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:45.454812 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:45.598989 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:45.598905 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:41:47.267111 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:47.267076 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:47.335730 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:47.335695 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:47.335887 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:47.335757 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:41:47.356615 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:47.356577 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:47.781301 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:47.781269 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f568487bc-kc4vf" Sep 07 13:41:47.789233 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:47.789212 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:41:49.399038 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:49.398996 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:41:51.734280 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:51.734249 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:41:51.797461 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:41:51.797426 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:42:04.774301 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:04.774214 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f997ff49c-swrtj" podUID="7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" containerName="console" containerID="cri-o://f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d" gracePeriod=15 Sep 07 13:42:05.040973 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.040942 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:42:05.153431 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.153392 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-oauth-config\") pod \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " Sep 07 13:42:05.153611 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.153441 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-serving-cert\") pod \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " Sep 07 13:42:05.153611 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.153488 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-service-ca\") pod \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " Sep 07 13:42:05.153611 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.153542 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-config\") pod \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " Sep 07 13:42:05.153611 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.153572 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-oauth-serving-cert\") pod \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " Sep 07 13:42:05.153611 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.153601 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgjk9\" (UniqueName: \"kubernetes.io/projected/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-kube-api-access-qgjk9\") pod \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\" (UID: \"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de\") " Sep 07 13:42:05.154010 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.153974 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-config" (OuterVolumeSpecName: "console-config") pod "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" (UID: "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:05.154087 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.153982 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-service-ca" (OuterVolumeSpecName: "service-ca") pod "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" (UID: "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:05.154087 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.153988 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" (UID: "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:05.155992 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.155961 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-kube-api-access-qgjk9" (OuterVolumeSpecName: "kube-api-access-qgjk9") pod "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" (UID: "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de"). InnerVolumeSpecName "kube-api-access-qgjk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:42:05.156144 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.156115 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" (UID: "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:05.156187 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.156129 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" (UID: "7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:05.254758 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.254724 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-oauth-config\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:05.254758 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.254756 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-serving-cert\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:05.254892 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.254765 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-service-ca\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:05.254892 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.254775 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-console-config\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:05.254892 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.254784 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-oauth-serving-cert\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:05.254892 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.254792 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgjk9\" (UniqueName: \"kubernetes.io/projected/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de-kube-api-access-qgjk9\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:05.887929 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.887892 2574 generic.go:356] "Generic (PLEG): container finished" podID="7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" containerID="f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d" exitCode=0 Sep 07 13:42:05.888332 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.887945 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f997ff49c-swrtj" Sep 07 13:42:05.888332 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.887967 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f997ff49c-swrtj" event={"ID":"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de","Type":"ContainerDied","Data":"f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d"} Sep 07 13:42:05.888332 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.888018 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f997ff49c-swrtj" event={"ID":"7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de","Type":"ContainerDied","Data":"3dac84656694c353f5d8ee7420de49cc223abb0f27df449d9c294150afd7186b"} Sep 07 13:42:05.888332 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.888046 2574 scope.go:117] "RemoveContainer" containerID="f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d" Sep 07 13:42:05.896381 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.896343 2574 scope.go:117] "RemoveContainer" containerID="f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d" Sep 07 13:42:05.896668 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:42:05.896647 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d\": container with ID starting with f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d not found: ID does not exist" containerID="f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d" Sep 07 13:42:05.896710 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.896674 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d"} err="failed to get container status \"f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d\": rpc error: code = NotFound desc = could not find container \"f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d\": container with ID starting with f9c7168f936bad59567b1474ab3e02b9452866e49c70b69263f330e7badf484d not found: ID does not exist" Sep 07 13:42:05.912054 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.911928 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f997ff49c-swrtj"] Sep 07 13:42:05.913749 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:05.913727 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f997ff49c-swrtj"] Sep 07 13:42:06.109657 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:06.109620 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" path="/var/lib/kubelet/pods/7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de/volumes" Sep 07 13:42:06.739037 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:06.738999 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:42:06.791798 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:06.791760 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b5c475f5-lqdv9" podUID="202c6fd8-01b7-4973-8474-82ef3da08550" containerName="console" containerID="cri-o://cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e" gracePeriod=15 Sep 07 13:42:06.816814 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:06.816788 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:42:07.077430 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.077402 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:42:07.174328 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.174293 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-trusted-ca-bundle\") pod \"202c6fd8-01b7-4973-8474-82ef3da08550\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " Sep 07 13:42:07.174328 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.174334 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-serving-cert\") pod \"202c6fd8-01b7-4973-8474-82ef3da08550\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " Sep 07 13:42:07.174613 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.174374 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-console-config\") pod \"202c6fd8-01b7-4973-8474-82ef3da08550\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " Sep 07 13:42:07.174613 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.174404 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-service-ca\") pod \"202c6fd8-01b7-4973-8474-82ef3da08550\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " Sep 07 13:42:07.174613 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.174432 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmkg8\" (UniqueName: \"kubernetes.io/projected/202c6fd8-01b7-4973-8474-82ef3da08550-kube-api-access-gmkg8\") pod \"202c6fd8-01b7-4973-8474-82ef3da08550\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " Sep 07 13:42:07.174613 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.174490 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-oauth-config\") pod \"202c6fd8-01b7-4973-8474-82ef3da08550\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " Sep 07 13:42:07.174613 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.174528 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-oauth-serving-cert\") pod \"202c6fd8-01b7-4973-8474-82ef3da08550\" (UID: \"202c6fd8-01b7-4973-8474-82ef3da08550\") " Sep 07 13:42:07.174912 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.174810 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "202c6fd8-01b7-4973-8474-82ef3da08550" (UID: "202c6fd8-01b7-4973-8474-82ef3da08550"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:07.175038 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.174865 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-service-ca" (OuterVolumeSpecName: "service-ca") pod "202c6fd8-01b7-4973-8474-82ef3da08550" (UID: "202c6fd8-01b7-4973-8474-82ef3da08550"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:07.175038 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.174876 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-console-config" (OuterVolumeSpecName: "console-config") pod "202c6fd8-01b7-4973-8474-82ef3da08550" (UID: "202c6fd8-01b7-4973-8474-82ef3da08550"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:07.175038 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.174980 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "202c6fd8-01b7-4973-8474-82ef3da08550" (UID: "202c6fd8-01b7-4973-8474-82ef3da08550"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:07.176754 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.176732 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "202c6fd8-01b7-4973-8474-82ef3da08550" (UID: "202c6fd8-01b7-4973-8474-82ef3da08550"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:07.176956 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.176941 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/202c6fd8-01b7-4973-8474-82ef3da08550-kube-api-access-gmkg8" (OuterVolumeSpecName: "kube-api-access-gmkg8") pod "202c6fd8-01b7-4973-8474-82ef3da08550" (UID: "202c6fd8-01b7-4973-8474-82ef3da08550"). InnerVolumeSpecName "kube-api-access-gmkg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:42:07.177005 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.176956 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "202c6fd8-01b7-4973-8474-82ef3da08550" (UID: "202c6fd8-01b7-4973-8474-82ef3da08550"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:07.275457 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.275405 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-trusted-ca-bundle\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:07.275457 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.275449 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-serving-cert\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:07.275457 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.275460 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-console-config\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:07.275457 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.275468 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-service-ca\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:07.275457 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.275477 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmkg8\" (UniqueName: \"kubernetes.io/projected/202c6fd8-01b7-4973-8474-82ef3da08550-kube-api-access-gmkg8\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:07.275743 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.275486 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/202c6fd8-01b7-4973-8474-82ef3da08550-console-oauth-config\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:07.275743 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.275496 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/202c6fd8-01b7-4973-8474-82ef3da08550-oauth-serving-cert\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:07.340816 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.340739 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:42:07.344632 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.344608 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5cb74979ff-pq9r2" Sep 07 13:42:07.899420 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.899380 2574 generic.go:356] "Generic (PLEG): container finished" podID="202c6fd8-01b7-4973-8474-82ef3da08550" containerID="cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e" exitCode=0 Sep 07 13:42:07.899420 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.899420 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5c475f5-lqdv9" Sep 07 13:42:07.899688 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.899465 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5c475f5-lqdv9" event={"ID":"202c6fd8-01b7-4973-8474-82ef3da08550","Type":"ContainerDied","Data":"cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e"} Sep 07 13:42:07.899688 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.899510 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5c475f5-lqdv9" event={"ID":"202c6fd8-01b7-4973-8474-82ef3da08550","Type":"ContainerDied","Data":"48b42618d3507847051651e7116df778e0c6bcc4d31b897e39bf74fec98506e2"} Sep 07 13:42:07.899688 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.899532 2574 scope.go:117] "RemoveContainer" containerID="cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e" Sep 07 13:42:07.909791 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.909772 2574 scope.go:117] "RemoveContainer" containerID="cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e" Sep 07 13:42:07.910093 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:42:07.910072 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e\": container with ID starting with cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e not found: ID does not exist" containerID="cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e" Sep 07 13:42:07.910170 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.910105 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e"} err="failed to get container status \"cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e\": rpc error: code = NotFound desc = could not find container \"cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e\": container with ID starting with cdfc3a9965c71764e383df3710bb8a32786afdc59c67a4a016dfd5b0f6c2b26e not found: ID does not exist" Sep 07 13:42:07.924681 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.924649 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5c475f5-lqdv9"] Sep 07 13:42:07.929675 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:07.929648 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b5c475f5-lqdv9"] Sep 07 13:42:08.111104 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:08.111051 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="202c6fd8-01b7-4973-8474-82ef3da08550" path="/var/lib/kubelet/pods/202c6fd8-01b7-4973-8474-82ef3da08550/volumes" Sep 07 13:42:29.224842 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:29.224802 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:42:29.399909 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:29.399873 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:29.415681 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:29.415647 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:30.004564 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:30.004536 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:42.024251 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:42.024216 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:42:42.244685 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:42.244645 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:42:47.524822 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.524785 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:47.525336 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.525105 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="prometheus" containerID="cri-o://7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df" gracePeriod=600 Sep 07 13:42:47.525336 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.525120 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy-thanos" containerID="cri-o://07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a" gracePeriod=600 Sep 07 13:42:47.525336 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.525155 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="config-reloader" containerID="cri-o://24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e" gracePeriod=600 Sep 07 13:42:47.525336 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.525147 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="thanos-sidecar" containerID="cri-o://d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41" gracePeriod=600 Sep 07 13:42:47.525336 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.525155 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy-web" containerID="cri-o://d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8" gracePeriod=600 Sep 07 13:42:47.525336 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.525237 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy" containerID="cri-o://78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6" gracePeriod=600 Sep 07 13:42:47.774973 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.774910 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:47.908121 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908084 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-tls-assets\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908121 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908124 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-db\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908399 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908142 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-kube-rbac-proxy\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908399 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908176 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908399 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908205 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-2\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908399 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908233 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m78mv\" (UniqueName: \"kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-kube-api-access-m78mv\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908399 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908294 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-thanos-prometheus-http-client-file\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908399 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908319 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-1\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908399 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908341 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-config\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908406 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908430 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-metrics-client-ca\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908454 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-metrics-client-certs\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908479 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-0\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908506 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-tls\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908561 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-grpc-tls\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908590 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-trusted-ca-bundle\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908622 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-serving-certs-ca-bundle\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908646 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-web-config\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908650 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908673 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-config-out\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.908753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908721 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-kubelet-serving-ca-bundle\") pod \"b88f450f-2ea5-4177-97d0-6293286bdb63\" (UID: \"b88f450f-2ea5-4177-97d0-6293286bdb63\") " Sep 07 13:42:47.909381 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.908992 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:47.909454 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.909402 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:47.909511 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.909441 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:47.910070 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.909898 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:42:47.910070 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.909931 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:47.910239 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.910205 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:47.910926 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.910328 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:47.911652 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.911624 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:42:47.911801 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.911772 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:47.912149 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.912120 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:47.912281 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.912256 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:47.912431 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.912342 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:42:47.912754 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.912726 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-config-out" (OuterVolumeSpecName: "config-out") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:42:47.912838 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.912773 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:47.912902 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.912873 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-kube-api-access-m78mv" (OuterVolumeSpecName: "kube-api-access-m78mv") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "kube-api-access-m78mv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:42:47.913492 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.913470 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-config" (OuterVolumeSpecName: "config") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:47.913492 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.913482 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:47.913985 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.913971 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:47.914398 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.914366 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:47.923515 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:47.923492 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-web-config" (OuterVolumeSpecName: "web-config") pod "b88f450f-2ea5-4177-97d0-6293286bdb63" (UID: "b88f450f-2ea5-4177-97d0-6293286bdb63"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:42:48.010068 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010028 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-tls-assets\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010068 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010062 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-db\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010068 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010071 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-kube-rbac-proxy\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010084 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010093 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m78mv\" (UniqueName: \"kubernetes.io/projected/b88f450f-2ea5-4177-97d0-6293286bdb63-kube-api-access-m78mv\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010102 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010112 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010121 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-config\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010130 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010139 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-metrics-client-ca\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010149 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-metrics-client-certs\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010157 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010165 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010175 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-secret-grpc-tls\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010183 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010192 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010202 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b88f450f-2ea5-4177-97d0-6293286bdb63-web-config\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010210 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b88f450f-2ea5-4177-97d0-6293286bdb63-config-out\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.010299 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.010218 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b88f450f-2ea5-4177-97d0-6293286bdb63-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:42:48.063978 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.063897 2574 generic.go:356] "Generic (PLEG): container finished" podID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerID="07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a" exitCode=0 Sep 07 13:42:48.063978 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.063926 2574 generic.go:356] "Generic (PLEG): container finished" podID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerID="78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6" exitCode=0 Sep 07 13:42:48.063978 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.063933 2574 generic.go:356] "Generic (PLEG): container finished" podID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerID="d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8" exitCode=0 Sep 07 13:42:48.063978 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.063939 2574 generic.go:356] "Generic (PLEG): container finished" podID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerID="d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41" exitCode=0 Sep 07 13:42:48.063978 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.063946 2574 generic.go:356] "Generic (PLEG): container finished" podID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerID="24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e" exitCode=0 Sep 07 13:42:48.063978 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.063952 2574 generic.go:356] "Generic (PLEG): container finished" podID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerID="7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df" exitCode=0 Sep 07 13:42:48.063978 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.063974 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.064329 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.063984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerDied","Data":"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a"} Sep 07 13:42:48.064329 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.064051 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerDied","Data":"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6"} Sep 07 13:42:48.064329 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.064081 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerDied","Data":"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8"} Sep 07 13:42:48.064329 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.064114 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerDied","Data":"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41"} Sep 07 13:42:48.064329 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.064119 2574 scope.go:117] "RemoveContainer" containerID="07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a" Sep 07 13:42:48.064329 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.064152 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerDied","Data":"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e"} Sep 07 13:42:48.064329 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.064190 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerDied","Data":"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df"} Sep 07 13:42:48.064329 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.064232 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b88f450f-2ea5-4177-97d0-6293286bdb63","Type":"ContainerDied","Data":"11b738f9c3f86c7e05b58b9805c3b87f8f8b7bb107b06e15c652f1bbea9f284d"} Sep 07 13:42:48.072257 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.072139 2574 scope.go:117] "RemoveContainer" containerID="78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6" Sep 07 13:42:48.079838 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.079817 2574 scope.go:117] "RemoveContainer" containerID="d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8" Sep 07 13:42:48.087613 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.087585 2574 scope.go:117] "RemoveContainer" containerID="d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41" Sep 07 13:42:48.089694 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.089670 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:48.098565 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.098531 2574 scope.go:117] "RemoveContainer" containerID="24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e" Sep 07 13:42:48.100137 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.100115 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:48.106792 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.106773 2574 scope.go:117] "RemoveContainer" containerID="7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df" Sep 07 13:42:48.108295 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.108272 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" path="/var/lib/kubelet/pods/b88f450f-2ea5-4177-97d0-6293286bdb63/volumes" Sep 07 13:42:48.114847 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.114827 2574 scope.go:117] "RemoveContainer" containerID="2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c" Sep 07 13:42:48.120749 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.120724 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:48.121031 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121019 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy-web" Sep 07 13:42:48.121078 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121033 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy-web" Sep 07 13:42:48.121078 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121041 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="202c6fd8-01b7-4973-8474-82ef3da08550" containerName="console" Sep 07 13:42:48.121078 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121048 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="202c6fd8-01b7-4973-8474-82ef3da08550" containerName="console" Sep 07 13:42:48.121078 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121061 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="init-config-reloader" Sep 07 13:42:48.121078 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121066 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="init-config-reloader" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121080 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="config-reloader" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121086 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="config-reloader" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121094 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy-thanos" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121099 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy-thanos" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121111 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="prometheus" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121116 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="prometheus" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121122 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121130 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121139 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" containerName="console" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121144 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" containerName="console" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121149 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="thanos-sidecar" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121155 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="thanos-sidecar" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121201 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="prometheus" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121212 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cc3c70c-e8e2-4bae-ac6f-86f74a4cb5de" containerName="console" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121218 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121223 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy-thanos" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121228 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="kube-rbac-proxy-web" Sep 07 13:42:48.121227 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121233 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="config-reloader" Sep 07 13:42:48.121950 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121239 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="202c6fd8-01b7-4973-8474-82ef3da08550" containerName="console" Sep 07 13:42:48.121950 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.121244 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b88f450f-2ea5-4177-97d0-6293286bdb63" containerName="thanos-sidecar" Sep 07 13:42:48.123165 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.123149 2574 scope.go:117] "RemoveContainer" containerID="07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a" Sep 07 13:42:48.123560 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:42:48.123540 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": container with ID starting with 07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a not found: ID does not exist" containerID="07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a" Sep 07 13:42:48.123623 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.123570 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a"} err="failed to get container status \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": rpc error: code = NotFound desc = could not find container \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": container with ID starting with 07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a not found: ID does not exist" Sep 07 13:42:48.123623 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.123588 2574 scope.go:117] "RemoveContainer" containerID="78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6" Sep 07 13:42:48.123841 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:42:48.123826 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": container with ID starting with 78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6 not found: ID does not exist" containerID="78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6" Sep 07 13:42:48.123886 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.123842 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6"} err="failed to get container status \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": rpc error: code = NotFound desc = could not find container \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": container with ID starting with 78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6 not found: ID does not exist" Sep 07 13:42:48.123886 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.123858 2574 scope.go:117] "RemoveContainer" containerID="d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8" Sep 07 13:42:48.124123 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:42:48.124111 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": container with ID starting with d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8 not found: ID does not exist" containerID="d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8" Sep 07 13:42:48.124216 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.124124 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8"} err="failed to get container status \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": rpc error: code = NotFound desc = could not find container \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": container with ID starting with d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8 not found: ID does not exist" Sep 07 13:42:48.124216 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.124135 2574 scope.go:117] "RemoveContainer" containerID="d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41" Sep 07 13:42:48.124373 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:42:48.124341 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": container with ID starting with d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41 not found: ID does not exist" containerID="d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41" Sep 07 13:42:48.124417 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.124378 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41"} err="failed to get container status \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": rpc error: code = NotFound desc = could not find container \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": container with ID starting with d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41 not found: ID does not exist" Sep 07 13:42:48.124417 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.124393 2574 scope.go:117] "RemoveContainer" containerID="24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e" Sep 07 13:42:48.124703 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:42:48.124674 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": container with ID starting with 24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e not found: ID does not exist" containerID="24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e" Sep 07 13:42:48.124800 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.124713 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e"} err="failed to get container status \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": rpc error: code = NotFound desc = could not find container \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": container with ID starting with 24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e not found: ID does not exist" Sep 07 13:42:48.124800 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.124730 2574 scope.go:117] "RemoveContainer" containerID="7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df" Sep 07 13:42:48.124905 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.124826 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.125037 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:42:48.125014 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": container with ID starting with 7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df not found: ID does not exist" containerID="7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df" Sep 07 13:42:48.125166 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.125043 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df"} err="failed to get container status \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": rpc error: code = NotFound desc = could not find container \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": container with ID starting with 7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df not found: ID does not exist" Sep 07 13:42:48.125166 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.125065 2574 scope.go:117] "RemoveContainer" containerID="2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c" Sep 07 13:42:48.125661 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:42:48.125638 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": container with ID starting with 2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c not found: ID does not exist" containerID="2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c" Sep 07 13:42:48.125749 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.125668 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c"} err="failed to get container status \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": rpc error: code = NotFound desc = could not find container \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": container with ID starting with 2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c not found: ID does not exist" Sep 07 13:42:48.125749 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.125689 2574 scope.go:117] "RemoveContainer" containerID="07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a" Sep 07 13:42:48.125986 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.125958 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a"} err="failed to get container status \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": rpc error: code = NotFound desc = could not find container \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": container with ID starting with 07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a not found: ID does not exist" Sep 07 13:42:48.126074 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.125987 2574 scope.go:117] "RemoveContainer" containerID="78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6" Sep 07 13:42:48.126252 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.126231 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6"} err="failed to get container status \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": rpc error: code = NotFound desc = could not find container \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": container with ID starting with 78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6 not found: ID does not exist" Sep 07 13:42:48.126252 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.126250 2574 scope.go:117] "RemoveContainer" containerID="d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8" Sep 07 13:42:48.126564 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.126544 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8"} err="failed to get container status \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": rpc error: code = NotFound desc = could not find container \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": container with ID starting with d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8 not found: ID does not exist" Sep 07 13:42:48.126651 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.126566 2574 scope.go:117] "RemoveContainer" containerID="d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41" Sep 07 13:42:48.126814 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.126796 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41"} err="failed to get container status \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": rpc error: code = NotFound desc = could not find container \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": container with ID starting with d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41 not found: ID does not exist" Sep 07 13:42:48.126889 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.126816 2574 scope.go:117] "RemoveContainer" containerID="24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e" Sep 07 13:42:48.127123 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.127100 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e"} err="failed to get container status \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": rpc error: code = NotFound desc = could not find container \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": container with ID starting with 24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e not found: ID does not exist" Sep 07 13:42:48.127169 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.127125 2574 scope.go:117] "RemoveContainer" containerID="7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df" Sep 07 13:42:48.127470 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.127443 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df"} err="failed to get container status \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": rpc error: code = NotFound desc = could not find container \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": container with ID starting with 7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df not found: ID does not exist" Sep 07 13:42:48.127560 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.127470 2574 scope.go:117] "RemoveContainer" containerID="2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c" Sep 07 13:42:48.127646 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.127627 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 13:42:48.127707 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.127628 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 13:42:48.127764 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.127724 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 13:42:48.127820 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.127776 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c"} err="failed to get container status \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": rpc error: code = NotFound desc = could not find container \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": container with ID starting with 2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c not found: ID does not exist" Sep 07 13:42:48.127820 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.127794 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 13:42:48.127928 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.127798 2574 scope.go:117] "RemoveContainer" containerID="07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a" Sep 07 13:42:48.128130 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.128100 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a"} err="failed to get container status \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": rpc error: code = NotFound desc = could not find container \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": container with ID starting with 07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a not found: ID does not exist" Sep 07 13:42:48.128130 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.128128 2574 scope.go:117] "RemoveContainer" containerID="78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6" Sep 07 13:42:48.128292 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.128270 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 13:42:48.128421 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.128406 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 13:42:48.128484 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.128472 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c4glk\"" Sep 07 13:42:48.128617 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.128595 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 13:42:48.128617 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.128617 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 13:42:48.128772 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.128665 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ag4ko9icmcea5\"" Sep 07 13:42:48.128772 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.128724 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 13:42:48.128772 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.128746 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6"} err="failed to get container status \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": rpc error: code = NotFound desc = could not find container \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": container with ID starting with 78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6 not found: ID does not exist" Sep 07 13:42:48.128772 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.128770 2574 scope.go:117] "RemoveContainer" containerID="d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8" Sep 07 13:42:48.129094 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.129071 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8"} err="failed to get container status \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": rpc error: code = NotFound desc = could not find container \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": container with ID starting with d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8 not found: ID does not exist" Sep 07 13:42:48.129094 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.129098 2574 scope.go:117] "RemoveContainer" containerID="d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41" Sep 07 13:42:48.129425 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.129395 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41"} err="failed to get container status \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": rpc error: code = NotFound desc = could not find container \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": container with ID starting with d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41 not found: ID does not exist" Sep 07 13:42:48.129425 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.129423 2574 scope.go:117] "RemoveContainer" containerID="24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e" Sep 07 13:42:48.129584 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.129472 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 13:42:48.129584 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.129557 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 13:42:48.129900 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.129769 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 13:42:48.129900 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.129846 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e"} err="failed to get container status \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": rpc error: code = NotFound desc = could not find container \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": container with ID starting with 24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e not found: ID does not exist" Sep 07 13:42:48.129900 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.129872 2574 scope.go:117] "RemoveContainer" containerID="7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df" Sep 07 13:42:48.130213 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.130182 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df"} err="failed to get container status \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": rpc error: code = NotFound desc = could not find container \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": container with ID starting with 7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df not found: ID does not exist" Sep 07 13:42:48.130213 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.130214 2574 scope.go:117] "RemoveContainer" containerID="2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c" Sep 07 13:42:48.130538 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.130508 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c"} err="failed to get container status \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": rpc error: code = NotFound desc = could not find container \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": container with ID starting with 2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c not found: ID does not exist" Sep 07 13:42:48.130626 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.130538 2574 scope.go:117] "RemoveContainer" containerID="07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a" Sep 07 13:42:48.130833 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.130810 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a"} err="failed to get container status \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": rpc error: code = NotFound desc = could not find container \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": container with ID starting with 07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a not found: ID does not exist" Sep 07 13:42:48.130921 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.130834 2574 scope.go:117] "RemoveContainer" containerID="78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6" Sep 07 13:42:48.132112 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.132092 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 13:42:48.132437 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.132411 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6"} err="failed to get container status \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": rpc error: code = NotFound desc = could not find container \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": container with ID starting with 78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6 not found: ID does not exist" Sep 07 13:42:48.132531 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.132439 2574 scope.go:117] "RemoveContainer" containerID="d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8" Sep 07 13:42:48.132784 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.132759 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8"} err="failed to get container status \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": rpc error: code = NotFound desc = could not find container \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": container with ID starting with d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8 not found: ID does not exist" Sep 07 13:42:48.132897 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.132785 2574 scope.go:117] "RemoveContainer" containerID="d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41" Sep 07 13:42:48.133122 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.133099 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41"} err="failed to get container status \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": rpc error: code = NotFound desc = could not find container \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": container with ID starting with d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41 not found: ID does not exist" Sep 07 13:42:48.133172 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.133125 2574 scope.go:117] "RemoveContainer" containerID="24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e" Sep 07 13:42:48.133437 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.133411 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e"} err="failed to get container status \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": rpc error: code = NotFound desc = could not find container \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": container with ID starting with 24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e not found: ID does not exist" Sep 07 13:42:48.133519 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.133439 2574 scope.go:117] "RemoveContainer" containerID="7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df" Sep 07 13:42:48.133519 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.133449 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 13:42:48.133711 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.133688 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df"} err="failed to get container status \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": rpc error: code = NotFound desc = could not find container \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": container with ID starting with 7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df not found: ID does not exist" Sep 07 13:42:48.133807 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.133711 2574 scope.go:117] "RemoveContainer" containerID="2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c" Sep 07 13:42:48.134002 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.133977 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c"} err="failed to get container status \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": rpc error: code = NotFound desc = could not find container \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": container with ID starting with 2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c not found: ID does not exist" Sep 07 13:42:48.134067 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.134005 2574 scope.go:117] "RemoveContainer" containerID="07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a" Sep 07 13:42:48.134510 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.134487 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a"} err="failed to get container status \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": rpc error: code = NotFound desc = could not find container \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": container with ID starting with 07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a not found: ID does not exist" Sep 07 13:42:48.134582 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.134510 2574 scope.go:117] "RemoveContainer" containerID="78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6" Sep 07 13:42:48.134784 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.134758 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6"} err="failed to get container status \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": rpc error: code = NotFound desc = could not find container \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": container with ID starting with 78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6 not found: ID does not exist" Sep 07 13:42:48.134882 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.134785 2574 scope.go:117] "RemoveContainer" containerID="d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8" Sep 07 13:42:48.135076 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.135057 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8"} err="failed to get container status \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": rpc error: code = NotFound desc = could not find container \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": container with ID starting with d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8 not found: ID does not exist" Sep 07 13:42:48.135153 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.135079 2574 scope.go:117] "RemoveContainer" containerID="d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41" Sep 07 13:42:48.135392 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.135372 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41"} err="failed to get container status \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": rpc error: code = NotFound desc = could not find container \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": container with ID starting with d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41 not found: ID does not exist" Sep 07 13:42:48.135453 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.135392 2574 scope.go:117] "RemoveContainer" containerID="24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e" Sep 07 13:42:48.135703 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.135676 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e"} err="failed to get container status \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": rpc error: code = NotFound desc = could not find container \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": container with ID starting with 24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e not found: ID does not exist" Sep 07 13:42:48.135703 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.135699 2574 scope.go:117] "RemoveContainer" containerID="7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df" Sep 07 13:42:48.135942 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.135922 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df"} err="failed to get container status \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": rpc error: code = NotFound desc = could not find container \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": container with ID starting with 7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df not found: ID does not exist" Sep 07 13:42:48.135942 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.135940 2574 scope.go:117] "RemoveContainer" containerID="2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c" Sep 07 13:42:48.136162 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.136144 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c"} err="failed to get container status \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": rpc error: code = NotFound desc = could not find container \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": container with ID starting with 2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c not found: ID does not exist" Sep 07 13:42:48.136236 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.136161 2574 scope.go:117] "RemoveContainer" containerID="07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a" Sep 07 13:42:48.136544 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.136515 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a"} err="failed to get container status \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": rpc error: code = NotFound desc = could not find container \"07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a\": container with ID starting with 07566080e063f7c38020497d189a79237ac2297e787d16f0d0205779b493c19a not found: ID does not exist" Sep 07 13:42:48.136626 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.136545 2574 scope.go:117] "RemoveContainer" containerID="78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6" Sep 07 13:42:48.136824 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.136806 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6"} err="failed to get container status \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": rpc error: code = NotFound desc = could not find container \"78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6\": container with ID starting with 78f3a8885efec55f87e1cd2f553883edf05b0b1afe089ee826577f96d3ba96c6 not found: ID does not exist" Sep 07 13:42:48.136878 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.136823 2574 scope.go:117] "RemoveContainer" containerID="d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8" Sep 07 13:42:48.137069 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.137049 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8"} err="failed to get container status \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": rpc error: code = NotFound desc = could not find container \"d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8\": container with ID starting with d837b2810489c44db8457b4e1ae9be8538cc77ab9942a3a73217139d7341fad8 not found: ID does not exist" Sep 07 13:42:48.137112 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.137069 2574 scope.go:117] "RemoveContainer" containerID="d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41" Sep 07 13:42:48.137305 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.137283 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41"} err="failed to get container status \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": rpc error: code = NotFound desc = could not find container \"d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41\": container with ID starting with d69f31cb6c6e90ee01f775b686af6d8609d46decf2f20c3c6d8a6be47fdf9e41 not found: ID does not exist" Sep 07 13:42:48.137383 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.137304 2574 scope.go:117] "RemoveContainer" containerID="24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e" Sep 07 13:42:48.137571 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.137546 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e"} err="failed to get container status \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": rpc error: code = NotFound desc = could not find container \"24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e\": container with ID starting with 24aa2c2ab45180a03eda9bdb309f5153cb126be7cd133210413b3d7258eeaf5e not found: ID does not exist" Sep 07 13:42:48.137571 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.137568 2574 scope.go:117] "RemoveContainer" containerID="7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df" Sep 07 13:42:48.137824 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.137798 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df"} err="failed to get container status \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": rpc error: code = NotFound desc = could not find container \"7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df\": container with ID starting with 7f8d6afb2a3f9e3bfcc799ab849074198244b28e41805331eb5ccc62e94c71df not found: ID does not exist" Sep 07 13:42:48.137871 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.137828 2574 scope.go:117] "RemoveContainer" containerID="2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c" Sep 07 13:42:48.138067 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.138049 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c"} err="failed to get container status \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": rpc error: code = NotFound desc = could not find container \"2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c\": container with ID starting with 2a2c3be048395f7f58600216efd994b59b6e479a8150a233b016c11adb57aa8c not found: ID does not exist" Sep 07 13:42:48.141577 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.141552 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:48.212033 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.211996 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212182 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212182 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212182 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212182 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212160 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212182 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bhl\" (UniqueName: \"kubernetes.io/projected/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-kube-api-access-n8bhl\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212438 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-config\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212438 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212438 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212438 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212438 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212402 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212438 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212636 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212636 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212636 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212636 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212636 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212809 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212809 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.212809 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.212689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.313626 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.313586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.313626 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.313622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.313872 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.313640 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.313872 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.313657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.313872 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.313672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bhl\" (UniqueName: \"kubernetes.io/projected/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-kube-api-access-n8bhl\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.313872 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.313687 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-config\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.313872 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.313808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.313872 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.313846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.313923 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.313946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.313973 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.314004 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.314033 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.314067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.314095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.314129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.314159 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.314195 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314237 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.314219 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314802 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.314254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314802 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.314521 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.314906 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.314831 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.316678 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.315781 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.316678 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.316453 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.316895 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.316873 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.316955 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.316936 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.317063 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.317042 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-config\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.317132 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.317070 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.317191 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.317156 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.317252 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.317184 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.317306 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.317279 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.317634 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.317610 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.317743 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.317702 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.317743 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.317711 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.319099 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.319073 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.319368 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.319326 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.319439 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.319428 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.319555 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.319534 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.320324 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.320307 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.322584 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.322568 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bhl\" (UniqueName: \"kubernetes.io/projected/6416f20d-6bda-4744-b21e-a9ae83b9ae3d-kube-api-access-n8bhl\") pod \"prometheus-k8s-0\" (UID: \"6416f20d-6bda-4744-b21e-a9ae83b9ae3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.437329 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.437281 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:42:48.723693 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:48.723651 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 13:42:48.725838 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:42:48.725813 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6416f20d_6bda_4744_b21e_a9ae83b9ae3d.slice/crio-9baf6a29e7b4b2f3fb908e35093b96b3023b92fb9e2df81ee79602e2f1a783dc WatchSource:0}: Error finding container 9baf6a29e7b4b2f3fb908e35093b96b3023b92fb9e2df81ee79602e2f1a783dc: Status 404 returned error can't find the container with id 9baf6a29e7b4b2f3fb908e35093b96b3023b92fb9e2df81ee79602e2f1a783dc Sep 07 13:42:49.069040 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:49.068950 2574 generic.go:356] "Generic (PLEG): container finished" podID="6416f20d-6bda-4744-b21e-a9ae83b9ae3d" containerID="fa2e0b598a9fe48f953db1242d8056b4b068543591b057c854a1960ff164235f" exitCode=0 Sep 07 13:42:49.069206 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:49.069034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6416f20d-6bda-4744-b21e-a9ae83b9ae3d","Type":"ContainerDied","Data":"fa2e0b598a9fe48f953db1242d8056b4b068543591b057c854a1960ff164235f"} Sep 07 13:42:49.069206 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:49.069116 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6416f20d-6bda-4744-b21e-a9ae83b9ae3d","Type":"ContainerStarted","Data":"9baf6a29e7b4b2f3fb908e35093b96b3023b92fb9e2df81ee79602e2f1a783dc"} Sep 07 13:42:49.594034 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:49.593954 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:42:50.077998 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:50.077959 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6416f20d-6bda-4744-b21e-a9ae83b9ae3d","Type":"ContainerStarted","Data":"a6ce83c292b5a4f39972b0a0a5459424798a979c3308233543f8bc5b111262a2"} Sep 07 13:42:50.078404 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:50.078080 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6416f20d-6bda-4744-b21e-a9ae83b9ae3d","Type":"ContainerStarted","Data":"9fac4af4b10dc8c960cdac46e8d5edc82527b64f5b572bc01345a3bf17438d7d"} Sep 07 13:42:50.078404 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:50.078128 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6416f20d-6bda-4744-b21e-a9ae83b9ae3d","Type":"ContainerStarted","Data":"f1dec59c2f1af456aff0fd1b9c207ed88afa59f2626bb8aff5b7fb03a0a79f13"} Sep 07 13:42:50.078404 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:50.078167 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6416f20d-6bda-4744-b21e-a9ae83b9ae3d","Type":"ContainerStarted","Data":"0036dc30ae38f3acbc8cbed49ce4e87264797fccd59873b115edd153f7312d34"} Sep 07 13:42:50.078404 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:50.078205 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6416f20d-6bda-4744-b21e-a9ae83b9ae3d","Type":"ContainerStarted","Data":"b4076866aa9cb24ecadfa7bdd29d0ee897892158d5c4f077bdecbad475e04d36"} Sep 07 13:42:50.078404 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:50.078242 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6416f20d-6bda-4744-b21e-a9ae83b9ae3d","Type":"ContainerStarted","Data":"0aa253f1e9475f9ff7d8d8843f4e1e959f670c3f84bad37716e0334d3e2e3ba7"} Sep 07 13:42:50.117010 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:50.116954 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.097152308 podStartE2EDuration="2.11693533s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.783022ms" isStatefulPod=false podCreationTimestamp="2026-09-07 13:42:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:42:50.115830558 +0000 UTC m=+202.455291455" watchObservedRunningTime="2026-09-07 13:42:50.11693533 +0000 UTC m=+202.456396228" Sep 07 13:42:53.438294 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:42:53.438249 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:43:00.636413 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:43:00.636366 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:43:00.763982 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:43:00.763948 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:43:06.214469 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:43:06.214437 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:43:20.322007 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:43:20.321967 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:43:48.437634 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:43:48.437600 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:43:48.453205 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:43:48.453174 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:43:49.325040 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:43:49.325003 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 13:43:57.367435 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:43:57.367334 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:43:57.425838 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:43:57.425807 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:09.224601 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:09.224558 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:09.283708 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:09.283671 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:20.258904 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:20.258868 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:20.314839 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:20.314808 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:21.740679 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:21.740643 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:21.810224 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:21.810191 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:28.058107 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:28.058074 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jfpl8_b687009b-a57a-4c02-925e-af07c3ad9667/console-operator/1.log" Sep 07 13:44:28.065932 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:28.065898 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jfpl8_b687009b-a57a-4c02-925e-af07c3ad9667/console-operator/1.log" Sep 07 13:44:28.069207 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:28.069182 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-acl-logging/0.log" Sep 07 13:44:28.072821 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:28.072790 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-acl-logging/0.log" Sep 07 13:44:28.073632 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:28.073614 2574 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 13:44:30.975749 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:30.975700 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:31.032542 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:31.032508 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:31.112808 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:31.112762 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:47.306212 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:47.306180 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:55.297339 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:55.297306 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:44:55.391915 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:44:55.391850 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:17.353055 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:17.353020 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:18.980209 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:18.980163 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:20.936747 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:20.936634 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:20.995000 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:20.994960 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:23.130795 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:23.130763 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:23.228478 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:23.228442 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:25.521373 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:25.521322 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:25.733728 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:25.733689 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:25.814574 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:25.814483 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:25.938998 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:25.938965 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:32.947032 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:32.946996 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:33.787610 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:33.787574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:33.888526 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:33.888494 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:35.261952 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:35.261903 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:35.360684 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:35.360638 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:45.629008 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:45.628944 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:45.727136 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:45.727098 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:55.991224 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:55.991188 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:56.739166 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:56.739129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:58.006514 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:58.006461 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:58.793783 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:58.793750 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:45:58.866248 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:45:58.866207 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:46:29.110766 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:46:29.110721 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:46:29.212173 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:46:29.212112 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:46:40.481786 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:46:40.481750 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:46:40.584141 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:46:40.584088 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:46:40.647717 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:46:40.647665 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:02.785286 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:02.785206 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:02.885020 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:02.884989 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:03.172876 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:03.172787 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:03.437059 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:03.436983 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:14.869624 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:14.869574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:14.928104 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:14.928064 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:52.386665 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:52.386631 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:52.488902 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:52.488867 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:54.856980 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.856941 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp"] Sep 07 13:47:54.859254 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.859236 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:47:54.860631 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.860604 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:54.863489 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.863466 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 07 13:47:54.863608 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.863574 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-6ds4k\"" Sep 07 13:47:54.863683 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.863608 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 07 13:47:54.863683 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.863617 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 07 13:47:54.863683 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.863626 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 07 13:47:54.873777 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.873755 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp"] Sep 07 13:47:54.907200 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.907165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b96178-a633-445b-9984-72c643ed14ac-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-nxgtp\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:47:54.907401 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.907215 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f89fr\" (UniqueName: \"kubernetes.io/projected/f5b96178-a633-445b-9984-72c643ed14ac-kube-api-access-f89fr\") pod \"kubeflow-trainer-controller-manager-7f9b886978-nxgtp\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:47:54.907401 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:54.907272 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f5b96178-a633-445b-9984-72c643ed14ac-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-nxgtp\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:47:55.008025 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:55.007983 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b96178-a633-445b-9984-72c643ed14ac-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-nxgtp\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:47:55.008217 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:55.008034 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f89fr\" (UniqueName: \"kubernetes.io/projected/f5b96178-a633-445b-9984-72c643ed14ac-kube-api-access-f89fr\") pod \"kubeflow-trainer-controller-manager-7f9b886978-nxgtp\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:47:55.008217 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:55.008056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f5b96178-a633-445b-9984-72c643ed14ac-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-nxgtp\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:47:55.008908 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:55.008881 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f5b96178-a633-445b-9984-72c643ed14ac-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-nxgtp\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:47:55.010600 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:55.010575 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b96178-a633-445b-9984-72c643ed14ac-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-nxgtp\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:47:55.017839 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:55.017804 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f89fr\" (UniqueName: \"kubernetes.io/projected/f5b96178-a633-445b-9984-72c643ed14ac-kube-api-access-f89fr\") pod \"kubeflow-trainer-controller-manager-7f9b886978-nxgtp\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:47:55.168658 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:55.168560 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:47:55.230740 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:55.230648 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:55.292964 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:55.292929 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:55.438024 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:55.437944 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp"] Sep 07 13:47:55.441066 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:47:55.441038 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5b96178_a633_445b_9984_72c643ed14ac.slice/crio-01ddf95b2b8e1e713f7d5c666f56b6ecb51377352e45716c4b4eacf96a7ba7d6 WatchSource:0}: Error finding container 01ddf95b2b8e1e713f7d5c666f56b6ecb51377352e45716c4b4eacf96a7ba7d6: Status 404 returned error can't find the container with id 01ddf95b2b8e1e713f7d5c666f56b6ecb51377352e45716c4b4eacf96a7ba7d6 Sep 07 13:47:55.443010 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:55.442990 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 13:47:56.275419 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:56.275373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" event={"ID":"f5b96178-a633-445b-9984-72c643ed14ac","Type":"ContainerStarted","Data":"01ddf95b2b8e1e713f7d5c666f56b6ecb51377352e45716c4b4eacf96a7ba7d6"} Sep 07 13:47:58.186078 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:58.186047 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:58.267751 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:58.267715 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:47:58.285812 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:58.285781 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" event={"ID":"f5b96178-a633-445b-9984-72c643ed14ac","Type":"ContainerStarted","Data":"28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4"} Sep 07 13:47:58.285962 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:47:58.285898 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:48:14.295298 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:14.295260 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:48:14.320638 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:14.320590 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" podStartSLOduration=18.258885614 podStartE2EDuration="20.320575102s" totalImagesPullingTime="2.061689488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:47:58.313110665 +0000 UTC m=+510.652571563" watchObservedRunningTime="2026-09-07 13:48:14.320575102 +0000 UTC m=+526.660035998" Sep 07 13:48:16.577111 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:16.577049 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:48:16.600114 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:16.600079 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-fgbv4"] Sep 07 13:48:16.608201 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:16.608182 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" Sep 07 13:48:16.612509 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:16.612487 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qtvkz\"" Sep 07 13:48:16.619753 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:16.619728 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-fgbv4"] Sep 07 13:48:16.694645 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:16.694605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wngj2\" (UniqueName: \"kubernetes.io/projected/d26673c9-aae9-4ddb-b814-47dbe2d2edd9-kube-api-access-wngj2\") pod \"test-trainjob-workflow-node-0-0-fgbv4\" (UID: \"d26673c9-aae9-4ddb-b814-47dbe2d2edd9\") " pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" Sep 07 13:48:16.796018 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:16.795964 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wngj2\" (UniqueName: \"kubernetes.io/projected/d26673c9-aae9-4ddb-b814-47dbe2d2edd9-kube-api-access-wngj2\") pod \"test-trainjob-workflow-node-0-0-fgbv4\" (UID: \"d26673c9-aae9-4ddb-b814-47dbe2d2edd9\") " pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" Sep 07 13:48:16.805725 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:16.805701 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wngj2\" (UniqueName: \"kubernetes.io/projected/d26673c9-aae9-4ddb-b814-47dbe2d2edd9-kube-api-access-wngj2\") pod \"test-trainjob-workflow-node-0-0-fgbv4\" (UID: \"d26673c9-aae9-4ddb-b814-47dbe2d2edd9\") " pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" Sep 07 13:48:16.916817 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:16.916732 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" Sep 07 13:48:17.192325 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:17.192298 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-fgbv4"] Sep 07 13:48:17.194921 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:48:17.194895 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd26673c9_aae9_4ddb_b814_47dbe2d2edd9.slice/crio-75e2261c4d245d81cb5c7fbf5fe01091b50ba85dd90dfd16fda8f8d22a730edd WatchSource:0}: Error finding container 75e2261c4d245d81cb5c7fbf5fe01091b50ba85dd90dfd16fda8f8d22a730edd: Status 404 returned error can't find the container with id 75e2261c4d245d81cb5c7fbf5fe01091b50ba85dd90dfd16fda8f8d22a730edd Sep 07 13:48:17.361484 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:17.361448 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" event={"ID":"d26673c9-aae9-4ddb-b814-47dbe2d2edd9","Type":"ContainerStarted","Data":"75e2261c4d245d81cb5c7fbf5fe01091b50ba85dd90dfd16fda8f8d22a730edd"} Sep 07 13:48:44.573501 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:48:44.573451 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:49:17.686714 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:17.686616 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" event={"ID":"d26673c9-aae9-4ddb-b814-47dbe2d2edd9","Type":"ContainerStarted","Data":"f9d3e08e9bdf657ed57b6ace738859ecf9c9129a38d63ab1c85ecaf50015bf50"} Sep 07 13:49:17.718086 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:17.718010 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" podStartSLOduration=1.6750779439999999 podStartE2EDuration="1m1.717987031s" totalImagesPullingTime="1m0.042909087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:49:17.713934417 +0000 UTC m=+590.053395313" watchObservedRunningTime="2026-09-07 13:49:17.717987031 +0000 UTC m=+590.057447941" Sep 07 13:49:20.701053 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:20.701016 2574 generic.go:356] "Generic (PLEG): container finished" podID="d26673c9-aae9-4ddb-b814-47dbe2d2edd9" containerID="f9d3e08e9bdf657ed57b6ace738859ecf9c9129a38d63ab1c85ecaf50015bf50" exitCode=0 Sep 07 13:49:20.701471 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:20.701087 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" event={"ID":"d26673c9-aae9-4ddb-b814-47dbe2d2edd9","Type":"ContainerDied","Data":"f9d3e08e9bdf657ed57b6ace738859ecf9c9129a38d63ab1c85ecaf50015bf50"} Sep 07 13:49:21.950921 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:21.950868 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" Sep 07 13:49:22.002602 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:22.002573 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wngj2\" (UniqueName: \"kubernetes.io/projected/d26673c9-aae9-4ddb-b814-47dbe2d2edd9-kube-api-access-wngj2\") pod \"d26673c9-aae9-4ddb-b814-47dbe2d2edd9\" (UID: \"d26673c9-aae9-4ddb-b814-47dbe2d2edd9\") " Sep 07 13:49:22.005059 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:22.005029 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d26673c9-aae9-4ddb-b814-47dbe2d2edd9-kube-api-access-wngj2" (OuterVolumeSpecName: "kube-api-access-wngj2") pod "d26673c9-aae9-4ddb-b814-47dbe2d2edd9" (UID: "d26673c9-aae9-4ddb-b814-47dbe2d2edd9"). InnerVolumeSpecName "kube-api-access-wngj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:49:22.103897 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:22.103857 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wngj2\" (UniqueName: \"kubernetes.io/projected/d26673c9-aae9-4ddb-b814-47dbe2d2edd9-kube-api-access-wngj2\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:49:22.711585 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:22.711556 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" Sep 07 13:49:22.711847 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:22.711584 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-fgbv4" event={"ID":"d26673c9-aae9-4ddb-b814-47dbe2d2edd9","Type":"ContainerDied","Data":"75e2261c4d245d81cb5c7fbf5fe01091b50ba85dd90dfd16fda8f8d22a730edd"} Sep 07 13:49:22.711847 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:22.711617 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75e2261c4d245d81cb5c7fbf5fe01091b50ba85dd90dfd16fda8f8d22a730edd" Sep 07 13:49:22.953609 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:22.953574 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-fgbv4"] Sep 07 13:49:22.960166 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:22.960134 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-fgbv4"] Sep 07 13:49:23.087518 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.087483 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:49:23.366901 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.366820 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:49:23.388253 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.388223 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp"] Sep 07 13:49:23.388449 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.388428 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" podUID="f5b96178-a633-445b-9984-72c643ed14ac" containerName="manager" containerID="cri-o://28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4" gracePeriod=30 Sep 07 13:49:23.496826 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.496794 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:49:23.654871 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.654846 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:49:23.716876 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.716851 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f5b96178-a633-445b-9984-72c643ed14ac-kubeflow-trainer-config\") pod \"f5b96178-a633-445b-9984-72c643ed14ac\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " Sep 07 13:49:23.717050 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.716893 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b96178-a633-445b-9984-72c643ed14ac-cert\") pod \"f5b96178-a633-445b-9984-72c643ed14ac\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " Sep 07 13:49:23.717050 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.716926 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f89fr\" (UniqueName: \"kubernetes.io/projected/f5b96178-a633-445b-9984-72c643ed14ac-kube-api-access-f89fr\") pod \"f5b96178-a633-445b-9984-72c643ed14ac\" (UID: \"f5b96178-a633-445b-9984-72c643ed14ac\") " Sep 07 13:49:23.717050 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.716945 2574 generic.go:356] "Generic (PLEG): container finished" podID="f5b96178-a633-445b-9984-72c643ed14ac" containerID="28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4" exitCode=0 Sep 07 13:49:23.717050 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.717045 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" Sep 07 13:49:23.717263 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.717036 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" event={"ID":"f5b96178-a633-445b-9984-72c643ed14ac","Type":"ContainerDied","Data":"28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4"} Sep 07 13:49:23.717263 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.717173 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp" event={"ID":"f5b96178-a633-445b-9984-72c643ed14ac","Type":"ContainerDied","Data":"01ddf95b2b8e1e713f7d5c666f56b6ecb51377352e45716c4b4eacf96a7ba7d6"} Sep 07 13:49:23.717263 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.717204 2574 scope.go:117] "RemoveContainer" containerID="28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4" Sep 07 13:49:23.719241 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.719200 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5b96178-a633-445b-9984-72c643ed14ac-cert" (OuterVolumeSpecName: "cert") pod "f5b96178-a633-445b-9984-72c643ed14ac" (UID: "f5b96178-a633-445b-9984-72c643ed14ac"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:49:23.719521 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.719496 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5b96178-a633-445b-9984-72c643ed14ac-kube-api-access-f89fr" (OuterVolumeSpecName: "kube-api-access-f89fr") pod "f5b96178-a633-445b-9984-72c643ed14ac" (UID: "f5b96178-a633-445b-9984-72c643ed14ac"). InnerVolumeSpecName "kube-api-access-f89fr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:49:23.722592 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.722572 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5b96178-a633-445b-9984-72c643ed14ac-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "f5b96178-a633-445b-9984-72c643ed14ac" (UID: "f5b96178-a633-445b-9984-72c643ed14ac"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:49:23.736908 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.736881 2574 scope.go:117] "RemoveContainer" containerID="28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4" Sep 07 13:49:23.737267 ip-10-0-131-22 kubenswrapper[2574]: E0907 13:49:23.737246 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4\": container with ID starting with 28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4 not found: ID does not exist" containerID="28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4" Sep 07 13:49:23.737338 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.737278 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4"} err="failed to get container status \"28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4\": rpc error: code = NotFound desc = could not find container \"28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4\": container with ID starting with 28ce6426f636fda3c5222c395c8cd73eb2679625de0a0e01d3b5786514a3f5f4 not found: ID does not exist" Sep 07 13:49:23.818020 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.817984 2574 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f5b96178-a633-445b-9984-72c643ed14ac-kubeflow-trainer-config\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:49:23.818020 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.818020 2574 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b96178-a633-445b-9984-72c643ed14ac-cert\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:49:23.818222 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.818036 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f89fr\" (UniqueName: \"kubernetes.io/projected/f5b96178-a633-445b-9984-72c643ed14ac-kube-api-access-f89fr\") on node \"ip-10-0-131-22.ec2.internal\" DevicePath \"\"" Sep 07 13:49:23.888088 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.888011 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:49:23.995856 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:23.995819 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:49:24.047559 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:24.047524 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp"] Sep 07 13:49:24.067072 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:24.067040 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-nxgtp"] Sep 07 13:49:24.109297 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:24.109266 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d26673c9-aae9-4ddb-b814-47dbe2d2edd9" path="/var/lib/kubelet/pods/d26673c9-aae9-4ddb-b814-47dbe2d2edd9/volumes" Sep 07 13:49:24.109689 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:24.109675 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5b96178-a633-445b-9984-72c643ed14ac" path="/var/lib/kubelet/pods/f5b96178-a633-445b-9984-72c643ed14ac/volumes" Sep 07 13:49:25.162812 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:25.162777 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:49:25.267532 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:25.267499 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:49:28.091451 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:28.091420 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jfpl8_b687009b-a57a-4c02-925e-af07c3ad9667/console-operator/1.log" Sep 07 13:49:28.092509 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:28.092488 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jfpl8_b687009b-a57a-4c02-925e-af07c3ad9667/console-operator/1.log" Sep 07 13:49:28.098024 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:28.098003 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-acl-logging/0.log" Sep 07 13:49:28.099364 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:28.099326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-acl-logging/0.log" Sep 07 13:49:40.521092 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:40.521046 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:49:40.655946 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:49:40.655905 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:50:24.955003 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:24.954950 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:50:25.090611 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.090572 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vzz84/must-gather-97gx5"] Sep 07 13:50:25.090955 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.090938 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d26673c9-aae9-4ddb-b814-47dbe2d2edd9" containerName="node" Sep 07 13:50:25.091039 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.090958 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d26673c9-aae9-4ddb-b814-47dbe2d2edd9" containerName="node" Sep 07 13:50:25.091039 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.090985 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b96178-a633-445b-9984-72c643ed14ac" containerName="manager" Sep 07 13:50:25.091039 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.090994 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b96178-a633-445b-9984-72c643ed14ac" containerName="manager" Sep 07 13:50:25.091205 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.091076 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5b96178-a633-445b-9984-72c643ed14ac" containerName="manager" Sep 07 13:50:25.091205 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.091089 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d26673c9-aae9-4ddb-b814-47dbe2d2edd9" containerName="node" Sep 07 13:50:25.093038 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.093016 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzz84/must-gather-97gx5" Sep 07 13:50:25.096667 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.096643 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vzz84\"/\"default-dockercfg-hmbwp\"" Sep 07 13:50:25.096772 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.096692 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vzz84\"/\"openshift-service-ca.crt\"" Sep 07 13:50:25.096772 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.096755 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vzz84\"/\"kube-root-ca.crt\"" Sep 07 13:50:25.108687 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.108666 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzz84/must-gather-97gx5"] Sep 07 13:50:25.137716 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.137682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3ebb99c7-f682-4785-a163-51257b907ff5-must-gather-output\") pod \"must-gather-97gx5\" (UID: \"3ebb99c7-f682-4785-a163-51257b907ff5\") " pod="openshift-must-gather-vzz84/must-gather-97gx5" Sep 07 13:50:25.137716 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.137726 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsj4g\" (UniqueName: \"kubernetes.io/projected/3ebb99c7-f682-4785-a163-51257b907ff5-kube-api-access-wsj4g\") pod \"must-gather-97gx5\" (UID: \"3ebb99c7-f682-4785-a163-51257b907ff5\") " pod="openshift-must-gather-vzz84/must-gather-97gx5" Sep 07 13:50:25.239097 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.239063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3ebb99c7-f682-4785-a163-51257b907ff5-must-gather-output\") pod \"must-gather-97gx5\" (UID: \"3ebb99c7-f682-4785-a163-51257b907ff5\") " pod="openshift-must-gather-vzz84/must-gather-97gx5" Sep 07 13:50:25.239254 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.239111 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsj4g\" (UniqueName: \"kubernetes.io/projected/3ebb99c7-f682-4785-a163-51257b907ff5-kube-api-access-wsj4g\") pod \"must-gather-97gx5\" (UID: \"3ebb99c7-f682-4785-a163-51257b907ff5\") " pod="openshift-must-gather-vzz84/must-gather-97gx5" Sep 07 13:50:25.239454 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.239433 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3ebb99c7-f682-4785-a163-51257b907ff5-must-gather-output\") pod \"must-gather-97gx5\" (UID: \"3ebb99c7-f682-4785-a163-51257b907ff5\") " pod="openshift-must-gather-vzz84/must-gather-97gx5" Sep 07 13:50:25.248057 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.248034 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsj4g\" (UniqueName: \"kubernetes.io/projected/3ebb99c7-f682-4785-a163-51257b907ff5-kube-api-access-wsj4g\") pod \"must-gather-97gx5\" (UID: \"3ebb99c7-f682-4785-a163-51257b907ff5\") " pod="openshift-must-gather-vzz84/must-gather-97gx5" Sep 07 13:50:25.402336 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.402297 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzz84/must-gather-97gx5" Sep 07 13:50:25.678196 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.678170 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzz84/must-gather-97gx5"] Sep 07 13:50:25.680297 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:50:25.680268 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ebb99c7_f682_4785_a163_51257b907ff5.slice/crio-f1241bb3ee9dbc91665e0af7f1573f26a111a7f5fdd5d5885732b0b9771ac8bc WatchSource:0}: Error finding container f1241bb3ee9dbc91665e0af7f1573f26a111a7f5fdd5d5885732b0b9771ac8bc: Status 404 returned error can't find the container with id f1241bb3ee9dbc91665e0af7f1573f26a111a7f5fdd5d5885732b0b9771ac8bc Sep 07 13:50:25.966020 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:25.965937 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzz84/must-gather-97gx5" event={"ID":"3ebb99c7-f682-4785-a163-51257b907ff5","Type":"ContainerStarted","Data":"f1241bb3ee9dbc91665e0af7f1573f26a111a7f5fdd5d5885732b0b9771ac8bc"} Sep 07 13:50:26.168873 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:26.168841 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:50:26.977571 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:26.977534 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzz84/must-gather-97gx5" event={"ID":"3ebb99c7-f682-4785-a163-51257b907ff5","Type":"ContainerStarted","Data":"19b52406667cf6d6c73a18c94505ece2475fbbab6e30312360f4b5843365f68c"} Sep 07 13:50:26.978120 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:26.978096 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzz84/must-gather-97gx5" event={"ID":"3ebb99c7-f682-4785-a163-51257b907ff5","Type":"ContainerStarted","Data":"a4f610b5c4dd7180dc3a5798b84d6c4d947b4100cce09dc7b86947ae2a2a92ee"} Sep 07 13:50:27.001094 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:27.001034 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vzz84/must-gather-97gx5" podStartSLOduration=1.414640992 podStartE2EDuration="2.001015356s" totalImagesPullingTime="586.374364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:50:27.000147152 +0000 UTC m=+659.339608079" watchObservedRunningTime="2026-09-07 13:50:27.001015356 +0000 UTC m=+659.340476252" Sep 07 13:50:27.775689 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:27.775652 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8d4vm_5e40cd05-9810-44c4-b3a5-2237f9f6ba56/global-pull-secret-syncer/0.log" Sep 07 13:50:27.892008 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:27.891977 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" Sep 07 13:50:27.974155 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:27.974118 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-22.ec2.internal_aef2fcf38a14b047ca1c2b9fe741b9ea/haproxy/0.log" Sep 07 13:50:30.875859 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:30.875804 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:50:30.975120 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:30.975084 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hwvw_89a988f9-5e65-475e-9a65-8d45d2c1a94b/konnectivity-agent/0.log" limit=1024 Sep 07 13:50:31.758998 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:31.758966 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-ljqt7_b51efc57-cf6f-40b7-9057-e0d5870963c8/cluster-monitoring-operator/0.log" Sep 07 13:50:31.799940 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:31.799906 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-t44b7_43989d5b-64f4-4e17-9cd9-0a76e7ab7244/kube-state-metrics/0.log" Sep 07 13:50:31.828613 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:31.828585 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-t44b7_43989d5b-64f4-4e17-9cd9-0a76e7ab7244/kube-rbac-proxy-main/0.log" Sep 07 13:50:31.861530 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:31.861503 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-t44b7_43989d5b-64f4-4e17-9cd9-0a76e7ab7244/kube-rbac-proxy-self/0.log" Sep 07 13:50:31.903627 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:31.903578 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5cb74979ff-pq9r2_58b19ac1-af6f-43a1-af40-289be163524f/metrics-server/0.log" Sep 07 13:50:32.095179 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.095150 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7hvb7_f521fd42-93ff-433b-adca-d3bdc658878c/node-exporter/0.log" Sep 07 13:50:32.130397 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.130366 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7hvb7_f521fd42-93ff-433b-adca-d3bdc658878c/kube-rbac-proxy/0.log" Sep 07 13:50:32.168638 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.168609 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7hvb7_f521fd42-93ff-433b-adca-d3bdc658878c/init-textfile/0.log" Sep 07 13:50:32.346113 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.346014 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qzjt4_9215ee1a-36d8-4b43-98ad-dd86794699b7/kube-rbac-proxy-main/0.log" Sep 07 13:50:32.389058 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.389025 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qzjt4_9215ee1a-36d8-4b43-98ad-dd86794699b7/kube-rbac-proxy-self/0.log" Sep 07 13:50:32.421251 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.421215 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qzjt4_9215ee1a-36d8-4b43-98ad-dd86794699b7/openshift-state-metrics/0.log" Sep 07 13:50:32.465464 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.465429 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6416f20d-6bda-4744-b21e-a9ae83b9ae3d/prometheus/0.log" Sep 07 13:50:32.496853 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.496824 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6416f20d-6bda-4744-b21e-a9ae83b9ae3d/config-reloader/0.log" Sep 07 13:50:32.533918 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.533884 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6416f20d-6bda-4744-b21e-a9ae83b9ae3d/thanos-sidecar/0.log" Sep 07 13:50:32.561120 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.561091 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6416f20d-6bda-4744-b21e-a9ae83b9ae3d/kube-rbac-proxy-web/0.log" Sep 07 13:50:32.601884 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.601806 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6416f20d-6bda-4744-b21e-a9ae83b9ae3d/kube-rbac-proxy/0.log" Sep 07 13:50:32.631223 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.631191 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6416f20d-6bda-4744-b21e-a9ae83b9ae3d/kube-rbac-proxy-thanos/0.log" Sep 07 13:50:32.667274 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:32.667241 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6416f20d-6bda-4744-b21e-a9ae83b9ae3d/init-config-reloader/0.log" Sep 07 13:50:33.017972 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:33.017806 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f568487bc-kc4vf_0e5a3f54-8518-4015-9a23-35e39b39c182/thanos-query/0.log" Sep 07 13:50:33.075461 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:33.075430 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f568487bc-kc4vf_0e5a3f54-8518-4015-9a23-35e39b39c182/kube-rbac-proxy-web/0.log" Sep 07 13:50:33.153413 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:33.153382 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f568487bc-kc4vf_0e5a3f54-8518-4015-9a23-35e39b39c182/kube-rbac-proxy/0.log" Sep 07 13:50:33.187344 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:33.187292 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f568487bc-kc4vf_0e5a3f54-8518-4015-9a23-35e39b39c182/prom-label-proxy/0.log" Sep 07 13:50:33.219816 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:33.219787 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f568487bc-kc4vf_0e5a3f54-8518-4015-9a23-35e39b39c182/kube-rbac-proxy-rules/0.log" Sep 07 13:50:33.265788 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:33.265719 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f568487bc-kc4vf_0e5a3f54-8518-4015-9a23-35e39b39c182/kube-rbac-proxy-metrics/0.log" Sep 07 13:50:34.421446 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:34.421368 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-pnqpv_e8c45689-172c-45df-8c17-6b2597f297a1/networking-console-plugin/0.log" Sep 07 13:50:34.881576 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:34.881542 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jfpl8_b687009b-a57a-4c02-925e-af07c3ad9667/console-operator/1.log" Sep 07 13:50:34.886863 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:34.886826 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jfpl8_b687009b-a57a-4c02-925e-af07c3ad9667/console-operator/2.log" Sep 07 13:50:35.009721 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.009679 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8"] Sep 07 13:50:35.014971 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.014944 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.025392 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.025364 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8"] Sep 07 13:50:35.144484 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.144391 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85qbp\" (UniqueName: \"kubernetes.io/projected/07ad6690-9a42-463a-b349-dce3871345b1-kube-api-access-85qbp\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.144657 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.144473 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-sys\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.144657 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.144530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-podres\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.144657 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.144595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-proc\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.144657 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.144624 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-lib-modules\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.246056 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.246012 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-proc\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.246264 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.246069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-lib-modules\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.246264 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.246129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85qbp\" (UniqueName: \"kubernetes.io/projected/07ad6690-9a42-463a-b349-dce3871345b1-kube-api-access-85qbp\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.246264 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.246175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-sys\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.246264 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.246201 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-podres\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.246520 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.246378 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-podres\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.246520 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.246443 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-proc\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.246631 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.246531 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-lib-modules\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.246898 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.246875 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07ad6690-9a42-463a-b349-dce3871345b1-sys\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.256914 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.256888 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85qbp\" (UniqueName: \"kubernetes.io/projected/07ad6690-9a42-463a-b349-dce3871345b1-kube-api-access-85qbp\") pod \"perf-node-gather-daemonset-sbgv8\" (UID: \"07ad6690-9a42-463a-b349-dce3871345b1\") " pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.329158 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.329121 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:35.339060 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.339022 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-mchqm_ac257d6f-b303-42be-bfed-f5c7a8d61bba/download-server/0.log" Sep 07 13:50:35.631204 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.631161 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8"] Sep 07 13:50:35.635594 ip-10-0-131-22 kubenswrapper[2574]: W0907 13:50:35.635555 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod07ad6690_9a42_463a_b349_dce3871345b1.slice/crio-19505810b9acf9460ecfa3dc32a97cb0c54590e2bc9318e10da769962d99523e WatchSource:0}: Error finding container 19505810b9acf9460ecfa3dc32a97cb0c54590e2bc9318e10da769962d99523e: Status 404 returned error can't find the container with id 19505810b9acf9460ecfa3dc32a97cb0c54590e2bc9318e10da769962d99523e Sep 07 13:50:35.865769 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:35.865742 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-g54f9_5ba2609a-b6c3-4972-9929-d2ee663ef8c0/volume-data-source-validator/0.log" Sep 07 13:50:36.032481 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:36.032445 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" event={"ID":"07ad6690-9a42-463a-b349-dce3871345b1","Type":"ContainerStarted","Data":"dc8c914384480be429299e7ee819dadf1e14df100a03397ce8d6a35ee714b604"} Sep 07 13:50:36.032665 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:36.032506 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" event={"ID":"07ad6690-9a42-463a-b349-dce3871345b1","Type":"ContainerStarted","Data":"19505810b9acf9460ecfa3dc32a97cb0c54590e2bc9318e10da769962d99523e"} Sep 07 13:50:36.032665 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:36.032617 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:36.055756 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:36.055708 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" podStartSLOduration=2.055692244 podStartE2EDuration="2.055692244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:50:36.055435396 +0000 UTC m=+668.394896292" watchObservedRunningTime="2026-09-07 13:50:36.055692244 +0000 UTC m=+668.395153136" Sep 07 13:50:36.686499 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:36.686469 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4tchg_b4e67131-76b3-4498-b189-b5e75264b7e0/dns/0.log" Sep 07 13:50:36.711846 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:36.711819 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4tchg_b4e67131-76b3-4498-b189-b5e75264b7e0/kube-rbac-proxy/0.log" Sep 07 13:50:36.918337 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:36.918302 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nqd8q_d8b6de1a-77e8-4fcf-baf1-46dae4022e6b/dns-node-resolver/0.log" Sep 07 13:50:37.496998 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:37.496969 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dwsnv_ec6a5d8f-2407-444c-88f2-d3e836cc90ae/node-ca/0.log" Sep 07 13:50:38.257151 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:38.257121 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69cd4f8474-865kt_3e80ef99-5f11-4f55-bfc0-bf8344d479a1/router/0.log" Sep 07 13:50:38.644115 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:38.644043 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k4zj2_4b2ba3dd-f860-479a-827d-e041f79a87dc/serve-healthcheck-canary/0.log" Sep 07 13:50:39.147093 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:39.147067 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t9rbc_fc8d79cb-3fa4-49a9-8601-ecacd081a6ba/kube-rbac-proxy/0.log" Sep 07 13:50:39.170456 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:39.170433 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t9rbc_fc8d79cb-3fa4-49a9-8601-ecacd081a6ba/exporter/0.log" Sep 07 13:50:39.189335 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:39.189314 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t9rbc_fc8d79cb-3fa4-49a9-8601-ecacd081a6ba/extractor/0.log" Sep 07 13:50:42.050888 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:42.050861 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vzz84/perf-node-gather-daemonset-sbgv8" Sep 07 13:50:46.222323 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:46.222295 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5pnqv_f252181b-ac89-4f41-90d5-87c8d4659dec/kube-multus/0.log" Sep 07 13:50:46.703564 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:46.703533 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxgsh_7a53b129-c0b0-4690-8c9d-017bcc36e246/kube-multus-additional-cni-plugins/0.log" Sep 07 13:50:46.737647 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:46.737622 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxgsh_7a53b129-c0b0-4690-8c9d-017bcc36e246/egress-router-binary-copy/0.log" Sep 07 13:50:46.773630 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:46.773603 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxgsh_7a53b129-c0b0-4690-8c9d-017bcc36e246/cni-plugins/0.log" Sep 07 13:50:46.806993 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:46.806963 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxgsh_7a53b129-c0b0-4690-8c9d-017bcc36e246/bond-cni-plugin/0.log" Sep 07 13:50:46.836538 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:46.836471 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxgsh_7a53b129-c0b0-4690-8c9d-017bcc36e246/routeoverride-cni/0.log" Sep 07 13:50:46.866530 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:46.866504 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxgsh_7a53b129-c0b0-4690-8c9d-017bcc36e246/whereabouts-cni-bincopy/0.log" Sep 07 13:50:46.902849 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:46.902822 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mxgsh_7a53b129-c0b0-4690-8c9d-017bcc36e246/whereabouts-cni/0.log" Sep 07 13:50:47.304396 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:47.304341 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l5pc5_249d9193-e8e4-41bc-8fdb-6520c9380538/network-metrics-daemon/0.log" Sep 07 13:50:47.353488 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:47.353460 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l5pc5_249d9193-e8e4-41bc-8fdb-6520c9380538/kube-rbac-proxy/0.log" Sep 07 13:50:48.764752 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:48.764717 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-controller/0.log" Sep 07 13:50:48.782327 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:48.782298 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-acl-logging/0.log" Sep 07 13:50:48.782487 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:48.782401 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovn-acl-logging/1.log" Sep 07 13:50:48.800465 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:48.800437 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/kube-rbac-proxy-node/0.log" Sep 07 13:50:48.820366 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:48.820331 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 13:50:48.842166 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:48.842115 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/northd/0.log" Sep 07 13:50:48.866328 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:48.866304 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/nbdb/0.log" Sep 07 13:50:48.894451 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:48.894424 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/sbdb/0.log" Sep 07 13:50:48.928188 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:48.928157 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dvsp8_62efdb8c-5ab4-4949-b6aa-78a5e3422f7e/ovnkube-controller/0.log" Sep 07 13:50:49.959821 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:49.959792 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hgqkx_b17085af-30e5-4059-a235-e829361adbf1/network-check-target-container/0.log" Sep 07 13:50:50.903735 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:50.903700 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xgkfr_f81a57de-3969-4153-980b-4273bd38127d/iptables-alerter/0.log" Sep 07 13:50:51.565613 ip-10-0-131-22 kubenswrapper[2574]: I0907 13:50:51.565581 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-ffg6f_346164b8-01d8-4eac-817a-3193599e898f/tuned/0.log"